Thanks for all the suggestions everyone!
So, I've done a lot of troubleshooting.
It's not specific to one guitar - not single coils - my ESP has EMG pickups so I changed to a new battery.
I've tried both using the Axe as SPDIF and as an interface - issue was still there.
I've managed to make it pretty much completely gone now - can't hear my mouse on scroll anymore - I did disconnect the mouse and it didn't help. I'm using a wireless keyboard but I honestly think that the issue is routed to the motherboard or GPU.
I've gone into my BIOS and disabled EIST - this has helped. I've increased the noise gate threshold on the preset and that really has helped too.
I've still got the issue - I have to get my guitar really close to the case to hear interference. I haven't solved the problem but it's more usable now. Pickups will pick up EMI so it's natural for this to happen - I was just hearing it way more than I should.
Without spending more time and money, I don't think I'll get this 100% solved.
I did use to record with Guitar Rig 5 and never noticed this issue. Maybe it was because the presets weren't as 'noisy' and didn't make it as noticeable. Preset 55 'Dweezil's Bassguy' on the Axe III was where I first noticed the issue - it's a very 'noisy' preset with the noise gate at the default setting. I turn that up to -60 and it's much better to me.
I have a lot more to learn - I've quickly come to realise that the factory presets are there to show what the Axe can do to an extent ... but the true power comes with creating your own presets that sound good with your own equipment. None of the factory presets are useful to me but I don't expect them to be.
TIme for me to venture into some third party IRs and create my own presets ... and eventually get a mac
Thanks again.