Are you talking about the audio latency going into your DAW over USB from the Axe ??
If so, you have a problem somewhere... I can get by with the minimum 2 ms that the driver supports with no dropout.
What's ur setup ?
You probably need lower the latency settings on the driver. They are pretty conservative by default.
Plug your speakers into the Axe, not your PC [if you haven't].
I had same problem. Your Axe will be your soundsource. Works perfectly now.
tried that helped a lil bit
Yep. Same issue I had.