Assuming you have a control pad connected, may not be the best answer, but it seems if your control pads left stick is even slightly not centered, it affects the mouse.
In star wars, I move the left stick up and down, left and right, and keep trying mouse until mouse works perfectly.
Basically you're trying to recenter your left stick, so always move it around and finish movements in the middle, until mouse works.