My guess is that one of your arrow keys is stuck, or, if you are using a joypad, that it isn't calibrated correctly.