I actually found what my problem was! It was the stupid mouse (wireless BenQ). When I press on of the buttons, the mouse jumps! Go figure. I found out when I tried it on another computer and got the same symptoms. Now I changed my mouse and all is good
(This has nothing to do with my GPS receiver after all)