Are you by any chance using a computer that has an Intel video chipset?

I know that I had issues of this kind when I used the i810 driver on my laptop. I have since switched to the newer Intel driver (package xserver-xorg-video-intel) which doesn't exhibit that problem.