I would say it's a monitor and/or driver issue for the video card.
It's odd that a drawn square would look correct, until you rotate it....
When a place I worked at first brought 19" lcd's into the office, all circles were ellipses.
Took some fiddling with the resolution to get them to be circles again...
Might be someplace to start...
Pieter