Yes, I have a couple on the side of the monitor I'm typing this on and they always seem wrong to me once I get something plugged in (after one or two failed attempts, of course).

Also doesn't help when the lighting's not so good and you have a USB logo embossed in black plastic on a black plug with the manufacturer's logo embossed in the same way on the other side. Trial-and-error probably isn't as bad as squinting at it trying to figure out which side is "up"...