Square wheels work fine if the road accommodates them — in this case, the road must be a series of catenaries suited to the size of the square. (A catenary is the shape that a cable assumes when suspended by its ends.)
Macalester College mathematician Stan Wagon designed a square-wheeled tricycle in 2004, and physics students at Texas A&M built a companion in 2007 (below).