With candy-colored cottages, a charming Victorian history, a walkable downtown, inspiring museums, a lighthouse, and kid-pleasing ways to get around town