What To Do In Madison · Visit downtown! · Hike and see the waterfalls at Clifty Falls State Park. · Visit the Lanier Mansion Historic Site, an 1844 Greek Revival ...