Home to the oldest public park in the US and the first American lighthouse, there's no shortage of timeless history.