From public parks to historic sites and districts, you can always find something to do that won't blow your budget.