After discovering this old fort built in 1853, which was the highlight of our visit, we decided to head up the east coast