The 1856 lighthouse, at the south end of A St, still operates on a tiny, rocky island that you can easily reach at low tide. You can also get a tour of the onsite museum for $3. Note that the listed hours are subject to change due to tides and weather.
