Traditional-music enthusiasts may be interested in this sweet little museum, which displays 19th-century instruments and offers recordings of Icelandic songs and chants. It's free to enter if you have a ticket to the Herring Era Museum.
