Even if you don't plan to get wet, it's worth a peek inside the Altes Stadtbad , a stunning Art Nouveau covered swimming pool with ornamental tiles and stained-glass windows. Check with the tourist office as opening hours vary; it's generally closed during summer.
