Established in 1908 as Taiwan's first public museum, the present location in 2-28 Park hails from 1915. Unless there is a special exhibit happening (and they are frequent and often excellent), give this place a miss as the permanent natural history and prehistory displays aren't particularly interesting and have little accompanying English write-up.
