Use the entrance at Borovitskaya Tower if you intend to skip the churches and visit only the Armoury or Diamond Fund.
