“The Birthplace of Russia” might be a little off the beaten path, but it houses plenty of surprises for the enthusiastic history buff.