Where and When Will Ollie's Open Its New Massachusetts Store? Fitchburg, MA 01420Ollie's posted a message on its website regarding the opening of the new Massachusetts store. Hey folks, we’re celebrating the opening of our new store in Fitchburg on Wednesday, October 15th. Find us off John Fitch Hwy, in Wallace Plaza in the old Big Lots! You can get more details about the Fitchburg store opening by going here.