The Diocese of East Anglia has admitted making historic mistakes in allowing a Catholic priest who had a conviction for indecency in New Zealand in 1976 to play a role in parishes across Norfolk and Suffolk from the 1980s.