The Bishop of Norwich will arrive by wherry to lead an open-air service in the riverside ruins of St Benet’s Abbey, to which all are welcome. By Anna Heydon