Building work on the church began in 1264 and in 1269 Bishop de la Wyle founded a collegiate church here in 1269 to serve the newly created parish of St. Edmund. Nothing remains of this church and in 1407 a church here was said to be newly built. It was cruciform with a central tower, aisled nave, aisled chancel, a south Lady Chapel and a north chapel of St. John the Baptist. The nave was used as the parish church and the chancel used by the priests of the college. In 1624 the state of the tower was causing concern as the roof of the chancel was slipping away from it. In 1638 three buttresses were built to support the north wall and in 1653 all but two bells and the weather vane were removed from the tower.