By 1852 a group had amicably seceded from the Wesleyan Methodists and set up a separate chapel. They first met in a disused and dilapidated malthouse and in 1852 a license was issued to hold meetings in a building in the possession and occupation of Samuel Marshman, the Devizes photographer. The group became strong enough to build a chapel on 'Lower Churchyard' and prospered for some time. They used the United Sunday School with the Wesleyans and Methodists. They decined in the early 20th century and the chapel closed during the First World War. The residue of the congregation became the nucleus of the Open Brethren and the chapel was re-opened as a mission room.