In 1822 a tenement occupied by John Moor, a weaver, was licensed for Baptist services. In 1835 James Miles, a deacon, left the Particular Baptist chapel, taking some followers with him. They established a church at Hilperton Marsh by fitting out a cottage so that services could be held there. James Miles was regarded by the Particular Baptist minister as very troublesome. Later on services were carried out by the Conigre chapel in Trowbridge but none were held after 1850.