There were Quakers in the Devizes area in the 1650s and in 1658 Samuel Noyes, their leader, was prosecuted for 'brawling in church'. A burial ground was acquired in 1665, probably in Hillworth Park, where one existed in 1759. In 1669 there was a meeting in the house of John May with attendances of 80-100 people. By 1682 John Clark's house was licensed and others followed later. In 1702 a newly erected house at 23 High Street was certified for meetings and this became the sole meeting place. Anglicans and other nonconformist denominations helped in the building of this house.
During the 18th century many leading families in the town were Quakers and the meetings were also attended by non Quakers. In the 1790s there were about 30 Friends and the meeting house remained in use until 1826. The meeting then lapsed and the house was sold in 1840. The meeting revived in 1853 and the old meeting house was re-purchased in 1858, remaining in use until the 1870s. The meeting was discontinued in 1879 and the house was again sold in 1884. It was re-occupied between 1903 and 1907 by a small number of Friends.