When Henry Nightingale was dismissed from the Old Baptist Chapel this church was founded by 20 people who objected to his dismissal and left at the same time. They formed a Society of Strict Baptists, adopting the rules and articles of the Zion Baptist Church in Trowbridge, meeting in a house in Goose Street for some months. The foundation stone of the new chapel was laid on 1st April 1861 and it opened on 31st July that year. Money was raised by subscription and from friends at Zion. The stone chapel, with slate roof, was built by Henry Pocock of Seend and,with its one gallery, would seat 130 people. A burial ground was added later and a commodious school with a vestry and offices were added at the rear. After Henry Nightingale died in 1877 there was no settled pastor and services were taken by supply ministers. The debt on the chapel was paid off by 1889 and although the congregation was reduced in numbers by 1890 there were 60 pupils at the Sunday School. The chapel closed in the late 20th century and is now a private house.