The earliest known reference to quarrying in Tormarton is 4th March 1793 when James Gingell was killed "in consequence of a certain quantity of Earth & Rubbish falling upon his Body as he was raising Stone in a certain Quarry in the Parish of Tormarton".

Brookman's Quarry in Tormarton is an underground one, it is pencilled on a map of the Manor of Tormarton dated 1763, and is thus of later date. Thomas Brookman a farmer worked it up to 1863, from 1864 it appears to have been worked by the Badminton Estate, digging continued up to 1916 when the quarry closed. In the summer of 1936 the Bath & Portland Stone Firms Ltd sunk a shaft in the floor of the quarry in order to test the nature of the stone at a greater depth, the Badminton Estate paid £25 towards the cost. The work was done by Owen Bishop, a well known Corsham ganger. The gang included Ted Gibbons of Gastard who died in the early 1990s, he was the last man to work underground at Tormarton.

Tormarton stone was used for the restoration of Acton Turville Church in 1853, for the new font and the pillars and arches which separate the Aisles from the Nave and the corbels supporting the roof. A new font was supplied to West Littleton church in 1856.