The extensive area of the Witney Mill complex was based around the site of Woodford Mill, a medieval fulling mill and one of the oldest wool related sites in Witney. The earliest structures still standing today are the former mill offices by the entrance on Mill Street, dating from around 1750. The 110ft chimney stack was built in 1895.

From the 1820s the Early family began to acquire land piece by piece around this area. Charles Early bought Woodford Mill in 1888 and now the whole site, known as Witney Mill, was under single ownership. It gradually became a centralised unit for blanket making, where all processes could take place.

A serious fire in 1905 destroyed the original central building of Witney Mill, in a blaze so fierce that it was reportedly seen as far away as Reading, over 30 miles away! The story goes that Charles Early, by now an elderly man, is said to have asked the Fire Chief “ls everybody safe?", “Yes, Mr Early”, “Can anything be done to save the Mill?”, “No, I'm afraid not” came the reply. “Then let us enjoy the spectacle”.

The buildings were rebuilt and extended. In the 1960s, following the merger of Early's and Marriott's, a large warehouse and office block were built as the new centre for operations.

Still trading under the name of Early until its closure in 2002, Witney Mill was the town's last working blanket factory.