Plans have been announced to bring a former Knottingley quarry back into use for the first time in 30 years.
Concrete supplier Plasmor hopes to quarry for limestone at Park Balk Quarry just off Womersley Road.
The company said the project was “essential” to protect jobs” at its Womersley Road factory.
But people living near the site - on The Poplars and Downland Crescent - claim the development would lead to unsuitable levels of noise and dust.
Gloria Vaughan, of The Poplars, said: “We launched a petition last Thursday and we’ve got more than 100 signatures already which just shows how strongly people feel about it.
“The response we’ve had has been unbelievable.
“Our main concerns are that there will be an awful lot of machinery on the site, making lots of noise and creating lots of dust.
“The boundary of the site is literally over my back fence. It is just not a suitable site for quarrying given how close people’s homes are to the site.”
Ms Vaughan, who has lived on the street for 28 years, said there were also concerns about the effect dust from the site could have on people living close to the site.
She said: “I’ve got asthma and if these plans were to go ahead it certainly wouldn’t do my health any good.
“There are also a lot of elderly people who live around the site and people who work nights so the noise could be a real problem.
“There is nothing worse than the sound of reversing vehicles and heavy machinery and we would get it constantly.”
Ms Vaughan said people in the area already have problems with lorries coming through the town.
She said: “We are going to fight these plans all the way. “
For more information on the campaign visit www.facebook.com/notoplasmor/