A company is seeking consent to keep quarrying and working stone in Calderdale - but neighbours have raised concerns.