you are having  three remedies

1) complain this to your taluk magistrate

or

2) file a civil case to remove the nuisence

or

3) approach the high court by filing PIL

Mr. Jithender gave you all good options but, anything you choose to do - do that collectively, i mean include all other residents in your locality and do because the factory owner might take it personally against you because he has invested lot of money on his factory.

with all your neighbours file suit of nuisance as it is a silence zone

Complain  in Pollution control Board,if  they donot act on it there is an appellate authority u can file a case there.