Not allowing to use road to commute.

Sir, I need to take metro so as to reach my tuition.In order to reach metoStation i need to take a road that goes through a colony.Suddenly a man comes infront of my scooter and asks me to take u turn and says outsiders are not allowed to enter the society and talks in very disrespectful manner. My question is if it is allowed something like this to happen on the grounds of our constitution.Am I not allowed to take the road that goes through a colony that's not even a society.