As the property's legal owner through a gift deed, you have certain rights over its usage. Filing a suit of permanent injunction against your brother and his wife is possible under the Specific Relief Act, seeking to prevent their entry onto your property. The act protects your possession rights and restricts their entry without lawful authority.
However, their legal remedies could involve challenging the injunction by asserting their right to reside if they can prove any prior agreements, tenancy rights, or familial arrangements allowing their stay. If they've contributed financially or if any promise was made for their accommodation, it could affect the case's outcome.
The case of Ram Sumer Puri Mahant vs State of UP and Ors. established that if an individual's possession is lawful and based on consent, injunctions might not be granted without due process. Therefore, your brother and his wife might argue for their right to stay based on prior arrangements, which could impact the court's decision.
Consulting a legal expert for tailored advice considering all relevant aspects of the situation would be crucial before taking legal action.