Since marriage is not solemnized or registered, you can just as well live seperate ... i dont think there is anything legal which can be done by either of the party since the marriage is not legally registered.
In that case, inform your parents/elders your decision to stay seperate and agree for no further disputes (out of court settlement)
