I believe that your marriage exists from a legal perspective even if it is not registered. This is subject to the condition that it was solemnized with proper religious procedures, which I presume it was. So, you are a married woman! Congratulations!!
Now lets talk about future. You need to think hard before you decide to divorce. Grass is always greener on the other side until you reach there. Point is, your next husband may not be a better one. Marriage consists of a set of compromises and only when you are convinced that you have sacrificed enough, should you think of divorce. Think real hard. There are some monstrous men out there (and even bigger monstrous women). You may be having a good husband relatively speaking! Look closer... may be divorce is not what you want.
Assuming that you have decided to divorce: What you describe above will not satisfy the criterion for mental or physical cruelty so cruelty as a basis for divorce will be thrown out unless your husband gets a bad advocate. A good advocate will argue that this is just a regular wear-and-tear in a marriage not amounting to cruelty. You will be wasting your time in pursuing divorce based upon cruelty.
Next option: Divorce based upon desertion. You need to be deserted by him for two years. So, you will need to show evidence that your attempt to reconcile with him have failed because of him and that you have been separate for two years. Cunning wives (and there are no shortages of these types) usually stay away for two years during which time they smartly collect evidence to blame the separation on their husband. And Voila!! Its divorce based upon desertion.
Last option: Mutual consent. It appears that he does not want it. That means one or more of the following: He loves you a lot, he loves your earnings or potential earnings (may be inheritance) or he hates you a lot or he is concerned about paying you maintenance. If you want to get remarried which it appears you want to, give him a suggestion: Lets get divorced and I will waive maintenance. Now, technically speaking, maintenance cannot be waived but you can work something out that is legally sustainable and makes both of you happy.
Conclusion: Analyze your situation. Think practically. Shut your emotions in a drawer. Take firm decisions before you take the next step. Once taken, do not waiver from the decision no matter what. Then plan and execute the plan to reach your goal in a methodical and unemotional manner. Before you go out there and hire an advocate, do a thorough reading on all the applicable Acts.
GOOD LUCK!!!