Since marriage already stand solemnized, socially both of you would remain as husband and wife. By virtue of which, she would be entitled to all the rights as a wife unless and until the marriage is decreed to be as invalid or void on application by any of your wife or other concerned. Even after the law declares your marriage invalid or void, nobody can restrain you to extend rights of a wife to that girl till you are mentally prepared to do so.
Of course, even after the law comes in to your way, even law would not snatch the right of the child to be known as your own child and to use your name as his father.