Unless things become better with you and your husband dont have a baby. It will only affect the child and you will be stuck forever. going on a vacationmay have brought you closer to your husband. But your financial status does suggest scope for such expenditure. Try spending more time with your husband. Try to have a new start. Give it 6 months before you have a baby. If things dont change for the better then opt for a divorce. If there is a part of you that wants this marriage then hold on to it. I personally respect marriages. Its not a game that you can quit when you feel you are losing. Any husband would get angry looking at his wife talk to her ex. I suggest trying to make things better. Communicate. Thats what is important. Tell your husband what you want.
All the best!