I am not an expert in this matter but have experienced Ups and downs of long distance relationship and the love for work from partner.
One thing which one of my close friend told me and which I have also started believing is that for some people their individual life, lifestyle, independence becomes a habit and they get addicted to it. It becomes their personal space rather comfort zone. Which is unfortunately not good for any husband -wife relationship.coming out of their comfort zone pisses them off badly . I am talking general.
My suggestion is , if your relate to what i have written above, please increase the frequently of your visit. Do not make him habitual of staying alone. PLan short visit to avoid and feuds..this might help….
Its just 2 years.. you might wait for increasing your your family….