I’m Sorry to know that you are in this position.
In my opinion, its unreasonable to expect you to just follow all his demands without considering your wishes.. isn’t marriage supposed to be about mutual understanding and respect? Stand your ground if you feel insulted. Tell him that you have every bit of rights to with your son if not more.
So tell your husband that you are willing to take professional guidance to work this thing through..
Hoping I was of some help!