I think you already know what to do. You need to let your husband take on some more of the responsibility of feeding, holding, walking outside, playing games, etc. He'll come around. Might be hard for you though, Tanya, to keep your hands off the little boy for a while. But I think it will help.
Good luck!
Logan