Maybe isolation in a well-lit room for awhile would help your buff guy . It would let him have some territory while he gradually adjusts to your brood.