He's lost and confused, homesick so to speak, probably frightened beyond belief..

He needs attention and reassurance that he's home and he's welcome there. Probably why he went to sleep after playing with him.

He's so beautiful, just have patience, I think you're farther along than you think if the other cats arent picking on him, and vice versa.