I am mostly concerned about your reaction to what was going on. While it doesn't sound like Sophie was being hurt, someone was invading your personal comfort zone. You said you were upset by it....so, why not instantly say, "hey, you might think I am over reacting, and maybe I am, but, I am not comfortable with the way you are handling Sophie". That way, your personal feelings are addressed first and foremost, and second, there isn't any danger of hurting Sophie.