It depends on who the person is. If it's someone I look up to and like, then yes it bothers me. But, if it's someone who annoys me and is rude to me, then no... It doesn't bother me that they don't like me, I'd just rather not associate with them.