Kind of reminds me of when Rachell got a cat on Friends, I don't know whether you remember the episode, or have ever watched the show even. She loved cats, but this cat kept biting and scratching her for no reason(it was one of those hairless cats?). When I first got Grover and she got into the playful mode, she was sleeping with me, I would wake up with scratches all over my hands and knees, how did I sleep through that? She is i guess about seven months old now, and has developed her own independent personality and she still will scratch me, but only when I am wanting to hold her, but she doesn't want to be held. There is a certain time of day though when she does think it is time for our little nap together. I do have one cat, that I got as a kitten, for awhile he tolerated me, now he wants me to just leave him alone, he will even growl at me if I just touch him. So you may just have one that is very independent. Why would we be mad at you for giving it back, sometimes things just don't work out, I completely understand, and I gave ten dollars for the one that don't like me, only when I have food then he like me. LOL. But no, there is no reason to be mad at you for that.
I think I have a picture of him in my photo album, he loves everybody but me, could it be because I had him neutered? LOL.