I've never really noticed my cats getting really grumpy or upset with me. There was one time though, when I first adopted Cirrus, Sunny was terrified of him and very mad at me. He would sit up in the highest perch of the cat tree and he wouldn't come down for me. He just ignored me.

When AmberLee came over to see Cirrus for the first time, Sunny came down from the cat tree and came running over to her. I told her that I was surprised that he did this because he was ignoring me. She said "Well I didn't bring a new cat into your house." I then realized what was going on. Luckily this didn't last too long because now Sunny and Cirrus are buddies.