ooooookk, you are as bad as I am!!! spoiled kitties, yes!
don't feel bad about taking the toy away, they probably just found something else to play with. and I'm sure they would not want you to have a headache! heck, when they see that cat tree, they will think, gee, lets bug mom again and see what else we can get!!