At one time I had 5 litter boxes in my house with the 4 cats. They seem to ALL like the same box except for Boo. (she does not like a covered box).

If I were you, I would try moving that box to another room just to see if he will still do that. He may think that is what they are there for and don't want to hurt your feelings... They are such funny little creatures.