You know your cat better than any of us. And it sounds like he's not being himself so I would say take him in. Better to be safe than sorry, especially since he already has health issues. It may be nothing, but you'd feel a lot better hearing that from the vet than worrying about him.