Yes, cats do have belly buttons, they are just hard to see under all their fur.
Here is a link with more info...

Belly buttons

Unless your cat is an alien, it has a belly button.