My vet said to only feed fish to a cat iregularly because of the threat of fatty tissue build up around the liver. (I can't think of the name he gave it)

I don't think your kitty would be getting all the he needs out of fish. I would be giving him some red meat or good quality cat food.