I do, but I NEVER give it to them while I'm eating. I always wait until I am done (and everyone else) and then I put the scraps in their bowls and make them sit and then give it to them.

And if they get an excess of table scraps, I calculate that into their daily food amount so I may give them 1/2 less of food or something to compensate