I dont think that ginger will hurt Paddington at all.
Cats are usually very careful of what they eat, and wont touch something that will hurt them.