Grapes are bad for dogs, I would not continue feeding him grapes.

I've never heard anything bad about bananas, apples, or oranges. My husky likes fruit as well and I give him pieces of those from time to time.