I would go to the Grandfather's birthday party. Blood is thicker than water as they say. I think his family will understand and if they don't, that would concern me.