I think that dogs are like humans when they grieve. They can be so sad.
My sister's dog Pugsley was like that when one of our cats died. Puglsey was quite fond of the Chelsea the cat, and when Chelsea died, she was so upset. She was off her food (and this is a dog that LOVES to eat). It took her a while but she did get over it.