I would take him back to the vet and have them do a skin scraping to find out of he by chance has mange. (his chances are higher because he came from a shelter)
When a dog has mange, the hair loss would be around the edge of his ears, and his hocks first, then as it gets worse it spreads all over.