Eight other architects also submitted designs, but Hoban won. The "White House" proposed by Hoban was a refined Georgian mansion in the Palladian style. Built of pale gray sandstone, it would have three floors and more than 100 rooms.
I just HAD to check out the idea of a pink White House. This is one description I found of the original house.

When it was rebuilt after the war of 1812, the sandstone was painted white, largely to hid the burn marks.

Can't find any reference to PINK.