Don't over-react. My husband and I have driven past people's houses to take a peek at times too. It is human curiosity. So unless you fear your boss for OTHER reasons, just brush it off and don't feel threatened.

By the way, that is a FANTASTIC color for a car!