What if the next time it happens you just appear at the window and stare back at them with a look of "WTH" on your face? Think they'd get the picture??