Call the cops the next time there is a party.

Chances are they know this guy...

(Actually, it's your landlady that should be calling them, considering there are children in the building...not really safe for them....)