I'm not a bad neighbour but I wouldn't sweep it up simply because I'm not able to and the fact that there's no friendly relationship between us. I didn't realize it was in front of my house in which case I would probably go over and politely ask them to pick it up in case a dog or child stepped on it or even myself.