Have you called and asked your vet? I'd get their opinion on it and go from there. They might even be willing to board him there without him being neutered yet.