Rescue Remedy can be found in any health food store. You can either put it in their water or just put it directly in their mouth.

Good luck. If it's any consolation, MooShoo, who is neutered tries to mount my girls all the time. They just turn around and smack him silly. He's such a goof.