Best thing would have been to put 'gals only' in the invitation if that's what you really wanted all along. Since you didn't do that, I'd say you're safe not having to notify everyone else that's coming that a guy will be there. If he's fine with that theme of the party, and you're comfortable with him there, then just have fun! Good luck.