What exactly happened did not see a thread on it - but if you are meeting him for coffee start your list and write down what is important and why you felt you had no choice but to stay at home the following day. Also be assertive about this you cannot let him see that you are afraid or worried about the meeting.

I'm going to pm you now...