I think I'd just ask him to have coffee afterwards, that way if you fall apart, he can see for himself that you don't have much to give right now. Might help him for any future times too. It might be embarassing at first but there's nothing quite like your body telling people "no" when they won't listen to you saying "no" in the first place.