I think Esther has great suggestions. And maybe tell him that because the appointment is priority, hanging is out isn't so great today, but you could get together another day when you don't have something "big" like that going on. You might also need to suggest some things that you have a better chance of tolerating than a coffee shop, like "sit in my living room and talk."