Dear NuttyB,
You don't have to look at it as closing doors behind you. I am sure that if you stop seeing your pdoc for a while, you could still go back. And if you tell him the very practical reason that he cannot see you in the hospital, he will accept it.
Your main concern right now seems to be continuity of care while in the hospital. This is hugely important and can make the difference in lots of things. So I like the idea of the hospital pdoc.
If he has Borderline for a hobby horse, that could be annoying. But you can explain things to him. He is probably smart enough.
Mari