.....or you may have to persue legal measures, which you would hate to do...

Don't be surprised if this rolls off his back, as another 'legal measure' added to those he already has, is just a 'drop in the ocean', to him.
But you may get results if he has broken the law, an existing one,
regarding proper ethical medical practices, and your lawyer threatens
with pursuing it to the Medical Board........that may get results.