My story may not help cause this was years ago when I had no pain issues just mental. Anyhow I was on so many meds and have went off so many meds. I think a big key is the approach your doc takes when weaning you off. No cold turkey for sure and sometimes it needs to be slower for some.I would encourage you to call your docs and express your concerns.I had one med I had to go back on and wean slower. Also and again not when I was in pain but with my depression/anxiety/ocd I wanted to go off a med cause I thought it wasn't helping. My psych said though it may have not fixed me it may have been helping so if symptoms got worse to call him. So you too cause then you may need to start as you say your baseline or get more help.Feel better and I understand worry.