In general, I just don't think it is fair for someone who can work, takes no meds and does not see the dr should get SSDI. I have the same impairments as well as 3 other issues and I would never think of stopping my meds...I would probably be dead...seriously. I NEED to see the dr. I don't see anything wrong with them denying you. I am sorry that sounds so harsh...I feel for you, and I am sorry you are going through this. I really do feel badly, I wish you the very best. I hope that if you start to deteriorate(can't spell) that you see your dr regularly and start your meds again.
I hope things go well for you!