Sydney, you have the same problem I do with meds. They work but only for short spurts and then its a mega-doses. I call it having the constitution of a governmen mule! I also cannot take pain meds because they don't work well or only work for a very short time and I have to take again the mega-dose.
I am on trazadone and take a 100 mgs a night and it seems to work for me for now. I have been on it for about 6 months or so.
As for keeping around meds, it is a good temporary idea but you really need to see your doc and talk things over with him/her. Taking random meds like that could cause issues with other meds you may be taking.