Yeast can be so tricky to get rid of, so a cleanse is definitely a good idea. One good one that I know of is the Whole Body Yeast Balance by Enzymatic Therapy. It also comes with a probiotic (in the form of acidophilus). Also, whenever you have a yeast problem, it's good to cut/limit carbs and sugars until it's under control, since this is what yeast feeds on.

Also, it's always a good idea to be taking a probiotic all the time anyway. It will help prevent yeast, as well as many other issues. Keeping your "gut" in good health really goes a long way.