Is your doctor a neurologist? Have you tried getting a second opinion. Maybe he has a good reason for taking you off Topamax (something in your blood work?) but he isn't explaining it so it makes sense. You have a right to a thorough explanation that is understandable to you.