I agree with your doctor about no caffeine.

Sugar might be associated with your headaches if you get your caffeine in sugary drinks. If you quit drinking sugary drinks containing caffeine, that will help. But it's the caffeine, not the sugar, that causes the headaches.

I think "rebound headache" is a misnomer for withdrawal headache.