Yes, definitely taper off slowly.
And, don't let other symptoms confuse you, such as allergies which are bad this year again. Treat those symptoms if you must with a nasal spray, or whatever works for you, and the same with your stomach. Tums, maalox, again whatever works for you!

Hope you feel better soon!

Pete