If you are just walking at a casual pace, I think your response is either anxiety or due to over-attending from the audiobook or watching your mobile screen.

A casual walk increase blood flow but only increases calorie burn by about 40 to 50% over sitting. That should not cause physical fatigue.

The over-attending can cause mental fatigue that can result in the dizziness and other symptoms.