I have a thought to share with you about this.

When fluid builds up in the middle ear, due to allergy or blockage of the eustachian tube for that ear, it will press on the ear drum
which has nerves connected to it and cause dizziness. In a worst case scenario it might be severe enough to be labeled vertigo.

Sinus congestion may cause this too.

In fact one test for the nerve function of the inner ear called an electronystagmogram blows air on the ear drum to stimulate these nerves and measure the nerve function and viability (they put electrodes on your head to measure this nerve).Water does the same thing with different results. Too much ear wax may also press on the eardrum causing dizziness:
http://www.ehow.com/facts_4759429_di...x-buildup.html

There is also a factoid for bipolar symptoms of mania. Putting cold water in the ear canal, somehow stimulates the ear drum and switches activity in the brain:
http://www.alternativedepressionther...wo-brains.html

So I don't know what "experts" told you what you claim. The nerves in the ear ARE there and have effects on perception.