Many experience such a sensitivity. I believe it is anxiety in many cases. After the initial contact, the "Was that hard enough to cause damage ?" though takes over and the resulting anxiety causes brain fog and even head aches.

It's best to learn to just ignore these head contacts.