I would find a less risky sport for now... at least wait until you have no issues flaring up from minor jolts/bumps for many months.
And start back very slowly with any risky activity when you are doing better long term..

It does sound like your neck has soft tissue /stability issues..
Possibly your C1/C2 needs adjusted..
Explore Up C Spine for info on that.

Explore the sticky threads in the upper area on the main PCS/TBI page.

Anxiety & worry can re create some symptoms also.. sorting those out is important.