I would tell your PCP (bring along a trusted advocate like family or dear friend) you expect a referral to neurologist.

Failing that solution, I would simply find a new primary care doc. Look for one highly recommended by people you trust - a doctor who listens, keeps an open mind and keeps current on the latest findings, and is not challenged by not being able to diagnose or "fix" your medical issues.

Good luck and I hope you find the answer and solution to what ails you - regardless of the diagnosis.