Not knowing (and definitely not wanting to pry or seem intrusive) how referrals work for you re: your docs/insurance, if not feeling good about how you're being treated, and if the option is available, I'd do one or both of the following:

A) Schedule an appointment specifically for a heart-to-heart with the neurologist and relay how I'm feeling (put off or dismissed, etc.) and why so. I'd pitch it back to the doc, and ask how he/she thinks that can change. If no resolution...

B) Ask - PCP - for a referral to another neurologist.