"He then sent me home.. said it made no sense to come back since at my age I should have been worse."


IMO, "He" needs to get his head out of you know where, and read up on what he is supposed to be specializing in. Age has nothing to do with it. Gee Whiz.
Clearly you need to see someone who has a handle on diagnosing neuro-immune disorders. You might try going back in to your PCP and talking about why every doctor has said "why haven't you been dx yet" to you. Tell your PCP it is because they, including him/her are not assessing you, but are apparently just dismissing you; and that you now need the reassurance that the referral that your PCP sends to the neuro that he/she has referred you to, outlines this part of your history with 'specialists' and doctors, as well as the importance and urgency of getting a diagnosis ASAP.

You can also press your PCP to phone the specialist and not to just send in the referral. During that call, the PCP should ask the neuro what they suggest in the interim, seeing as you haven't been diagnosed and you Sxs are getting worse. That might get you in sooner for both the MRI and in to see the neuro.
If your PCP won't do this, you might need to find another PCP. Even with Canada's health care system problems, how you are being treated is not acceptable; especially when you have relatively easy access to the resources in Toronto.

My PCP referred me to a general neuro while I waited to see the MS neuro that I have now. The wait to get in to see the general neuro was a couple of weeks because my PCP called the guy and said that there had been sudden and profound changes in my status. I had recently lost the upper left hand visual field in both eyes and was unable to stand with my eyes closed.

That neuro worked out of the regional hospital where the satellite MS Clinic is located in Northern B.C. He assessed and documented my Sxs, and also ordered an MRI stat, as he thought that I might have something else going on besides MS. I was actually happy to learn that he found only new lesions, so that the wait to see the MS neuro wasn't so bad, but all of those assessments and test results were available to the MS neuro when I saw him a year later.

Please go back to your PCP to see how the referral has been sent and to see if he/she will push a little harder with a phone call. Sometimes that can make all the difference.

With love, Erika