It answer is quite simple. The neuro does not know much about concussion. This is not uncommon. You will find better advice here.

Take it slow and start adding activities to your day. Keep your exercise low impact. Go in 2 week steps. Add a new activity for 2 weeks before adding another activity. If you cause a return of symptoms, stop the last activity added and give it a couple weeks to get back to symptom free then add another activity.

You know the activities to avoid. Use this time to establish a new routine of activities that will not set you up for future relapses. There are plenty of lower risk activities that can provide a full life experience.

My best to you.