Hi there,
I had my first massive Panic Attack - which led to a lifetime of Anxiety issues - at 22. If your symptoms extend further than talking to this girl I would suggest a little Counselling.

As for your Love. You only see her 1-2 times a year with no contact inbetween, right? I would lock this up in my heart as a painful, unrequited Love and find someone in my area with the same interests, that I see on a regular basis. Friendship is always a strong foundation on which to build a relationship.

In the interim, get out, join Clubs, meet people to boost your confidence over approaching and talking to strangers and Love interests.

Dave.