Abby I went through the same emotions!! I got my permit a couple months ago strictly so I can conserve energy. For example our K-Mart has a huge parking lot but even the handicapped parking is some distant from the door and that parking lot gets blazing hot. Heck I have given some thought to using the Handicapped carts because my wife is a slow shopper and if I am on my feet long I really get weak. Right now I hunt for a spot to sit for a bit and rest. I have finally convinced myself to think of conserving my energy instead of worrying about what others think. Heck if I explained what my problems are the doctors don't even understand much less the general public. My new son-in-law asked me why I didn't exercise more to improve my strength!!!
Do what you have to do for yourself.
Mike