I think it's time to go shopping, Donna! Or go on Amazon.
There are cross-body bags that lay very close to the body. You can't keep a ton of things in there, but you can fit the essentials in. You could even wear one on a rollercoaster...
He could keep his regular purse, and just switch bags for outings. I think that is a good compromise