I can somewhat relate. I can only wear slip ons or loose fitting shoes. Most of the time, I wear flip flops as they are the most comfortable. In the winter, I wear slippers all day. If I go out, I have some warmer slip on shoes. The sneakers I have are slip ons with the elastic you described. They don't bother my feet at all.