1. I wonder why dh told you what they said?? to gossip and hurt your feelings- because that's what happened..
2. Did he have your back and defend you to them , or just keep quiet, or agree with them??
But, I would try to not worry about what they think & say, and when you can focus on your & dh relationship..