As you are not harming another person, this fetish doesn't sound "freakish" or "perverted".

Other articles of female clothing have been the subject of arousal, black nylons and garter belts for example.

Don't beat yourself up, and over dramatize this.