I don’t think forcing people to wear any clothes is comparable to banning specific types of clothes.

There are differences, but I'd actually argue that only banning very specific clothing is a lesser infraction on liberty. If you really want to be nude, you have to ditch clothing altogether. With specific garments there tends to be some wiggle room. E.g. you might try to adhere to your religious rules by wearing a wig and baggy clothing.

Edit: I agree with you that it's based on the "offending portion" but that's the case with religious clothing in France. A lot of people there are offended by it.