I'm sorry, what even is this argument?? The commenter above you is saying that women have enough proven experience of men being shitty to have to prepare for it in every interaction. Even if they know that it's 'not all men' it's enough that they have to assume it could be any single one.

The only way this could be comparable to racism is if people had legitimate reasons to mistrust other races, which is not the case. Racism is the result of exaggerated stories and mistrust being created about a community with whom the racist generally has no connection.

Most of the time women being wary of men doesn't lead to misandry, it just leads to world-weariness and guardedness around men until we know we can trust them. But even if it did, misandry and misogyny are not equivalent. Misogyny is a prejudice which has been embedded in society for millennia and which has only begun to be deconstructed in the last century. Misandry is a response to this condition, but it is not structural, it's the position held by a handful of women exhausted by their shitty experiences with shitty men.

It's honestly a wonder that more women don't viscerally hate every man in existence, and men should be thankful that we continue to go out and put ourselves out there despite the plethora of bad and downright dangerous things we've experienced. Knowing that men can do awful things and preparing for that possibility is just a survival tactic for remaining in the world.

...sure, I guess? An argument can be repurposed to try and make a lot of different points. Here's the thing though...

A logical argument is considered valid if its conclusion follows necessarily from its premises, meaning that if the premises are true, the conclusion must also be true. However, an argument can be valid but not necessarily true (like the argument you're suggesting). This is because validity only concerns the form of the argument, not the truth of the premises or the conclusion.

Here are some examples of valid but not necessarily true arguments:

Modus ponens: If it's raining, then the streets will be wet. It is raining. Therefore, the streets will be wet. This argument is valid because it follows the form of a valid argument, but it may not be true if the streets are not wet for some other reason.

Modus tollens: If it is not raining, then the streets will not be wet. The streets are not wet. Therefore, it is not raining. This argument is valid because it follows the form of a valid argument, but it may not be true if the streets are not wet for some other reason.

Hypothetical syllogism: If it is raining, then the streets will be wet. If the streets are wet, then the roads are slippery. Therefore, if it is raining, then the roads are slippery. This argument is valid because it follows the form of a valid argument, but it may not be true if the roads are not slippery for some other reason.

In each of these examples, the argument is valid because it follows a valid logical form, but it may not be true because the premises or conclusion may not be true.

Now think about the "enough men" argument. It's not translatable to misogyny and racism because the context (the premises) is vastly different for people who don't identify as men, and for people who are not white, straight, or really any other centered group (these things vary a lot depending on the specific culture you're looking at and the intersectional dynamics that exist). Not enough women are violent towards men (though this does happen, and it is also bad) for men to have a realistic need to protect themselves in as many interactions.

Using the argument out of specific context, without true premises, nearly guarantees that the argument will no longer be true, while still being logically valid.

It's not misandry to be wary around men. Rape culture is a thing. It is not equivalent to racism.

Lemme try again. The same argument is not used (at least, not legitimately) to justify racism, because you do not have to actively take precautions to defend yourself from people of other races.

Ask any woman, they'll let you know that some guys take that "wow, I super hated being treated like that" and don't wisely stay the fuck away. Someone who cannot empathize with the caution women have to show around strangers is probably not the best partner anyway.

Do people give you a ton of flak, or do they complain about things they've experienced exclusively at the hands of men and you're getting defensive about it?

Maybe because you defend them. Or they see you not being a proactive force. It's not enough to stand by and wait for something horrendous to happen to try to stop. You need to be part of the culture of change which means changing how you joke and talk about things to actively pursuing to change even bad and minor habits of those you socialize with.

Anything less is condoning.