

Yes, the fear is typically that we don’t want to be accused of following you, sneaking up on you, or being creepy, so there is usually some noise or overt thing we do to try to imply we are just minding our own business.
Sometimes to avoid the situation all together, (let’s say I am walking home at night and I see some woman walking the same direction ahead of me, and I know I am going to end up passing her because my pace is faster), then we will literally cross the street just so that we don’t have to be put in the awkward situation of walking up to and past you at 3 am on a public sidewalk.
There are other things beyond this as well that men do or avoid doing which women might not realize. Most men in my experience are really careful to never be left alone with children for example. No one blinks an eye if a woman is, but men have learned to avoid potential false accusations in this way as well.
A lot of men are fearful to do something as simple as taking their kids to the park because of this. You can search for articles in which fathers who take their own kids to the park have been accused of being pedophiles just for sitting on a bench while their children play, or accused of kidnapping just because they are an adult man with a child in public. You won’t find any articles about this happening with a woman.
I purchased a hammer at a dollar store once, just to see how bad it was.
I found out when the head of the hammer flew off on a back-swing and put a whole in the wall. The neck of the hammer was made of flimsy, hollow tube metal and the head had only been tack-welded on in 2 places.