My dad used to tell me there are 36 fundamental skills in kung fu, and they get progressively harder to learn and master. The 36th and last, the most difficult skill, is the art of running away. Escaping and avoiding a fight.
If physical violence insists on sidling up to you, then you wouldn’t be wrong to try to escape that situation, sometimes even if it means literally running away.
Note: as a male, you may catch flak from your friends for this action later if it was done out of cowardice, out of being too scared to defend yourself (because intuitively, if you won’t even protect yourself, then there’s no way you’d protect me, god forbid). That being said, simple street fights can result in shocking consequences (even death and incarceration are not uncommon), so in general try to avoid that potential bad karma.