It's not you who can judge, but the people who
feel
threatened. Just a basic fact.
Actually such a question would need to be judged by an outside standard.
Neither side should be allowed to make this kind of call for themselves.
That's why we have codified laws and judicial systems. But even for
arguments between children on the playground, a third party is often
called upon to decide a disputed point.