Your right to swing your fist ends at the other's guy's nose. But what if the other guy is Pinocchio, and his nose is growing? Your freedom is being restricted by his expanding sense of harm.

Some ideas of "harm" are unreasonable. Via Dan Carlin, Common Sense #269, "The Challenges Of Living Dangerously" at about the 38:00 mark.