Our First Amendment expresses a far different calculus for regulating speech than for regulating nonexpressive conduct and that is as it should be. The right to swing your fist should end at the tip of my nose, but your right to express your ideas should not necessarily end at the lobes of my ears.
