It’s because the combination of both his outsized ego and giant head makes him an overly tempting target for a fist. It’d be hard for anyone to resist, especially a New Yorker.