It doesn't take any balls to fire him. It's something that people who feel butt-hurt do (to use an oldie on this board). If this is about Harvey, he can laugh this off and certainly doesn't need some underling defending "his honor."
If anyone spoke of my boss(es) like JS did, I'd fire them without hesitation regardless what the public backlash would be. There's no butthurt involved, your hate for Perlman is noted.