Well, that argument is so absurd that it's hard to take it seriously enough to even answer it. And it smacks of desperation.
Following your logic shown above, no business owner should ever be accountable for anything he does, because if his business suffers as a result, some innocent people working for him might lose their jobs or suffer a loss of income?
What if (hypothetically) he was actually committing a crime? Should that be overlooked also, to preserve his employees' jobs?
Of course that would be unfortunate, especially if the employees had no knowledge of his attitudes. Or even if they did; many of us have had bosses who were outright [fill in the epithet], but hey, the job was OK anyway and it provided a living. But that would be part of the "collateral damage," to use a favorite expression of the military. Life is hard sometimes.
If their boss is being offensive enough to antagonize a substantial number of people and lose business as a result, they just might be hurt by it.
BTW, I have no desire to see anyone "suffer." I do believe that actions have consequences. Since there is probably no way that the courts can satisfactorily solve this tangled mess, the marketplace results are probably the only outcome. And this will happen, inevitably, whether you think it's fair to the employees or not.