You miss the point about the "sides". We do know what the white supremacist side stands for. They have a right to free speech but the trump's false equivalence about sides is terrible.
There were incidents of white supremacists beaten up by minority/liberal opposition protesters, were there not? So there were two sides (white supremacists, and Antifa/minority/liberals) committing violence, were there not?