You're missing the nuance. The following day you had both the Unite the Right and the group protesting the tearing down of the statues, both protesting from the same side.
Ask yourself why people like David Duke are now Republicans. Ask yourself why Neo-Nazis vote Conservative. Ask yourself why when Elon did that salute that while conservatives downplayed it, neo-nazis embraced it. Ask yourself why dictators around the world love Trump.
If I'm on a side with all of those folk I would start questioning my position.
Ask yourself what the "good people" were protesting, they were against the tearing down of Confederate statues. Why would your protest that? They committed treason against the USA when they fired on Fort Sumter. They say heritage but like why would you be proud that your ancestors fought for a treasonous nation.
Ask yourself who 1920s-1940s Germany got their ideas from. They used 1800s America as a reference to what they wanted to accomplish. They used the Jim Crow laws of America as influence.
There's so much overlap between the two, the neo-nazis and the statue protestors, that why Trump was clearly talking about the former, you could argue that that doesn't matter.
https://dornsife.usc.edu/news/stories/germanys-nostalgia-antebellum-american-south/
I know you say they're two different groups and they are but there's overlap between the two. Hence why I mentioned the 1 Nazi at a table quote.