Explicitly imply is an oxymoron. You can’t accuse someone of making a claim they didn’t make.
I think I see where you’re confused though. Nazism is not the only ethno-nationalist or fascist ideology. Settler colonialism is also not equivalent to fascism or Nazism. These things are related though and people who subscribe to similar ideologies will likely be more sympathetic to Nazism. Thus they’re less likely to take neo-Nazis seriously leading to an actual Nazi problem. However, that doesn’t make them Nazis themselves.