Due process is the method that a society uses to determine whether people should be punished. The concentration camps under discussion do not hold people who have been adjudicated and condemned; they hold people who have been accused.
Yes, it would be wrong if there was not a justified basis for it.
Whether there's a justified basis for interning all people formally labelled as criminals in the USA I'll leave as an exercise, because it's obviously complicated there. So many people are imprisoned in the USA compared with other countries that it seems reasonable to doubt whether it is all justified, or even smart for those who remain outside.
When it comes to interning people who have few choices in life and are doing nothing of significant harm except being somewhere, and in a significant fraction of cases they have been there since birth or near birth, I see no justice-based justification for that.
Immigration detention centres have many of the awful qualities of prison, but the inmates there have not been subject to due process, and do not have a fixed term to serve out. These are qualities that make them more like a concentration camp.
At best, you could say the detention is politically-based to a much greater degree than criminal justice. This is obvious because detention is based on bureaucracy, what mood an official is in when they make a decision, and a person's background which they cannot do anything about, rather than the higher standard of criminal due process based on personal behaviour and trained, scrutinised judges; and because changes of political direction and secondary legislation (i.e. regulations made by beaurocrats, rather than laws) significantly change who is rounded up and released.
So if it's not justified as a prison, and does not have the qualities we associate with justice, and is selecting people based on their background they can do nothing about.... yes, that makes it meet the definition of a concentration camp IMHO.
But we don't call them concentration camps because that's not a good look, due to association with gas chambers and death trains, which to be fair ICE is not known for. We call them detention centres and avoid thinking about what that really means for the people and their families. Which if you think about it, sounds familiar from history...