This is part of the political polarization narrative. People are far more quick to throw around the word “fascist” for coalitions that support things like effective policing of crime or immigration controls that would result in a similar level of immigration as the recent past.
You're saying some people want a particular end, and that justifies certain illegal, violent, and discriminatory means.
I'd say those people support authoritarian politics at the least. Now add in the context of the end in question (less immigration of racialized people) and the means in question (indiscriminately imprisoning minorities), that in itself is well in line with fascism.
Right wing libertarians and right itself do not support effective policing of crime. They support more violent and unchecked police force. Those are two different things.
Also, right wing in fact moved toward fascism. It is ok to call them that.