I’d argue you’re using a status quo position- usury is fine when a bank does it and bad when a loan shark does it, even though the bank is legally allowed to do much more damage
That's simply not true. Loan sharks typically will charge the maximum rates, and even more in certain situations. Banks ordinarily will not even offer their services to the highest risk individuals.
Now depending on the bank, some have had discriminatory loan practices and such, but loan sharks are significantly worse in just about every metric.