Why is more accurately assessing credit risk without discriminating by race the "ultimate nightmare"?

One example - down payment size for home mortgages. A low loan/value ratio strongly affects risk (a), it's verifiably blind to all protected classes (b) and is also correlated with certain protected classes (c).

Is it the "ultimate nightmare" for banks to use the loan/value ratio while evaluating creditworthiness of mortgage applicants?