On the third morning of trial in the Dirksen Federal Building, lead defense counsel Arthur Vance hoisted an oversized, foam-core mounted graphic onto a mahogany easel facing the jury box.
Defense Exhibit 14-B was a chart straight out of a Python library, four feet high: a dotted spine flanked by floating blocks, apologetic blue drifting left, aggressive red stepping right.
To the regional director of the Consumer Financial Protection Bureau seated at the government table, the chart was a digital autopsy of an underwriting engine that had rejected 99.8% of mortgage applicants across four predominantly Black zip codes in South Chicago. To Vance, an equity partner who billed fifteen hundred dollars an hour out of a glass tower in the Loop, it was something entirely different: total statutory exoneration rendered through modern graphic design.
The Geometry of Non-Discrimination
Apex Underwriting Systems let five hundred decision trees approve or deny a mortgage in forty milliseconds. When federal regulators sued under the Equal Credit Opportunity Act, Apex did not argue that the South Side numbers were a fluke. It argued something bolder: discrimination cannot occur when the denial comes with a chart.
MR. VANCE: Dr. Holtz, looking at Exhibit 14-B—the applicant in question, Applicant 094182, a surgical nurse with a FICO score of 765 and zero derogatory marks—can you explain to the jury what this diagram shows?
DR. HOLTZ: Certainly. We do not employ subjective human intuition. We begin with the average applicant, the grey line at the bottom. From there, every feature in our data plays an individual, coöperative game.
MR. VANCE: A coöperative game.
DR. HOLTZ: Exactly. Lloyd Shapley won the Nobel Memorial Prize in Economic Sciences in 2012 for this formulation. When Applicant 094182 was evaluated, the algorithm did not see race. It cannot see race; we delete that column. What the model sees is eighty-four other things about her, each contributing its exact share, denoted as phi, toward the final score.
In row two behind the defense bench, three Apex model-risk quant recruits clutched matching black Moleskines, nodding whenever Holtz said "Nobel." The soothing visual geometry did not survive cross-examination.
Exhibit 14-B: The Chromatic Threshold
Janice Mercer, assistant regional counsel for the enforcement division, approached the easel.
MS. MERCER: Dr. Holtz, let us look at the red rectangles. What is this top one, the widest bar on the chart?
DR. HOLTZ: That is
applicant_fips_tract_prefix.MS. MERCER: In plain English, Dr. Holtz, that is the applicant’s neighborhood census tract.
DR. HOLTZ: It is a categorical geographic identifier.
MS. MERCER: And the second crimson bar?
form_fill_dwell_ms?DR. HOLTZ: Browser telemetry. The applicant hesitated for four-point-two seconds before clicking submit, which the trees associate with hesitation-related default.
MS. MERCER: Dr. Holtz, are you aware that these two crimson bars alone accounted for ninety-four percent of the push that sent Applicant 094182 over the denial threshold?
DR. HOLTZ: That is merely where the attribution fell. The bars add up exactly to the prediction. The arithmetic is immaculate.
MS. MERCER: Your chart shows her finances in a calming shade of blue. So why did the denial letter she received in the mail say 'Insufficient credit file history'?
DR. HOLTZ: Because when the top reason is a neighborhood variable that cannot be printed on a denial letter without regulatory friction, our software files it under Box Four.
MS. MERCER: You mapped a geographical proxy for race into a generic checkbox about credit history length?
DR. HOLTZ: We translated a high-dimensional vector into an administrative artifact. The aesthetic of the underlying tree, however, remained entirely transparent.
The Shapley Defense
Vance rose for redirect with the unhurried swagger of an art dealer closing a private sale on Michigan Avenue.
MR. VANCE: Dr. Holtz, the government suggests that the red bars on this chart represent an ancient, crude legal violation known as redlining. Does a SHAP waterfall plot bear any structural resemblance to redlining?
DR. HOLTZ: None whatsoever. Redlining was an arbitrary, manual act of administrative malice conducted by human loan officers with grease pencils on paper maps. It possessed no baseline expectation. It lacked mathematical convergence.
MR. VANCE: What does Exhibit 14-B possess?
DR. HOLTZ: It possesses strict game-theoretic efficiency. Every feature receives precisely the credit it deserves. If you look at the composition—the rhythm of the steps, the tension between the cerulean mitigating forces and the crimson risk markers—it reflects a total systems architecture. One might compare it to a Piet Mondrian grid or a late Mark Rothko color field. It is a self-contained, self-justifying visual truth.
MR. VANCE: Would an arbitrary or racially biased system produce a waterfall plot this orderly?
DR. HOLTZ: Absolutely not. Bias is chaotic. Bias introduces structural asymmetry. Here, every bar is exactly two hundred pixels wide. The labels are set in Roboto Mono. There is no human prejudice in the library dependencies.
Juror Seven worked substation maintenance for ComEd out in Cicero. Leaning against the varnished pine railing, he blinked hard at the foam display. What Vance called higher game theory looked to him like an uneven wiring diagram: ten heavy crimson bricks stacked hard against the right margin, utterly crushing two puny slivers of blue that sat stranded near zero.
He did not see Mark Rothko. He did not see Lloyd Shapley. He saw a barcode that said yes on one side of the expressway and no on the other.
THE COURT: Mr. Vance, is it your position that turning down 998 of every thousand applicants in four neighborhoods is excused under federal lending law if the chart uses tasteful typography?
MR. VANCE: Your Honor, the law requires creditors to provide the actual reasons for a decision. We have provided eighty-four of them, summed to the fourth decimal place, in a high-resolution PNG.
THE COURT: And the actual reason was where she lived?
MR. VANCE: The actual reason, Your Honor, was where the tree terminated its branch.