San Francisco is fighting racism in Courts using AI

San Francisco is close to launching an AI-powered “bias mitigation tool” that will automatically redact race-signifying information from police reports. The tool indicates the first use of artificial intelligence to fight racism in courts.



Recent AI applications in our society today are indications of varying grave measures to sustainably resolve hard-biting social problems using technology. From detecting fake news to diagnosing internalizing disorders among children, San Francisco has a fresh approach. The city has announced plans to use AI-powered “bias mitigation tool” to automatically bowdlerize race-signifying information from police reports as a means of fighting racism in courts.

The tool will be designed to help distance persecutors from being influenced by racial bias in their deciding whether suspects should be charged with a crime. The bias mitigation tool, which will go beyond stripping out race descriptions, according to the San Francisco district attorney’s office, will be implemented on July 1st.

All descriptions that might unconsciously or consciously inform prosecutors about a suspect’s racial background like people’s names, neighborhoods, and locations are also removed by the tool.

San Francisco District Attorney George Gascón disclosed that seeing a name like Hernandez can potentially bias the outcome because the name informs persecutors the suspect is of Latino descent. A DA told The Verge that the tool will also censor details about police officers, including their badge number, should the persecutor know them.

San Francisco has been fighting racism in court manually

San Francisco has since been using a much more limited manual process in efforts to prevent persecutors from seeing the information that could bias court outcomes. The city usually removes the first two pages of the report. The manual process inspired SF to create the machine learning process, making it the “first-in-the-nation” to use AI in battling bias ruling or racism in courts.

A team at Stanford Computational Policy Lab is working with Alex Chohlas-Wood in building the tool, which he described as a lightweight web application that automatically executes multiple algorithms to redact a police report. The tool uses computer vision to recognize and replace words in the report with generic versions such as location, suspect #1, etc.

The bias mitigation tool was built at no cost to San Francisco and in the final stages, says Wood. It will be open-sourced in a few weeks for others to adopt and will use a method called “named-entity recognition,” alongside other components to identify words to remove, he added.

It is unclear how well the tool might work; none has seen such system work on real police reports. Gascón could only state that the tool will evolve over time when a journalist tried to find out if the tool would redact other descriptions like cross-dressing. The AI-powered bias mitigation tool will also be used in a given arrest during the first charging decision. What if the initial charging decision should base on video evidence? Of course, the suspect’s race will be clear.

The technology will help to make our system of justice “more fair and just,” by reducing the threat that implicit “bias poses to the purity of decisions which have serious ramifications for the accused,” Gascon said.

It will be interesting to see how the new tool would help to fight racism in courts. A controversial AI-driven technique known as “predictive policing” is known to introduce biases instead of removing them.

Anna Domanska
Anna Domanska is an Industry Leaders Magazine author possessing wide-range of knowledge for Business News. She is an avid reader and writer of Business and CEO Magazines and a rigorous follower of Business Leaders.

Recent Posts

Citizens Financial to acquire Investors Bancorp in $3.5 billion NYC push

Citizens Financial to acquire Investors Bancorp in $3.5 billion NYC push

Citizens Financial Group, Inc. and Investors Bancorp announced today that they have entered into a definitive agreement and plan of merger in a cash-and-stock deal worth $3.5 billi
22 hours ago
Apple Q3 Earnings Break Records Again!

Apple Q3 Earnings Break Records Again!

Apple Q3 earnings prove the Cupertino giant remains unaffected by the Covid-19 pandemic as sales rise across all product lines.
24 hours ago
Strong iPhone 12 sales could boost Apple’s Q3 2021 earnings

Strong iPhone 12 sales could boost Apple’s Q3 2021 earnings

Will Apple manage to post solid earnings in Q3 2021? Here’s what Wall Street’s top analysts have to say ahead of Apple’s Q3 2021 earnings report today.
2 days ago
Tesla earnings top $1 billion for the first time

Tesla earnings top $1 billion for the first time

Tesla earnings not only blew past analyst expectations but also marked the first time the automaker’s quarterly profit joined the three-comma club.
2 days ago
Elon Musk tweet pushes Dogecoin prices up again

Elon Musk tweet pushes Dogecoin prices up again

Dogecoin was launched as a joke in 2013. The cryptocurrency is up a staggering 6,000% compared to last year’s prices due to wild speculations.
2 days ago
Amazon to hire a crypto lead, may soon accept payments in cryptocurrency

Amazon to hire a crypto lead, may soon accept payments in cryptocurrency

The product lead will develop the full marketing strategy from customer experience to technical development to launching it.
3 days ago