San Francisco is fighting racism in Courts using AI

San Francisco is close to launching an AI-powered “bias mitigation tool” that will automatically redact race-signifying information from police reports. The tool indicates the first use of artificial intelligence to fight racism in courts.



Recent AI applications in our society today are indications of varying grave measures to sustainably resolve hard-biting social problems using technology. From detecting fake news to diagnosing internalizing disorders among children, San Francisco has a fresh approach. The city has announced plans to use AI-powered “bias mitigation tool” to automatically bowdlerize race-signifying information from police reports as a means of fighting racism in courts.

The tool will be designed to help distance persecutors from being influenced by racial bias in their deciding whether suspects should be charged with a crime. The bias mitigation tool, which will go beyond stripping out race descriptions, according to the San Francisco district attorney’s office, will be implemented on July 1st.

All descriptions that might unconsciously or consciously inform prosecutors about a suspect’s racial background like people’s names, neighborhoods, and locations are also removed by the tool.

San Francisco District Attorney George Gascón disclosed that seeing a name like Hernandez can potentially bias the outcome because the name informs persecutors the suspect is of Latino descent. A DA told The Verge that the tool will also censor details about police officers, including their badge number, should the persecutor know them.

San Francisco has been fighting racism in court manually

San Francisco has since been using a much more limited manual process in efforts to prevent persecutors from seeing the information that could bias court outcomes. The city usually removes the first two pages of the report. The manual process inspired SF to create the machine learning process, making it the “first-in-the-nation” to use AI in battling bias ruling or racism in courts.

A team at Stanford Computational Policy Lab is working with Alex Chohlas-Wood in building the tool, which he described as a lightweight web application that automatically executes multiple algorithms to redact a police report. The tool uses computer vision to recognize and replace words in the report with generic versions such as location, suspect #1, etc.

The bias mitigation tool was built at no cost to San Francisco and in the final stages, says Wood. It will be open-sourced in a few weeks for others to adopt and will use a method called “named-entity recognition,” alongside other components to identify words to remove, he added.

It is unclear how well the tool might work; none has seen such system work on real police reports. Gascón could only state that the tool will evolve over time when a journalist tried to find out if the tool would redact other descriptions like cross-dressing. The AI-powered bias mitigation tool will also be used in a given arrest during the first charging decision. What if the initial charging decision should base on video evidence? Of course, the suspect’s race will be clear.

The technology will help to make our system of justice “more fair and just,” by reducing the threat that implicit “bias poses to the purity of decisions which have serious ramifications for the accused,” Gascon said.

It will be interesting to see how the new tool would help to fight racism in courts. A controversial AI-driven technique known as “predictive policing” is known to introduce biases instead of removing them.

Anna Domanska
Anna Domanska is an Industry Leaders Magazine author possessing wide-range of knowledge for Business News. She is an avid reader and writer of Business and CEO Magazines and a rigorous follower of Business Leaders.

Recent Posts

Best Electric Bikes for Any Budget & Terrain (2022)

Best Electric Bikes for Any Budget & Terrain (2022)

Industry Leaders has curated details and insights on the five best electric bikes that will be available by 2022.
1 day ago
3 Invaluable Leadership Lessons from Jeff Bezos

3 Invaluable Leadership Lessons from Jeff Bezos

Jeff Bezos is an American entrepreneur with so much experience in leadership and business. We can learn a lot from the New Mexico-born billionaire.
1 day ago
Payhawk raises $112 million in round 2

Payhawk raises $112 million in round 2

Payhawk, the expenses and spend management startup with a focus on European customers, has raised a $112 million Series B round at a $570 million valuation.
2 days ago
US government seeking to lift a stay on workplace COVID-19 rules

US government seeking to lift a stay on workplace COVID-19 rules

The US government has asked a federal court to lift a stay on workplace COVID-19 rules to avoid any risks to public health.
2 days ago
Citadel Founder buys rare copy of US Constitution for $43 million outbidding crypto consortium

Citadel Founder buys rare copy of US Constitution for $43 million outbidding crypto consortium

Citadel Founder Ken Griffin bought a first print of the US Constitution for $43.2 million in a Sotheby auction, the broker house announced Friday.
3 days ago
SoftBank backed Fortress acquires Accordia Golf for $3.5 billion

SoftBank backed Fortress acquires Accordia Golf for $3.5 billion

SoftBank backed Fortress Investment Group is planning to acquire Accordia Golf, which operates around 170 golf courses in Japan, in a $3.5 billion deal.
4 days ago