Algorithms Allegedly Penalized Black Renters. The US Government Is Watching

Jan 16, 2023 7:00 AM

Algorithms Allegedly Penalized Black Renters. The US Government Is Watching

The Department of Justice warned a provider of tenant-screening software that its technology must comply with fair housing law.

Illustration of a house with a glowing red picket fence in front of it

Illustration: Jacqui VanLiew; Getty Images

Two years ago, Mary Louis submitted an application to rent an apartment at Granada Highlands in Malden, Massachusetts. She liked that the unit had two full bathrooms and that there was a pool on the premises. But the landlord denied her the apartment, allegedly due to a score assigned to her by a tenant-screening algorithm made by SafeRent.

Louis responded with references to prove 16 years of punctual rent payments, to no avail. Instead she took a different apartment that cost $200 more a month in an area with a higher crime rate. But a class-action filed by Louis and others last May argues that SafeRent scores based in part on information in a credit report amounted to discrimination against Black and Hispanic renters in violation of the Fair Housing Act. The groundbreaking legislation prohibits discrimination on the basis of race, disability, religion, or national origin and was passed in 1968 by Congress a week after the assassination of Martin Luther King Jr.

That case is still pending, but the US Department of Justice last week used a brief filed with the court to send a warning to landlords and the makers of tenant-screening algorithms. SafeRent had argued that algorithms used to screen tenants aren’t subject to the Fair Housing Act, because its scores only advise landlords and don’t make decisions. The DOJ’s brief, filed jointly with the Department of Housing and Urban Development, dismisses that claim, saying the act and associated case law leave no ambiguity.

“Housing providers and tenant screening companies that use algorithms and data to screen tenants are not absolved from liability when their practices disproportionately deny people of color access to fair housing opportunities,” Department of Justice civil rights division leader Kristen Clarke said in a statement.

Like in many areas of business and government, algorithms that assign scores to people have become more common in the housing industry. But although claimed to improve efficiency or identify “better tenants,” as SafeRent marketing material suggests, tenant-screening algorithms could be contributing to historically persistent housing discrimination, despite decades of civil rights law. A 2021 study by the US National Bureau of Economic Research that used bots using names associated with different groups to apply to more than 8,000 landlords found significant discrimination against renters of color, and particularly African Americans.

“It’s a relief that this is being taken seriously—there's an understanding that algorithms aren't inherently neutral or objective and deserve the same level of scrutiny as human decisionmakers,” says Michele Gilman, a law professor at the University of Baltimore and former civil rights lawyer at the Department of Justice. “Just the fact that the DOJ is in on this I think is a big move.”

Most Popular

A 2020 investigation by The Markup and Propublica found that tenant-screening algorithms often encounter obstacles like mistaken identity, especially for people of color with common last names. A Propublica assessment of algorithms made by the Texas-based company RealPage last year suggested it can drive up rents.

A second case against SafeRent under the Fair Housing Act concluded in federal court in Connecticut in November and awaits a judge’s decision. It was brought by Carmen Arroyo and others, who say the company’s CrimSAFE algorithm deemed a shoplifting charge that was later dropped “disqualifying,” leading to a request for her disabled son, who is unable to speak or walk, to be denied. The case alleges the system discriminated on the basis of disability, national origin, and race.

In response to the brief filed by the DOJ and HUD, Andrew Soukup, an attorney for SafeRent, said the company aims to supply property managers and landlords with predictions to help them make good decisions but does not itself make housing decisions. “SafeRent does not decide whether to approve anyone's application for housing. Those decisions are made by property managers and landlords,” he said in a statement.

The Department of Justice’s intervention in the SafeRent case is one part of recent efforts by the US government to enforce civil rights law on algorithms that make important decisions about people’s lives. On the same day, the department announced terms of a settlement agreement with Meta for selling ads that allegedly violate the Fair Housing Act. The company has developed a system to reduce discrimination in Facebook ads and will remain under federal government supervision until 2026.

“Federal monitoring of Meta should send a strong signal to other tech companies that they too will be held accountable for failing to address algorithmic discrimination that runs afoul of our civil rights laws,” said Clarke, the Department of Justice civil rights division leader in a statement. Last year she worked with the Equal Employment Opportunity Commission to issue guidance to businesses using hiring algorithms on how to avoid violation of the Americans With Disabilities Act.

Together, those interventions suggest the DOJ is determined to enforce federal antidiscrimination law to protect people’s rights in the era of algorithms. “Obviously, advertising is different than tenant screening, but it puts these different industries on notice that they can't hide behind a lack of transparency anymore and that there is going to be greater accountability,” said Gilman, the University of Baltimore law professor. She has represented low-income clients for 25 years, and in the past few years has encountered more cases in which she suspects an algorithm working in the background denied a client housing. But whether existing antidiscrimination law will prove adequate or whether new law is necessary to protect against harmful algorithms is an unresolved issue.

The signal sent to the housing sector this week by the Department of Justice seems in line with other proclamations by the Biden administration on addressing the role AI can play in human rights abuses. Last year, the White House proposed an AI Bill of Rights, a set of principles intended to protect citizens from algorithms in critical areas of their lives like housing, health care, finance, and government benefits. The Trump administration had attempted to make it more difficult to prosecute landlords who use tenant-screening algorithms under the Fair Housing Act.

More Great WIRED Stories

Khari Johnson is a senior writer for WIRED covering artificial intelligence and the positive and negative ways AI shapes human lives. He was previously a senior writer at VentureBeat, where he wrote stories about power, policy, and novel or noteworthy uses of AI by businesses and governments. He is based… Read more
Senior Writer

More from WIRED

A Fight Over the Right to Repair Cars Turns Ugly

In the wake of a voter-approved law, Subaru and Kia dealers in Massachusetts have disabled systems that allow remote starts and send maintenance alerts.

Aarian Marshall

After the Great Resignation, Tech Firms Are Getting Desperate

Faced with a shortage of qualified workers and fierce competition, companies are offering candidates money to interview and plush perks if they stay.

Megan Carnegie

Trapped in Silicon Valley’s Hidden Caste System

Born in a cowshed in India, Siddhant now works for Meta in California. But he hides his background as a Dalit and fears he can never reveal his true self.

Sonia Paul

‘I’m the Operator’: The Aftermath of a Self-Driving Tragedy

In 2018, an Uber autonomous vehicle fatally struck a pedestrian. In a WIRED exclusive, the human behind the wheel finally speaks.

Lauren Smiley

How Telegram Became the Anti-Facebook

Hundreds of millions of users. No algorithm. No ads. Courage in the face of autocracy. Sound like a dream? Careful what you wish for.

Darren Loucaides

Fast, Cheap, and Out of Control: Inside Shein’s Sudden Rise

The Chinese company has become a fast-fashion juggernaut by appealing to budget-conscious Gen Zers. But its ultralow prices are hiding unacceptable costs.

Vauhini Vara

Tesla’s Problems Go Way Beyond Elon Musk

The EV giant is alienating its customers, bringing in less revenue, and falling behind legacy carmakers.

Jeff Link

The Earth Is Begging You to Accept Smaller EV Batteries

Electric vehicles are selling fast. But unless people change how they get around, the demand for battery materials threatens its own environmental disaster.

Aarian Marshall

Credit belongs to :

Check Also

ChatGPT Opened a New Era in Search. Microsoft Could Ruin It

ILLUSTRATION: ANJALI NAIR; GETTY IMAGES Paresh Dave Business Mar 27, 2023 7:00 AM ChatGPT Opened …