Save over 40% when you secure your tickets today to TNW Conference 💥 Prices will increase on November 22 →

This article was published on April 28, 2021

Black man says racially-biased AI system rejected his passport photo

The system's had the same problem for years


Black man says racially-biased AI system rejected his passport photo Image by: Joris Lechêne

A Black man says a passport photo he submitted was rejected by the British government because the AI software couldn’t recognize his “melanated hotness.”

Joris Lechêne, a model and racial justice activist, said in a TikTok video that his photo met every rule in the application guidelines:

But lo and behold, that photo was rejected because the artificial intelligence software wasn’t designed with people of my phenotype in mind.

Lechêne shared a screenshot of the photo he submitted. It shows him standing in a black t-shirt, mouth closed, against a contrasting grey background.

Nonetheless, the government website rejected the image because his “mouth may be open” and his “image and the background are difficult to tell apart.”

The 💜 of EU tech

The latest rumblings from the EU tech scene, a story from our wise ol' founder Boris, and some questionable AI art. It's free, every week, in your inbox. Sign up now!

[Read: 3 new technologies ecommerce brands can use to connect better with customers]

“[The software] tends to get very confused by hairlines that don’t fall along the face and somehow mistakes it for the background,” said Lechêne. “And it has a habit of thinking that people like me keep our mouths open.”

@joris_explainsAutomation is never diversity-friendly. #LearnOnTikTok #diversity #technology #artificialintelligence #ukcitizen #bias♬ Clock It – Clutch

Lechêne isn’t the first Black person to have their passport photo denied despite following the guidelines. In 2019, the facial recognition software rejected an image of Joshua Bada because it mistook his lips for an open mouth.

“My mouth is closed, I just have big lips,” Bada wrote in the website’s comment box.

A year later, a woman tweeted that her submission had also been denied by the racially-biased algorithm.

Despite knowing about these biases for years, the government is still using the same face analysis algorithm.

In March, the Passport Office told New Scientist that an update to the system had been available for more than a year, but still hadn’t been rolled out.

HT – Daily Dot.

Greetings Humanoids! Did you know we have a newsletter all about AI? You can subscribe to it right here.

Get the TNW newsletter

Get the most important tech news in your inbox each week.

Also tagged with