All incidents

Amazon Scraps AI Recruiting Tool Found to Be Biased Against Women

Jan 1, 2015Seattle, WA, United States3 sources

Summary

In 2015, Amazon developed an AI recruiting tool to automate resume evaluation but discovered it exhibited bias against women. The system was trained on historical resumes, predominantly from men, leading the AI to penalize resumes with terms like 'women's'. Amazon ultimately scrapped the tool due to these discriminatory outcomes.

Incident Details

Domain
Algorithmic Discrimination

Automated systems that produce discriminatory outcomes based on protected characteristics.

Who Was Affected

Age
Young Adult, Adult
Gender
Female, mixed
Group
Women & Girls, Racial/Ethnic Minority