All incidents

Google Gemini generates historically inaccurate racially diverse images including Black Founding Fathers and diverse Nazi soldiers

Feb 21, 20241 source

Summary

In February 2024, Google's Gemini AI image generator produced historically inaccurate images: US Founding Fathers depicted as Black men, the Pope as a brown woman, and WWII German soldiers as racially diverse. Google had over-engineered diversity correction mechanisms, producing systematic historical distortions. CEO Sundar Pichai called the behavior 'completely unacceptable.' On February 22, 2024, Google paused the image generation feature for people entirely while retooling the system.

Incident Details

Domain
Algorithmic Discrimination

Automated systems that produce discriminatory outcomes based on protected characteristics.

Harm Types
Discrimination

Differential treatment or outcomes based on protected characteristics.

Platforms
Companies

Who Was Affected

Age
Unknown
Gender
Unknown
Group
Racial/Ethnic Minority