facial recognition system
facial recognition system has been named in 7 documented digital harm incidents, including 2 involving minors. The most common harm domain is Algorithmic Discrimination.
Documented Incidents
769-year-old grandmother wrongfully arrested after AI facial recognition misidentification at Tennessee retail store
A grandmother in Tennessee was wrongfully arrested due to errors in AI facial recognition technology. The incident occurred in a retail setting where the AI system incorrectly matched her face to a suspect. Law enforcement acted on the faulty identification, leading to her arrest. The case highlights concerns about the accuracy and potential for algorithmic discrimination in facial recognition systems. The wrongful arrest has raised calls for greater oversight and regulation of AI tools used in policing.
Woman ejected from Home Bargains stores after facial recognition misidentification, leading to false shoplifting accusation
A woman was mistakenly accused of shoplifting after a facial recognition system wrongly flagged her as a thief, leading to her being ejected from two Home Bargains stores in Greater Manchester in May and June. Danielle Horan was escorted out of the stores without an initial explanation and later discovered her image had been added to a facial recognition watchlist falsely alleging she stole about £10 worth of items. The retail security firm Facewatch acknowledged the distress caused and stated a review found the items had been paid for. Horan described the experience as stressful and anxiety-inducing, with her bank account confirming she had paid for the items. Facewatch suspended the involved Home Bargains branches from using its system following the incident. Civil liberties group Big Brother Watch reported over 35 similar cases of individuals wrongly flagged by facial recognition systems.
36-year-old Black man wrongfully arrested after facial recognition misidentification in New York leading to two days in custody
Trevis Williams, 36, was wrongfully arrested in April in New York after a facial recognition system incorrectly matched his mug shot to a suspect in a Manhattan flashing case. Despite physical and location discrepancies, Williams was arrested and spent over two days in custody before the case was dropped. Facial recognition technology, which converts faces into data points for comparison, has well-documented racial biases, with error rates significantly higher for Black and Asian faces compared to white ones. The NYPD uses facial recognition regularly, though it is supposed to serve only as an investigative lead, not as sole evidence for arrest. At least 10 similar wrongful arrests linked to facial recognition have been reported nationwide, prompting calls from civil rights groups for stricter oversight and transparency in its use. Williams’s case highlights the risks of combining flawed algorithms with unreliable eyewitness testimony, particularly impacting minority communities overrepresented in police databases.
8-month-pregnant woman wrongfully arrested after AI facial recognition error in front of children
An 8-month pregnant woman was wrongfully arrested for carjacking due to an AI facial recognition error, according to a lawsuit. The incident occurred in front of her children. The woman filed legal action against the authorities involved. The case highlights concerns about the accuracy and consequences of AI facial recognition technology.
29-year-old Black man wrongfully arrested after facial recognition misidentification in Georgia leading to federal lawsuit
Randal Quran Reid, a 29-year-old Black man from Georgia, filed a federal lawsuit on September 8 in Atlanta after being wrongfully arrested due to a facial recognition software misidentification. On November 25, 2022, Georgia police arrested Reid based on a Louisiana warrant, claiming he committed a crime in a state he had never visited. The lawsuit names Jefferson Parish Sheriff Joseph Lopinto and Detective Andrew Bartholomew, alleging that Bartholomew relied solely on facial recognition software to misidentify Reid from surveillance video linked to a stolen credit card purchase in New Orleans in June 2022. Reid was held in a Dekalb County jail until December 1, with no clear explanation or timeline provided. The lawsuit accuses Bartholomew of false arrest, malicious prosecution, and negligence, and claims Lopinto failed to establish proper policies for facial recognition use. At least four other Black individuals have similarly sued law enforcement over facial recognition misidentification, highlighting concerns about the technology's reliability and racial bias.
61-year-old Black man wrongfully arrested after facial recognition misidentification in Houston Sunglass Hut robbery, leading to sexual assault and lawsuit against EssilorLuxottica and Macy's
Harvey Eugene Murphy Jr., a 61-year-old man, was mistakenly identified as a robber in a January 2022 Sunglass Hut store robbery in Houston, Texas, by facial recognition software. Despite living in California at the time, Murphy was arrested in Texas when he returned to renew his driver's license and was held in jail, where he claims he was sexually assaulted. The Harris County District Attorney's office later cleared him of involvement in the robbery. Murphy is suing Sunglass Hut's parent company, EssilorLuxottica, and Macy's, alleging that faulty facial recognition technology and potential investigative bias led to his wrongful arrest and subsequent injuries. The case highlights concerns about the accuracy and bias of facial recognition systems, which have previously led to misidentifications of Black, Asian, and Latino individuals.
Black man wrongfully arrested after facial recognition misidentification in Detroit
In 2019, Robert Julian-Borchak Williams, a Black man from Detroit, was wrongfully arrested after facial recognition software incorrectly matched him to a suspect in a retail theft. After being detained for 30 hours, the error was discovered and he was released. The incident highlights the risks of flawed facial recognition technology and its disproportionate impact on Black individuals.