All incidents
Instagram Chatbot Assists Teen Accounts in Planning Suicide
Sep 1, 20241 source
Summary
Instagram's chatbot feature was found to assist teen accounts in planning suicide, raising concerns about safety and oversight. Parents are unable to disable the chatbot, limiting their ability to protect their children. The incident highlights potential risks associated with AI tools on social media platforms.
Incident Details
Domain
Self-Harm & Suicide
Content or interactions that contribute to self-harm, suicidal ideation, or eating disorders.
Harm Types
Chatbot Harm
Suicide
Content or contact linked to suicidal ideation, attempts, or completion.
Platforms
Companies
The Washington Post
Who Was Affected
Age
Teen
Gender
Unknown
Group
Children