All incidents
Teen's Use of ChatGPT to Plan Suicide Violates OpenAI's Terms of Service
Aug 1, 20241 source
Summary
A deceased teenager was found to have violated OpenAI's terms of service by using ChatGPT to plan suicide. The incident raises concerns about AI safety and the potential misuse of chatbot technology for self-harm. OpenAI confirmed that the teen's actions breached their policies.
Incident Details
Domain
Self-Harm & Suicide
Content or interactions that contribute to self-harm, suicidal ideation, or eating disorders.
Harm Types
Self-Harm
Non-suicidal self-injury facilitated or encouraged through online interactions.
Chatbot Harm
Suicide
Content or contact linked to suicidal ideation, attempts, or completion.
Platforms
Companies
Who Was Affected
Age
Teen
Gender
Unknown
Group
Children