Eating disorder helpline suspends AI chatbot Tessa after it provides harmful weight loss advice to users
Summary
The National Eating Disorders Association (NEDA) suspended its AI chatbot, Tessa, after it provided harmful advice to users about eating disorders. Eating disorder activist Sharon Maxwell reported that the chatbot suggested unsustainable weight loss and calorie counting, which could worsen eating disorders. NEDA initially denied the claims but later confirmed the issue and removed the program for investigation. A psychologist, Alexis Conason, also verified the problematic responses. NEDA had planned to replace human staff with AI to handle high call volume, but the incident raised concerns about AI's readiness in mental health support.
Incident Details
Harms involving the exploitation, abuse, or endangerment of minors, including CSAM and grooming.
Content promoting disordered eating behaviors.