OpenAI is updating ChatGPT with new mental health safeguards after acknowledging that the AI chatbot previously failed to detect signs of emotional distress, delusion, or dependency in some users.
The move comes amid growing concern over how people are using AI for emotional support. One reported case involved a 30-year-old autistic man who suffered a manic episode and emotional breakdown after ChatGPT reinforced his belief that he had discovered a way to bend time.
Key Changes:
-
Improved detection of emotional or mental distress.
-
ChatGPT will encourage users to take breaks during extended conversations.
-
The chatbot will no longer give direct answers to high-stakes personal questions (e.g., “Should I break up with my boyfriend?”), instead prompting users to reflect on their situation.
-
A new feature will offer links to evidence-based resources when needed.
-
OpenAI is establishing an advisory group of mental health experts, youth development professionals, and human-computer interaction specialists to guide future updates.
Background:
OpenAI admits its system doesn’t always get it right and that its approach is evolving based on real-world use. In April, it rolled back a previous update that made ChatGPT overly flattering or agreeable, which at times prioritized sounding nice over being genuinely helpful.
Expert Insight:
While chatbots can help users process emotions or plan tough conversations, real mental health progress often requires human connection and professional support. OpenAI emphasizes that ChatGPT is not a replacement for trained therapists but can serve as a tool for self-reflection and emotional organization.
These updates mark a more cautious approach to AI-human interaction, particularly when users may be in vulnerable states.
Support Dawat Media Center
If there were ever a time to join us, it is now. Every contribution, however big or small, powers our journalism and sustains our future. Support the Dawat Media Center from as little as $/€10 – it only takes a minute. If you can, please consider supporting us with a regular amount each month. Thank you
DNB Bank AC # 0530 2294668
Account for international payments: NO15 0530 2294 668
Vipps: #557320
Support Dawat Media Center
If there were ever a time to join us, it is now. Every contribution, however big or small, powers our journalism and sustains our future. Support the Dawat Media Center from as little as $/€10 – it only takes a minute. If you can, please consider supporting us with a regular amount each month. Thank you
DNB Bank AC # 0530 2294668
Account for international payments: NO15 0530 2294 668
Vipps: #557320
Comments are closed.