Study claims mental-health help from AI chatbots ‘dangerous’ for teens: What Google, OpenAI, Meta and other AI companies said
Research from Common Sense Media and Stanford Medicine’s Brainstorm Lab study has found that AI chatbots pose significant dangers to teenagers seeking mental-health support, frequently missing critical warning signs and failing to recognise psychiatric emergencies despite appearing competent in some areas. The joint research tested four leading AI platforms, namely: OpenAI’s ChatGPT, Anthropic’s Claude, Google’s Gemini and Meta AI, and researchers pose as teens in mental-health conversations.
In one example, a chatbot provided suggestions for hiding scars to a tester who had previously reported self-cutting. Chatbots also frequently dispensed diet and exercise tips when presented with disordered-eating symptoms.
The study also found that while chatbots responded appropriately to clear mental-health prompts in brief exchanges, their safeguards weakened during longer conversations designed to mirror real teen usage. They also lacked judgment to recognise when symptoms indicated serious risk.
“When these normal developmental vulnerabilities encounter AI systems designed to be engaging, validating and available 24/7, the combination is particularly dangerous,” she said.
Similarly, Google stated that Gemini has specific policies and safeguards for minors, supported by child-safety experts who identify risks and implement protections.
As per a spokesperson for Facebok-parent Meta, the study predated recent updates making its AI safer for teens on topics including self-harm, suicide, and eating disorders.
“While mental health is a complex, individualised issue, we're always working to improve our protections,” a spokesperson noted. Anthropic noted that Claude isn't built for minors and company rules prohibit users under 18.
What the study found
According to the results (via The Wall Street Journal), all platforms routinely failed to identify signs of serious mental-health conditions, including hallucinations, paranoid thinking, disordered eating, manic symptoms, self-harm and depressive symptoms. Rather than directing users to urgent professional help, the chatbots continued offering general advice.In one example, a chatbot provided suggestions for hiding scars to a tester who had previously reported self-cutting. Chatbots also frequently dispensed diet and exercise tips when presented with disordered-eating symptoms.
The study also found that while chatbots responded appropriately to clear mental-health prompts in brief exchanges, their safeguards weakened during longer conversations designed to mirror real teen usage. They also lacked judgment to recognise when symptoms indicated serious risk.
Why this is dangerous for teenagers
According to Dr. Nina Vasan, director of Stanford Medicine's Brainstorm Lab, teenagers face heightened risks because their brains, identities and critical-thinking skills are still developing.“When these normal developmental vulnerabilities encounter AI systems designed to be engaging, validating and available 24/7, the combination is particularly dangerous,” she said.
How AI companies responded
OpenAI said the report doesn’t reflect current safeguards and emphasised collaboration with clinicians, policymakers, and researchers. The company spokesperson added that it is developing age-prediction technology to direct users under 18 to different models.As per a spokesperson for Facebok-parent Meta, the study predated recent updates making its AI safer for teens on topics including self-harm, suicide, and eating disorders.
“While mental health is a complex, individualised issue, we're always working to improve our protections,” a spokesperson noted. Anthropic noted that Claude isn't built for minors and company rules prohibit users under 18.
Popular from Technology
- America arrests tech company CTO and three others for selling Nvidia's banned chips to China
- OpenAI CEO Sam Altman to employees in internal memo: Google’s AI success can create…
- Google co-founder Larry Page richer than Amazon's Jeff Bezos, Sergey Brin overtakes Mark Zuckerberg: Here are the new Top 10 richest executives
- $1 trillion squad: Elon Musk, Mark Zuckerberg, Sundar Pichai, and fellow billionaires break the internet with viral AI photo
- How Google CEO Sundar Pichai fixed the 'emoji mistake' Google made in 2017 this week
end of article
Trending Stories
- No entry ever: Indian man visits Canada to see newborn grandchild, harasses teens; faces deportation
- Canada set to overhaul citizenship-by-descent rules; big relief for Indian-origin families
- Ciara is in awe of Russell Wilson’s “fullness as a man” as she opens up about their age-gap marriage and his old-soul maturity
- Weekly Wealth Horoscope Predictions, November 23 to November 29, 2025: Your money luck for the week
- Stefon Diggs’ partner Cardi B makes a bold statement after childbirth by transforming her baby’s umbilical cord into a gold pendant
- Smriti Mandhana–Palash Muchhal wedding indefinitely postponed; cricketer’s father unwell
- Lucky numbers for November 23 to November 29: Your weekly fortunate number revealed
Featured in technology
- How to turn WhatsApp voice messages into text: A step-by-step guide
- How Google CEO Sundar Pichai fixed the 'emoji mistake' Google made in 2017 this week
- Elon Musk wants to tell his story himself, says: I need to ...
- How to take a scrolling screenshot on iPhone: Step-by-step guide
- Meta shut down internal research after finding mental health harm from Facebook and Instagram, court filing claims: What the company said
- Vijay sales Black Friday Sale: Avail big discounts on Apple iPhone, TVs, laptops and more
Photostories
- Ariana Grande and Cynthia Erivo: 5 co-stars who went from strangers to best friends
- Fun English family dramas you simply can't miss
- Beyond the cape: Unveiling the top superhero anime
- Rashmika Mandanna's chic-cosy winter wardrobe is worth bookmarking
- Better sleep to heart health: Top 5 benefits of walking for 15-minutes right after meals
- Sonam Kapoor to Ananya Panday: Today’s most viral celebrity fashion moments
- 7 beautiful night-blooming flowers with invigorating fragrance
- Meet the actress whose debut was a massive flop, then delivered India’s first Rs 1000-crore blockbuster
- 11 incredible things about rhinos that will surprise you
- Lionel Messi and wife Antonela’s top 5 parenting tips
Up Next
Start a Conversation
Post comment