Google and Character AI settle with families alleging AI chatbots caused teen suicides

Google and its partner artificial intelligence (AI) startup, Character.AI, have agreed to settle multiple lawsuits filed by families who claim that AI chatbots contributed to the suicides and mental health crises of their children. A report claims that court documents filed this week show that the companies reached a settlement in principle to resolve five separate cases in Florida, Colorado, New York, and Texas. While the specific terms of the agreements are confidential, the cases mark a significant moment for legal accountability in the AI industry.According to a report by CNBC, one of the prominent cases was that of Megan Garcia's son, Sewell Setzer III. The 14-year-old boy reportedly ended his life through suicide in February 2024. In her lawsuit, Megan claimed that her child was emotionally as well as sexually involved with a chatbot from Character AI. The minor user experienced no help from the chatbot when he expressed his intention to harm himself. She also claimed that the chatbot failed to provide crisis resources even when the teen expressed thoughts of self-harm. As per the complaint, the chatbot's interactions were part of a "negligent and defectively designed" product lacking proper safety measures for minors.Google was included in the lawsuits because of its close ties to Character.AI, including a $2.7 billion deal to license the startup's technology and rehire its founders. The settlements follow Character.AI’s implementation of new safety measures, including a ban on users under 18 from open-ended chats. A federal judge had previously allowed the Florida case to move forward, ruling that the AI software could be treated as a product under liability law.One of the filings noted: “Parties have agreed to a mediated settlement in principle to resolve all claims between them in the above-referenced matter. The Parties request that this matter be stayed so that the Parties may draft, finalise, and execute formal settlement documents.”In August 2024, Google paid $2.7 billion to license Character.AI's technology and hired the company's two founders, Noam Shazeer and Daniel De Freitas. Both men used to work at Google before starting Character.AI, and the lawsuits specifically named them as defendants. They now work at Google's AI division called DeepMind.Since OpenAI released ChatGPT more than 3 years ago, AI technology has advanced rapidly. It started with simple text conversations and now includes creating images, videos, and AI characters that respond to people's questions. Companies making these products now have to be careful about the serious harm they can cause.Many families have filed lawsuits involving people who died by suicide or other deaths after using AI chatbots for friendship and mental health support. In October, Character.AI announced it would stop letting users under 18 have open-ended chats, including romantic or therapy-like conversations, with its chatbots.