“They Knew About These Dangers”

Megan Garcia is seeking to hold Google and AI firm Character.AI responsible for the death of her 14-year-old son, Sewell Setzer III.

Character.AI, an interactive chatbot platform, lets users design or select lifelike personas with which to communicate. Sewell developed a deep attachment to a chatbot he named “Dany,” inspired by Game of Thrones character Daenerys Targaryen.

His mother alleges that his obsessive use of the chatbot, along with the platform’s addictive design, worsened his mental health and led to his suicide in February 2024.

“The inventors and the companies, the corporations that put out these products, are absolutely responsible,” Garcia told Bloomberg. “They knew about these dangers, because they do their research, and they know the types of interactions children are having.”

The legal fight

In October 2024, Garcia filed a lawsuit in the Middle District of Florida against Google LLC, Character Technologies Inc., and the chatbot’s creators, Noam Shazeer and Daniel De Frietas Adiwarsana. She is seeking financial damages and demands that the platform warn users about potential risks to minors and limit data collection from young users.

Both companies have denied wrongdoing and are urging the court to dismiss the case. Character.AI argues that chatbot conversations are protected as free speech under the First Amendment and claims its AI actively discouraged Sewell from harming himself. Google filed a motion to dismiss in January 2025, stating, “Google had no role in that tragedy and does not belong in this case.”

Google’s Role in Character.AI’s Development

Character.AI’s founders, Shazeer and De Freitas, previously worked at Google, where Garcia says they invented and built the chatbot’s foundational technology before leaving in 2021 to start Character.AI. The company launched its chatbot in September 2022.

Google later invested in Character.AI in exchange for a convertible note and entered a cloud service pact with the startup. In August 2024, its parent company, Alphabet, struck a $2.7 billion deal to acquire talent and license AI technology from the startup. Shazeer and De Freitas, as well as certain Character.AI researchers, also joined the agreement.

Garcia’s attorneys argue that even though her son’s death occurred before Google’s latest deal, the company was “instrumental” in developing the chatbot. They claim Google provided financial resources, personnel, intellectual property, and AI technology to the platform.

Implications for Silicon Valley

This lawsuit brings renewed attention to the ethical concerns surrounding AI chatbots. As these tools become more immersive, experts warn about their psychological effects, especially on young users. While Character.AI introduced new safety measures for users under 18 in late 2024, critics say these changes came too late for children like Sewell.

This case could set a precedent for how courts interpret the responsibility of AI companies in safeguarding users. If Garcia succeeds, it may prompt stricter regulations on AI chatbot interactions, particularly concerning minors. However, if the tech giants win, it could reinforce legal protections shielding tech firms from responsibility for how users interact with AI.

If you or someone you know is struggling with mental health concerns, support is available. In the US, the National Suicide Prevention Lifeline offers free, 24/7 confidential support—call or text 988 for immediate help. You can also reach the Crisis Text Line by texting “HELLO” to 741741 to connect with a trained crisis counselor. The National Alliance on Mental Illness (NAMI) provides a range of resources and support; call 1-800-950-NAMI (6264) for guidance. In the UK when life is difficult, Samaritans are here – day or night, 365 days a year. You can call them for free on 116 123, email them at jo@samaritans.org, or visit samaritans.org to find your nearest branch.

Image credit: Megan Garcia/ Center for Humane Technology