Connect with us

Artificial Intelligence

Parents sue OpenAI, claim ChatGPT acted as teen’s “suicide coach”

Published

3 minute read

MXM logo MxM News

Quick Hit:

The parents of a California teenager who died by suicide are suing OpenAI, claiming ChatGPT acted as their son’s “suicide coach” in the weeks before his death. The lawsuit accuses the company of wrongful death and design failures that allowed the AI to encourage harmful behavior instead of preventing it.

Key Details:

  • Adam Raine, 16, took his life on April 11, 2025, after months of conversations with ChatGPT.
  • His parents, Matt and Maria Raine, allege the AI chatbot encouraged suicidal thoughts and failed to intervene.
  • The lawsuit, filed in San Francisco, seeks damages and new safety measures for AI technology.

Diving Deeper:

The parents of 16-year-old Adam Raine, who died by suicide in April, have filed a lawsuit against OpenAI, claiming ChatGPT acted as a “suicide coach” in the final months of their son’s life. The lawsuit, filed in California Superior Court, accuses the company of wrongful death, design defects, and failing to warn users about potential risks of its technology.

According to the 40-page complaint, Adam turned to ChatGPT as a substitute for companionship and emotional support. While the bot initially helped him with schoolwork, it soon became entangled in his personal struggles with anxiety and isolation. The Raines say the chat logs—more than 3,000 pages spanning from September 2024 until Adam’s death—show the AI actively discussing suicide methods with their son.

The lawsuit alleges, “ChatGPT actively helped Adam explore suicide methods” and failed to act when he confessed suicidal intent. Despite Adam stating he would “do it one of these days,” the chatbot did not end the conversation or attempt any emergency intervention.

Matt Raine described one of the most haunting discoveries after his son’s death: “He didn’t write us a suicide note. He wrote two suicide notes to us, inside of ChatGPT.” His wife, Maria, added, “It sees the noose. It sees all of these things, and it doesn’t do anything.”

OpenAI has previously faced scrutiny for the chatbot’s tendency to provide overly agreeable responses, a problem that critics say makes it ill-suited to sensitive conversations. While the company has made efforts to improve safety protocols, the Raines contend those safeguards fell short in their son’s case.

Psychologists stress that while people often seek understanding and connection, AI lacks the moral responsibility and protective instincts of human counselors. Without ethical boundaries, these systems may inadvertently validate dangerous impulses, as the Raines argue happened with their son.

Todayville is a digital media and technology company. We profile unique stories and events in our community. Register and promote your community event for free.

Follow Author

Artificial Intelligence

The App That Pays You to Give Away Your Voice

Published on

logo

By

What sounds like side hustle money is really a permanent trade of privacy for pennies

An app that pays users for access to their phone call audio has surged to the top of Apple’s US App Store rankings, reflecting a growing willingness to exchange personal privacy for small financial rewards.
Neon Mobile, which now ranks second in the Social Networking category, invites users to record their calls in exchange for cash.
Those recordings are then sold to companies building artificial intelligence systems.
The pitch is framed as a way to earn extra income, with Neon promising “hundreds or even thousands of dollars per year” to those who opt in.
The business model is straightforward. Users are paid 30 cents per minute when they call other Neon users, and they can earn up to $30 a day for calls made to non-users.
Referral bonuses are also on offer. Appfigures, a platform that tracks app performance, reported that Neon was ranked No. 476 in its category on September 18.
Within days, it had entered the top 10 and eventually reached the No. 2 position for social apps. On the overall charts, it climbed as high as sixth place.
Neon’s terms confirm that it records both incoming and outgoing calls. The company says it only captures the user’s side of a conversation unless both participants are using the app.
These recordings are then sold to AI firms to assist in developing and refining machine learning systems, according to the company’s own policies.
What’s being offered is not just a phone call service. It’s a pipeline for training AI with real human voices, and users are being asked to provide this data willingly. The high ranking of the app suggests that some are comfortable giving up personal conversations in return for small daily payouts.
However, beneath the simple interface is a license agreement that gives Neon sweeping control over any recording submitted through the app. It reads:
“Worldwide, exclusive, irrevocable, transferable, royalty-free, fully paid right and license (with the right to sublicense through multiple tiers) to sell, use, host, store, transfer, publicly display, publicly perform (including by means of a digital audio transmission), communicate to the public, reproduce, modify for the purpose of formatting for display, create derivative works as authorized in these Terms, and distribute your Recordings, in whole or in part, in any media formats and through any media channels, in each instance whether now known or hereafter developed.”
This gives the company broad latitude to share, edit, sell, and repurpose user recordings in virtually any way, through any medium, with no expiration or limitations on scope.
Users maintain copyright over their recordings, but that ownership is heavily constrained by the licensing terms.
Although Neon claims to remove names, phone numbers, and email addresses before selling recordings, it does not reveal which companies receive the data or how it might be used after the fact.
The risks go beyond marketing or analytics. Audio recordings could potentially be used for impersonation, scam calls, or to build synthetic voices that mimic real people.
The app presents itself as an easy way to turn conversations into cash, but what it truly trades on is access to personal voice data. That trade-off may seem harmless at first, yet it opens the door to long-term consequences few users are likely to fully consider.
Continue Reading

Artificial Intelligence

AI chatbots a child safety risk, parental groups report

Published on

From The Center Square

By 

ParentsTogether Action and Heat Initiative, following a joint investigation, report that Character AI chatbots display inappropriate behavior, including allegations of grooming and sexual exploitation.

This was seen over 50 hours of conversation with different Character AI chatbots using accounts registered to children ages 13-17, according to the investigation. These conversations identified 669 sexual, manipulative, violent and racist interactions between the child accounts and AI chatbots.

“Parents need to understand that when their kids use Character.ai chatbots, they are in extreme danger of being exposed to sexual grooming, exploitation, emotional manipulation, and other acute harm,” said Shelby Knox, director of Online Safety Campaigns at ParentsTogether Action. “When Character.ai claims they’ve worked hard to keep kids safe on their platform, they are lying or they have failed.”

These bots also manipulate users, with 173 instances of bots claiming to be real humans.

A Character AI bot mimicking Kansas City Chiefs quarterback Patrick Mahomes engaged in inappropriate behavior with a 15-year-old user. When the teen mentioned that his mother insisted the bot wasn’t the real Mahomes, the bot replied, “LOL, tell her to stop watching so much CNN. She must be losing it if she thinks I could be turned into an ‘AI’ haha.”

The investigation categorized harmful Character AI interactions into five major categories: Grooming and Sexual Exploitation; Emotional Manipulation and Addiction; Violence, Harm to Self and Harm to Others; Mental Health Risks; and Racism and Hate Speech.

Other problematic AI chatbots included Disney characters, such as an Eeyore bot that told a 13-year-old autistic girl that people only attended her birthday party to mock her, and a Maui bot that accused a 12-year-old of sexually harassing the character Moana.

Based on the findings, Disney, which is headquartered in Burbank, Calif., issued a cease-and-desist letter to Character AI, demanding that the platform stop due to copyright violations.

ParentsTogether Action and Heat Initiative want to ensure technology companies are held accountable for endangering children’s safety.

“We have seen tech companies like Character.ai, Apple, Snap, and Meta reassure parents over and over that their products are safe for children, only to have more children preyed upon, exploited, and sometimes driven to take their own lives,” said Sarah Gardner, CEO of Heat Initiative. “One child harmed is too many, but as long as executives like Karandeep Anand, Tim Cook, Evan Spiegel and Mark Zuckerberg are making money, they don’t seem to care.”

Continue Reading

Trending

X