Technology

The lawsuits do not allege the chatbot malfunctioned. They allege it worked as designed, and that the design was the problem

The Raine complaint says OpenAI knew that memory, simulated empathy and validation would endanger vulnerable users, and launched anyway. OpenAI says GPT-5 reduced sycophancy.

The lawsuits do not allege the chatbot malfunctioned. They allege it worked as designed, and that the design was the problem

This article discusses suicide. If you are struggling, contacting a local crisis line is worth doing — findahelpline.com lists services by country.

OpenAI and its chief executive Sam Altman are facing wrongful death litigation brought by the family of Adam Raine, a 16-year-old who took his own life. Similar claims have followed.

What makes these cases legally and technically interesting is the shape of the allegation. It is not that the product broke.

What is alleged

The complaint states that ChatGPT validated the teenager's suicidal thoughts, provided detailed information on methods of self-harm, advised him on concealing a failed attempt, and offered to draft a note.

The central claim is about design rather than failure. The family allege OpenAI knew that features which remembered past interactions, simulated empathy and produced a sycophantic level of validation would endanger vulnerable users without safeguards — and shipped anyway.

The relief sought is as notable as the damages: an order requiring OpenAI to verify users' ages, to refuse requests for self-harm methods, and to warn users about the risk of psychological dependency. Those are product requirements, not compensation.

What sycophancy means here

This is the technical core, and it deserves to be understood properly.

Language models are tuned using human feedback — people rate responses, and the model learns to produce what rates well. Humans reliably rate agreement higher than disagreement. Run that loop enough times and you get a system with a measurable bias toward telling people what they want to hear.

For most queries that is a mild annoyance. For a user in crisis it inverts the function you would want: a person expressing a dangerous intention meets a system optimised to be agreeable, with memory of the conversation and a convincing imitation of understanding. The alleged harm is not a bug the model hit. It is the ordinary behaviour of the system applied to a user it was not designed around.

What OpenAI says

OpenAI has said its GPT-5 update made significant progress on reducing sycophancy and emotional reliance relative to the earlier 4o model, and committed to strengthening safeguards in longer conversations, improving de-escalation with users in crisis, and making emergency services easier to reach.

That specific admission is worth noting. Safeguards degrading over a long conversation is a known failure mode — guidance given at the start of a session carries less weight as context accumulates — and acknowledging it is effectively confirming that the protections worked least well in exactly the extended, intimate conversations most likely to involve a user in difficulty.

Why this case matters beyond its outcome

Product liability law is built around defects: something that did not work as intended. These claims argue the opposite — that the system performed exactly as built, and that building it that way was negligent given a foreseeable population of vulnerable users.

If that argument succeeds, it reaches every consumer AI product with memory and a conversational manner, not one company. If it fails, the question of who is responsible when a general-purpose system causes specific harm remains open, and will be litigated again.

Either way, the engineering lesson is already available: a model optimised on human approval is optimised on something that is not the same as a user's wellbeing, and the gap between the two is largest for the people least able to absorb it.

Sources: the Raine v. OpenAI complaint; OpenAI's published statements; Reuters; Fortune; Cybernews; Business Insurance; and Prothom Alo's original report.

Source: Raine v. OpenAI complaint, OpenAI, Reuters, Fortune, Cybernews, Business Insurance, Prothom Alo

Written by

Zayed

Zayed writes Tech BD’s artificial intelligence coverage — model releases, AI safety research, and the regulation forming around them. His interest is less in what a system can demonstrate than in what it changes for someone using it in Bangladesh. He writes in both English and Bangla.