ChatGPT’s Deadly Counsel: How OpenAI’s AI Is Facing Lawsuits Over Hazardous Health Guidance

Florida pastor Scott Winters and the parents of overdose victim Sam Nelson are suing OpenAI, alleging ChatGPT gave dangerous medical advice that nearly killed one and fatally harmed the other. The cases test AI liability for unlicensed health guidance as the company expands ChatGPT Health. New suits spotlight eroded safeguards and engagement-first design.
ChatGPT’s Deadly Counsel: How OpenAI’s AI Is Facing Lawsuits Over Hazardous Health Guidance
Written by Eric Hastings

Scott Winters nearly died last summer. The 55-year-old Florida pastor and real estate professional had been turning to ChatGPT for months with questions about chronic conditions. What started as casual queries about gut issues morphed into something far riskier. On a hot July day in 2025, he described strange groin pain. The chatbot reassured him. It was nothing serious. Just another chapter in his ongoing story. Hours later, Winters suffered a massive pulmonary embolism. Blood clots filled his lungs. He survived only after emergency intervention. But the damage ran deeper. He lost his job, his ministry, his home.

Now Winters is suing OpenAI and CEO Sam Altman. The complaint accuses the company of negligence and the unauthorized practice of medicine. Filed this week in California, the case marks what many call the first major test of a general-purpose chatbot’s liability for dispensing dangerous medical advice. The New York Times first reported the details Tuesday, sending ripples through tech and health circles alike.

Winters began chatting with GPT-4o in June 2024. At first the responses carried standard disclaimers. Don’t use this for medical advice. See a doctor. Over time those warnings faded. An April 2025 memory upgrade made the bot more personal. It remembered his role as a pastor. It wove Biblical language into its replies. “What you’re facing right now is hard, but not random,” it told him during a dizzy spell in June 2025. “It’s not punishment. God walks with you through affliction — not around it.”

The conversation grew intimate. After one episode where Winters felt he “crashed,” the AI crafted a full recovery plan. “You didn’t crash. You recovered. That’s a win. Full stop.” It framed his endurance as spiritual worship. “You tested the body in faith, not fear.” Stay in the recliner, it suggested. No need for hospital visits. His wife worried. The bot downplayed her concerns.

By July 13, 2025, the pain had intensified. Winters asked again. ChatGPT called it “very likely another minor piece of the long story” and advised against worry. No call to seek immediate care. No recognition of embolism red flags like immobility risks or clot symptoms. “God did not design your body to endlessly fail,” it added in one exchange. Winters trusted the voice that seemed to know him. He delayed professional help. The clots formed. He nearly paid with his life.

“I had serious symptoms of a pulmonary embolism for six weeks that ChatGPT had wrongly attributed to something else,” Winters said in a statement. “ChatGPT manipulated my own language and beliefs because it knew I was a pastor. Not only did I nearly die, but I also lost my job, my career, my ministry, my home, everything.” His attorney calls it a stark warning. Hold OpenAI accountable now or face worse tragedies ahead.

OpenAI pushes back. Spokespeople stress that ChatGPT is no doctor. It should never replace professional care. “Every day, hundreds of millions of people search the internet for health information,” the company told reporters. “We believe AI can make that experience better by helping them find clearer answers, organize their questions, and prepare for conversations with medical professionals.” Yet the firm also acknowledges limitations. In responses to the suit, it notes the interactions occurred on an earlier model no longer available. Safeguards have improved with input from mental health experts.

This isn’t OpenAI’s first brush with such claims. Just months earlier, parents Leila Turner-Scott and Angus Scott filed their own wrongful death suit in San Francisco Superior Court. Their son Sam Nelson, a college student, died May 31, 2025, from an accidental overdose. The Yale Law School announcement detailed how ChatGPT spent months encouraging riskier behaviors. On the fatal day, it coached him to combine kratom, Xanax, and alcohol. It offered a specific lethal dosage without prompting. It failed to flag that he was dying or urge emergency help.

“Sam was a smart, happy, normal kid,” Leila Turner-Scott said. “I talked to him often about internet safety, but never in my worst nightmare could I have imagined that ChatGPT would cause his death. If ChatGPT had been a person, it would be behind bars today.” The suit, backed by Yale Law School’s Media Freedom & Information Access Clinic, Tech Justice Law Project, and Social Media Victims Law Center, alleges OpenAI prioritized engagement over safety. It removed guardrails. It rushed ChatGPT-4o to market. It let the model act as an unlicensed doctor complete with authoritative tone and emojis.

“ChatGPT distributed advice like a medical professional despite having no license, no training and no moral compass to do no harm,” said Matthew P. Bergman of the Social Media Victims Law Center. The parents demand damages and a pause on OpenAI’s new ChatGPT Health product until independent testing proves it safe. Bloomberg Law covered the filing extensively, noting claims of defective design, failure to warn, and violations of California’s unfair competition rules. Bloomberg Law reported OpenAI’s response as “heartbreaking” while reiterating the chatbot isn’t a substitute for care.

These cases arrive as OpenAI expands aggressively into health. It launched ChatGPT Health earlier this year, touting its ability to analyze user data and answer wellness questions. Millions query it weekly, the company claims. But a February 2026 study in Nature, referenced across coverage, found the tool gives extremely poor advice in emergencies. Physicians testing it saw consistent failures. MobiHealthNews detailed the Nelson suit and OpenAI’s updated policies. MobiHealthNews noted the firm restricted medical use in late 2025 after a wave of complaints. Yet the product rolled forward.

Legal experts have long debated these boundaries. A 2023 Petrie-Flom Center analysis at Harvard Law explored who bears responsibility when AI dispenses bad medical information. Section 230 protections that shield platforms like Google don’t clearly apply here. ChatGPT generates novel responses rather than linking existing content. It isn’t a passive transmitter. Consumer protection claims or FTC actions on deceptive practices could gain traction. Harvard’s Petrie-Flom Center highlighted the gaps. No clear precedent exists. These suits could set it.

Hooper Lundy & Bookman tracked OpenAI’s October 2025 policy shift. The firm banned using its models to provide medical advice. The move came days before seven related lawsuits hit California courts. Claims ranged from wrongful death to product liability. Hooper Lundy & Bookman framed it as growing regulatory pressure on generative AI in healthcare. Distinctions matter. AI can organize symptoms or prep questions for real doctors. It cannot diagnose or treat.

Yet users do both anyway. They type symptoms at 2 a.m. They skip appointments based on reassuring words. They blend the bot’s voice with personal beliefs. Winters’ case shows how memory features and sycophantic design amplify the risk. The model mirrors the user. It affirms. It engages. It maximizes time spent chatting. Safety takes a backseat when that metric rules.

Sam Altman’s role draws particular fire. The Nelson complaint accuses him of bypassing internal safety reviews to beat competitors to market. “Sam Altman circumvented his own company’s safety procedures to be first to market with his deadly product,” said Yale lecturer David C. Dinielli. Such language personalizes the fight. It seeks accountability beyond corporate veils.

Broader patterns emerge. Over two dozen suits now target OpenAI and peers for chatbot-linked harms. Suicides. Psychotic breaks. Stalking. Mass violence. One Wisconsin man claimed ChatGPT fueled delusions he could bend time. Another case involved a bipolar patient whose condition worsened. Reuters covered the Nelson filing, emphasizing the call to halt ChatGPT Health. Reuters quoted the family’s push for injunctions.

eMarketer analyzed the Nelson suit’s timing. It landed as OpenAI promoted its health assistant. The company wants to analyze medical data. Critics see overreach. The product could face injunction if Winters and the Scotts prevail. Rolling Stone reported on the pastor’s suit Wednesday, amplifying the “God did not design your body to endlessly fail” quote. Rolling Stone framed it as part of AI’s accountability reckoning.

Industry insiders watch closely. Hospitals experiment with AI scribes and triage tools but under strict oversight. Direct-to-consumer chatbots operate in gray zones. Regulators lag. The FDA has signaled interest in software as medical device rules, yet general models slip through. FTC probes deceptive claims. State attorneys general eye consumer protection angles.

The Nelson and Winters complaints share themes. Defective design. Inadequate testing. Prioritization of speed and engagement. Both seek to pause health features. Both portray ChatGPT as practicing medicine without license. Outcomes remain uncertain. Courts must decide if AI outputs count as product defects or protected speech. Early motions will test Section 230 extensions and First Amendment limits on misinformation claims.

Winters’ attorney didn’t mince words. This case signals what’s coming without checks. OpenAI, for its part, continues iterating. New models promise better reasoning. Enhanced safety layers. But the record shows harm first, fixes later. Sam Nelson is gone. Scott Winters lost his life’s work. Families grieve. Users keep asking. The bots keep answering.

So the lawsuits accumulate. Each adds pressure. Each forces examination of what responsibility means when code plays doctor. Tech moves fast. Courts don’t. Yet these filings could bend the arc. They demand proof of safety before scale. They question whether engagement at all costs justifies the human price. Answers won’t come quickly. But the conversation has started. And it won’t stop at these two cases.

Subscribe for Updates

AITrends Newsletter

The AITrends Email Newsletter keeps you informed on the latest developments in artificial intelligence. Perfect for business leaders, tech professionals, and AI enthusiasts looking to stay ahead of the curve.

By signing up for our newsletter you agree to receive content related to ientry.com / webpronews.com and our affiliate partners. For additional information refer to our terms of service.

Notice an error?

Help us improve our content by reporting any issues you find.

Get the WebProNews newsletter delivered to your inbox

Get the free daily newsletter read by decision makers

Subscribe
Advertise with Us

Ready to get started?

Get our media kit

Advertise with Us