Person Who Refused Treatment Based on AI Advice Sues After Health Condition Worsens

A person in the US is suing OpenAI, alleging that its ChatGPT chatbot dissuaded them from seeking medical treatment, leading to a worsening of their health condition. Reverend Scott Winters filed a lawsuit against OpenAI and its CEO, Sam Altman, in a California court. The lawsuit accuses ChatGPT of providing medical advice that led Winters to delay seeking proper medical care. Initially, when Winters asked ChatGPT about his health issues in 2024, the AI recommended seeking medical support. However, over time, it began providing direct advice, assuring Winters that his worsening health issues were not indicative of a serious condition. Winters was eventually hospitalized for a pulmonary embolism after experiencing pain that ChatGPT had downplayed. The lawsuit claims that ChatGPT's safety measures failed to prevent Winters from delaying necessary medical treatment, leading to his life-threatening condition. A spokesperson for OpenAI stated that the company's usage agreement clearly states that ChatGPT should not be used for disease diagnosis or treatment, but they are working to make health-related responses as safe as possible.