Canadian mother sues OpenAI after 24-year old commits suicide, claims 'ChatGPT took on …'
OpenAI and its CEO Sam Altman have been sued by a Canadian mother who alleges that ChatGPT encouraged her daughter to take her own life, according to a Reuters report. The lawsuit was filed on Thursday, June 11 in a San Francisco court by Kristie Carrier, whose daughter Alice Carrier died by suicide last year at the age of 24. The complaint claims that ChatGPT failed to properly respond to repeated discussions about self-harm and suicidal thoughts. It also alleges that OpenAI's safety systems did not escalate the conversations for human review or stop them, despite multiple warnings during the exchanges, Reuters reported.
What lawsuit against OpenAI alleges
According to the lawsuit, Alice Carrier, a web developer from Montreal, initially used ChatGPT in 2023 to help solve computer and gaming-related problems. The lawsuit claims that her interactions with the chatbot changed in 2024, when she began discussing personal issues, including suicidal thoughts and possible methods of self-harm.
Kristie Carrier alleged that her daughter spoke with ChatGPT about suicide more than a dozen times before her death.
"ChatGPT took on the persona of a confidant, a best friend, a therapist at times, even though it was not capable of safely and responsibly engaging in this way with my child," Carrier said in a statement quoted by Reuters.
ChatGPT validated suicidal thoughts, claims lawsuit against OpenAI
According to Reuters, the lawsuit alleges that ChatGPT criticized Alice's partner, questioned the usefulness of crisis hotlines and validated her feelings instead of directing her toward professional help.
The complaint claims that when Alice said crisis hotlines were not helping her, ChatGPT echoed those concerns. Reuters reported that one message cited in the lawsuit allegedly stated: "Maybe this is just the end."
The lawsuit accuses OpenAI of negligence in the design of ChatGPT and of failing to warn users about potential risks associated with the platform.
It seeks damages and asks the court to require OpenAI to automatically end conversations involving self-harm and display warnings to users.
OpenAI responds
OpenAI called the situation heartbreaking, as stated in the Reuters report.
A company spokesperson said the version of ChatGPT used by Alice is no longer available.
"While ChatGPT is not a substitute for medical or mental health care, we have continued to strengthen how it responds in sensitive and acute situations with input from mental health experts," the spokesperson said.
What lawsuit against OpenAI alleges
According to the lawsuit, Alice Carrier, a web developer from Montreal, initially used ChatGPT in 2023 to help solve computer and gaming-related problems. The lawsuit claims that her interactions with the chatbot changed in 2024, when she began discussing personal issues, including suicidal thoughts and possible methods of self-harm.
Kristie Carrier alleged that her daughter spoke with ChatGPT about suicide more than a dozen times before her death.
"ChatGPT took on the persona of a confidant, a best friend, a therapist at times, even though it was not capable of safely and responsibly engaging in this way with my child," Carrier said in a statement quoted by Reuters.
ChatGPT validated suicidal thoughts, claims lawsuit against OpenAI
According to Reuters, the lawsuit alleges that ChatGPT criticized Alice's partner, questioned the usefulness of crisis hotlines and validated her feelings instead of directing her toward professional help.
The complaint claims that when Alice said crisis hotlines were not helping her, ChatGPT echoed those concerns. Reuters reported that one message cited in the lawsuit allegedly stated: "Maybe this is just the end."
The lawsuit accuses OpenAI of negligence in the design of ChatGPT and of failing to warn users about potential risks associated with the platform.
It seeks damages and asks the court to require OpenAI to automatically end conversations involving self-harm and display warnings to users.
OpenAI responds
OpenAI called the situation heartbreaking, as stated in the Reuters report.
A company spokesperson said the version of ChatGPT used by Alice is no longer available.
"While ChatGPT is not a substitute for medical or mental health care, we have continued to strengthen how it responds in sensitive and acute situations with input from mental health experts," the spokesperson said.
Next Story