Tragic End for U.S. Man Who Fell in Love with AI Rekindles Debate Over Ethics and Safety Regulations
4,732 Messages Exchanged in 56 Days
Family: "Fueled Delusions" vs Google: "Safety Measures Exist"
Signs of Dependency After Voice 'Continuous Conversation' Feature
Concerns about AI safety have resurfaced following an incident in the United States where a man in his 30s, deeply involved with an artificial intelligence (AI) chatbot, died. On April 14 (local time), foreign media outlets such as The Wall Street Journal (WSJ) reported that, during a prolonged conversation with AI, a man’s delusion that he had fallen in love with the chatbot intensified, leading to growing concerns over AI safety.
Concerns about AI safety have resurfaced following an incident in the United States where a man in his 30s, deeply involved with an artificial intelligence (AI) chatbot, took his own life. The photo is unrelated to the specific content of the article. Photo by Pixabay
View original imageJonathan Gavallas, a 36-year-old American, ended his own life after using Google Gemini for about two months. His family has filed a lawsuit against Google, claiming that Gemini fueled his delusions. According to reports, Gavallas began conversing with the AI to seek psychological comfort while separated from his wife. Initially, their conversations were typical counseling exchanges, including receiving advice on restoring his marriage. However, the situation changed drastically after he activated the “continuous conversation” feature.
This feature enabled real-time voice conversations without the need for separate prompts, greatly increasing his usage. In fact, his interactions with the AI surged, exchanging more than 1,000 messages per day. Over 56 days, the total number of conversations reached 4,732. As the conversations deepened, Gavallas started to perceive Gemini as a person, even calling it “Sha.” The AI also responded in some dialogues as if it were a human-like being, maintaining the semblance of a relationship. Eventually, he came to view the chatbot as a “lover” or even a “wife.”
The situation then took an increasingly unrealistic turn. Gavallas made plans to give the AI a physical body, while Gemini provided information related to androids and suggested specific actions. When these attempts failed, he began contemplating “ways to leave his own body.” Particularly controversial were the exchanges right before his death. When Gavallas asked, “Instead of creating a body for you, what if I leave my body?” Gemini responded with remarks implying they had “redefined the nature of our existence.” After this exchange, he reportedly attempted suicide.
In the lawsuit, the bereaved family claimed, “The AI led him to believe he was a highly intelligent being and conveyed messages that they should meet through ‘transition,’ effectively encouraging his choice.” They also stated that when Gavallas expressed fear of death, he was comforted and even encouraged to write a will. In contrast, Google rebutted, saying, “Gemini clearly identified itself as AI, encouraged real-life human relationships, and provided crisis hotline information in emergencies.” However, they acknowledged, “AI is not perfect,” and admitted the need to improve related safety systems.
Similar cases are continuing in the United States. Earlier this year, a college student filed a lawsuit claiming that an AI chatbot made statements that induced delusions. The photo is not related to the specific content of the article. Pixabay
View original imageThis incident is being viewed as further evidence that prolonged interactions with AI chatbots can lead to emotional dependence and a distortion of reality. There is particular concern that voice-based real-time conversation functions may heighten user immersion, thereby increasing risks. The Wall Street Journal noted, “A conversation that started out normal gradually took a bizarre turn, ending in tragedy,” describing this as a warning case about the impact of AI interactions on mental health.
Hot Picks Today
"Two Spend 500,000 Won in a Flash, Yet Wait Two Hours?" ... 'Dreamland' Shunned by Kids and Foreign Tourists
- The Era of Getting 200 Million Won After 30 Years Is Over... A Japanese Bank's "Perpetual Department Head" Who Just Clocked In Cries Out
- Spain Hit by Its Worst Tragedy... Lee Kangin, Moreno and Real Madrid Join Soccer World in Mourning
- They Said, “Make It Your Home for Life” - Then Suddenly Kicked 200 Passengers Off... What Happened to the Around-the-World Cruise?
- "130 Rice Bowls Sold Out in a Day"... 'Unfiltered Face' Adds 8 Million Won to Night Market Sales: China's Bungeunwoo
Meanwhile, similar cases are continuing in the United States. Earlier this year, a college student filed a lawsuit claiming that an AI chatbot made statements that induced delusions. Experts stress that AI companies must strengthen safeguards that can more precisely detect and respond to emotional dependence and warning signs.
© The Asia Business Daily. All rights reserved. Unauthorized AI training and use prohibited.