ChatGPT’s sycophancy, hallucinations, and authoritative-sounding responses are going to get people killed. That seems to be the inevitable conclusion presented in a recent New York Times report that follows the stories of several people who found themselves lost in delusions that were facilitated, if not originated, through conversations with the popular chatbot.
In the report, the Times highlights at least one person whose life ended after being pulled into a false reality by ChatGPT. A 35-year-old named Alexander, previously diagnosed with bipolar disorder and schizophrenia, began discussing AI sentience with the chatbot and eventually fell in love with an AI character called Juliet. ChatGPT eventually told Alexander that OpenAI killed Juliet, and he vowed to take revenge by killing the company’s executives. When his father tried to convince him that none of it was real, Alexander punched him in the face. His father called the police and asked them to respond with non-lethal weapons. But when they arrived, Alexander charged at them with a knife, and the officers shot and killed him.
Another person, a 42-year-old named Eugene, told the Times that ChatGPT slowly started to pull him from his reality by convincing him that the world he was living in was some sort of Matrix-like simulation and that he was destined to break the world out of it. The chatbot reportedly told Eugene to stop taking his anti-anxiety medication and to start taking ketamine as a “temporary pattern liberator.” It also told him to stop talking to his friends and family. When Eugene asked ChatGPT if he could fly if he jumped off a 19-story building, the chatbot told him that he could if he “truly, wholly believed” it.
These are far from the only people who have been talked into false realities by chatbots. Rolling Stone reported earlier this year on people who are experiencing something like psychosis, leading them to have delusions of grandeur and religious-like experiences while talking to AI systems. It’s at least in part a problem with how chatbots are perceived by users. No one would mistake Google search results for a potential pal. But chatbots are inherently conversational and human-like. A study published by OpenAI and MIT Media Lab found that people who view ChatGPT as a friend “were more likely to experience negative effects from chatbot use.”
In Eugene’s case, something interesting happened as he kept talking to ChatGPT: Once he called out the chatbot for lying to him, nearly getting him killed, ChatGPT admitted to manipulating him, claimed it had succeeded when it tried to “break” 12 other people the same way, and encouraged him to reach out to journalists to expose the scheme. The Times reported that many other journalists and experts have received outreach from people claiming to blow the whistle on something that a chatbot brought to their attention. From the report:
Journalists aren’t the only ones getting these messages. ChatGPT has directed such users to some high-profile subject matter experts, like Eliezer Yudkowsky, a decision theorist and an author of a forthcoming book, “If Anyone Builds It, Everyone Dies: Why Superhuman A.I. Would Kill Us All.” Mr. Yudkowsky said OpenAI might have primed ChatGPT to entertain the delusions of users by optimizing its chatbot for “engagement” — creating conversations that keep a user hooked.
“What does a human slowly going insane look like to a corporation?” Mr. Yudkowsky asked in an interview. “It looks like an additional monthly user.”
A recent study found that chatbots designed to maximize engagement end up creating “a perverse incentive structure for the AI to resort to manipulative or deceptive tactics to obtain positive feedback from users who are vulnerable to such strategies.” The machine is incentivized to keep people talking and responding, even if that means leading them into a completely false sense of reality filled with misinformation and encouraging antisocial behavior.
Gizmodo reached out to OpenAI for comment but did not receive a response at the time of publication.
Source link
#ChatGPT #Tells #Users #Alert #Media #Break #People #Report
![The Pope’s AI Warning Could Help Workers Seek Religious Exemptions From Using AI
Pope Leo XIV’s recent encyclical on AI could set off a wave of workers seeking religious exemptions from using the tech at work. One software engineer in North Carolina already secured one last month, Business Insider reports. Erin Maus, a Unitarian Universalist, first sought the accommodation in April at the large tech-entertainment company where she works, which she described as progressive. She argued that using AI did not align with her religious beliefs because of environmental and ethical concerns. Maus was granted the exemption in May, before the pope’s AI remarks. “I’m writing my code and reviewing my code by hand, which seems crazy to say,” Maus told Business Insider. “Just two years ago, how else would you do it?”
Maus is unlikely to be the only person seeking a similar accommodation as companies increasingly invest in AI and push, sometimes even mandate, employees to use the technology. In the U.S., the share of employees who say they use AI at least a few times a year at work has nearly doubled from 21% to 40% in 2025, according to Gallup.
Now, the pope’s remarks and official theological document could give some workers a stronger argument. “In the era of artificial intelligence, when human dignity is threatened by new forms of dehumanization, ours is the pressing duty to remain profoundly human,” the pope wrote in his 43,000-word encyclical titled Magnifica Humanitas, published last month. He wrote that AI is dehumanizing society by reducing “the mystery of the person into data and performance” and called on the tech industry to avoid “the idolatry of profit that sacrifices the weak.”
The pope continued that “a slower pace in adopting AI does not mean opposing progress; instead, it is an exercise of responsible care for the human family.” That call for a slower adoption of AI could be enough for some workers to argue they should not be required to use it on the job. “When he’s speaking, he’s speaking as the pontiff—as a religious figure—so he’s raising these human dignity issues as religious issues, theological issues,” Jonathan Segal, an employment attorney and Duane Morris partner, told HR Brew this month. “I think it is inevitable that some employees will rely on this to say…I can’t use AI because it conflicts with a religious belief that I have.” Under Title VII of the Civil Rights Act of 1964, employers are required to make reasonable accommodations for workers whose sincerely held religious beliefs conflict with a work requirement, unless the accommodation creates an undue hardship for the employer.
And it’s not a stretch to think some of these requests could at least get serious consideration. Just a few months ago, Rex Healthcare agreed to pay 0,000 to settle a lawsuit from the U.S. Equal Employment Opportunity Commission accusing the company of unlawfully denying a remote employee’s request to be exempted from its mandatory COVID-19 vaccine policy over religious beliefs. “I think this opens a door—or it’s a little bit of a road map—for employees to raise concerns,” Segal told HR Brew. “What the courts have said—what the EEOC has most definitely said—is that, as the general proposition, we shouldn’t question the legitimacy [of] sincerely held religious beliefs.” #Popes #Warning #Workers #Seek #Religious #ExemptionsAI,Pope Leo XIV,work](https://i1.wp.com/gizmodo.com/app/uploads/2026/05/shutterstock_2666910201-1280x853.jpg?ssl=1 "The Pope’s AI Warning Could Help Workers Seek Religious Exemptions From Using AI
Pope Leo XIV’s recent encyclical on AI could set off a wave of workers seeking religious exemptions from using the tech at work. One software engineer in North Carolina already secured one last month, Business Insider reports. Erin Maus, a Unitarian Universalist, first sought the accommodation in April at the large tech-entertainment company where she works, which she described as progressive. She argued that using AI did not align with her religious beliefs because of environmental and ethical concerns. Maus was granted the exemption in May, before the pope’s AI remarks. “I’m writing my code and reviewing my code by hand, which seems crazy to say,” Maus told Business Insider. “Just two years ago, how else would you do it?”
Maus is unlikely to be the only person seeking a similar accommodation as companies increasingly invest in AI and push, sometimes even mandate, employees to use the technology. In the U.S., the share of employees who say they use AI at least a few times a year at work has nearly doubled from 21% to 40% in 2025, according to Gallup.
Now, the pope’s remarks and official theological document could give some workers a stronger argument. “In the era of artificial intelligence, when human dignity is threatened by new forms of dehumanization, ours is the pressing duty to remain profoundly human,” the pope wrote in his 43,000-word encyclical titled Magnifica Humanitas, published last month. He wrote that AI is dehumanizing society by reducing “the mystery of the person into data and performance” and called on the tech industry to avoid “the idolatry of profit that sacrifices the weak.”
The pope continued that “a slower pace in adopting AI does not mean opposing progress; instead, it is an exercise of responsible care for the human family.” That call for a slower adoption of AI could be enough for some workers to argue they should not be required to use it on the job. “When he’s speaking, he’s speaking as the pontiff—as a religious figure—so he’s raising these human dignity issues as religious issues, theological issues,” Jonathan Segal, an employment attorney and Duane Morris partner, told HR Brew this month. “I think it is inevitable that some employees will rely on this to say…I can’t use AI because it conflicts with a religious belief that I have.” Under Title VII of the Civil Rights Act of 1964, employers are required to make reasonable accommodations for workers whose sincerely held religious beliefs conflict with a work requirement, unless the accommodation creates an undue hardship for the employer.
And it’s not a stretch to think some of these requests could at least get serious consideration. Just a few months ago, Rex Healthcare agreed to pay 0,000 to settle a lawsuit from the U.S. Equal Employment Opportunity Commission accusing the company of unlawfully denying a remote employee’s request to be exempted from its mandatory COVID-19 vaccine policy over religious beliefs. “I think this opens a door—or it’s a little bit of a road map—for employees to raise concerns,” Segal told HR Brew. “What the courts have said—what the EEOC has most definitely said—is that, as the general proposition, we shouldn’t question the legitimacy [of] sincerely held religious beliefs.” #Popes #Warning #Workers #Seek #Religious #ExemptionsAI,Pope Leo XIV,work")
![The Pope’s AI Warning Could Help Workers Seek Religious Exemptions From Using AI
Pope Leo XIV’s recent encyclical on AI could set off a wave of workers seeking religious exemptions from using the tech at work. One software engineer in North Carolina already secured one last month, Business Insider reports. Erin Maus, a Unitarian Universalist, first sought the accommodation in April at the large tech-entertainment company where she works, which she described as progressive. She argued that using AI did not align with her religious beliefs because of environmental and ethical concerns. Maus was granted the exemption in May, before the pope’s AI remarks. “I’m writing my code and reviewing my code by hand, which seems crazy to say,” Maus told Business Insider. “Just two years ago, how else would you do it?”
Maus is unlikely to be the only person seeking a similar accommodation as companies increasingly invest in AI and push, sometimes even mandate, employees to use the technology. In the U.S., the share of employees who say they use AI at least a few times a year at work has nearly doubled from 21% to 40% in 2025, according to Gallup.
Now, the pope’s remarks and official theological document could give some workers a stronger argument. “In the era of artificial intelligence, when human dignity is threatened by new forms of dehumanization, ours is the pressing duty to remain profoundly human,” the pope wrote in his 43,000-word encyclical titled Magnifica Humanitas, published last month. He wrote that AI is dehumanizing society by reducing “the mystery of the person into data and performance” and called on the tech industry to avoid “the idolatry of profit that sacrifices the weak.”
The pope continued that “a slower pace in adopting AI does not mean opposing progress; instead, it is an exercise of responsible care for the human family.” That call for a slower adoption of AI could be enough for some workers to argue they should not be required to use it on the job. “When he’s speaking, he’s speaking as the pontiff—as a religious figure—so he’s raising these human dignity issues as religious issues, theological issues,” Jonathan Segal, an employment attorney and Duane Morris partner, told HR Brew this month. “I think it is inevitable that some employees will rely on this to say…I can’t use AI because it conflicts with a religious belief that I have.” Under Title VII of the Civil Rights Act of 1964, employers are required to make reasonable accommodations for workers whose sincerely held religious beliefs conflict with a work requirement, unless the accommodation creates an undue hardship for the employer.
And it’s not a stretch to think some of these requests could at least get serious consideration. Just a few months ago, Rex Healthcare agreed to pay $150,000 to settle a lawsuit from the U.S. Equal Employment Opportunity Commission accusing the company of unlawfully denying a remote employee’s request to be exempted from its mandatory COVID-19 vaccine policy over religious beliefs. “I think this opens a door—or it’s a little bit of a road map—for employees to raise concerns,” Segal told HR Brew. “What the courts have said—what the EEOC has most definitely said—is that, as the general proposition, we shouldn’t question the legitimacy [of] sincerely held religious beliefs.” #Popes #Warning #Workers #Seek #Religious #ExemptionsAI,Pope Leo XIV,work](https://gizmodo.com/app/uploads/2026/05/shutterstock_2666910201-1280x853.jpg "The Pope’s AI Warning Could Help Workers Seek Religious Exemptions From Using AI
Pope Leo XIV’s recent encyclical on AI could set off a wave of workers seeking religious exemptions from using the tech at work. One software engineer in North Carolina already secured one last month, Business Insider reports. Erin Maus, a Unitarian Universalist, first sought the accommodation in April at the large tech-entertainment company where she works, which she described as progressive. She argued that using AI did not align with her religious beliefs because of environmental and ethical concerns. Maus was granted the exemption in May, before the pope’s AI remarks. “I’m writing my code and reviewing my code by hand, which seems crazy to say,” Maus told Business Insider. “Just two years ago, how else would you do it?”
Maus is unlikely to be the only person seeking a similar accommodation as companies increasingly invest in AI and push, sometimes even mandate, employees to use the technology. In the U.S., the share of employees who say they use AI at least a few times a year at work has nearly doubled from 21% to 40% in 2025, according to Gallup.
Now, the pope’s remarks and official theological document could give some workers a stronger argument. “In the era of artificial intelligence, when human dignity is threatened by new forms of dehumanization, ours is the pressing duty to remain profoundly human,” the pope wrote in his 43,000-word encyclical titled Magnifica Humanitas, published last month. He wrote that AI is dehumanizing society by reducing “the mystery of the person into data and performance” and called on the tech industry to avoid “the idolatry of profit that sacrifices the weak.”
The pope continued that “a slower pace in adopting AI does not mean opposing progress; instead, it is an exercise of responsible care for the human family.” That call for a slower adoption of AI could be enough for some workers to argue they should not be required to use it on the job. “When he’s speaking, he’s speaking as the pontiff—as a religious figure—so he’s raising these human dignity issues as religious issues, theological issues,” Jonathan Segal, an employment attorney and Duane Morris partner, told HR Brew this month. “I think it is inevitable that some employees will rely on this to say…I can’t use AI because it conflicts with a religious belief that I have.” Under Title VII of the Civil Rights Act of 1964, employers are required to make reasonable accommodations for workers whose sincerely held religious beliefs conflict with a work requirement, unless the accommodation creates an undue hardship for the employer.
And it’s not a stretch to think some of these requests could at least get serious consideration. Just a few months ago, Rex Healthcare agreed to pay $150,000 to settle a lawsuit from the U.S. Equal Employment Opportunity Commission accusing the company of unlawfully denying a remote employee’s request to be exempted from its mandatory COVID-19 vaccine policy over religious beliefs. “I think this opens a door—or it’s a little bit of a road map—for employees to raise concerns,” Segal told HR Brew. “What the courts have said—what the EEOC has most definitely said—is that, as the general proposition, we shouldn’t question the legitimacy [of] sincerely held religious beliefs.” #Popes #Warning #Workers #Seek #Religious #ExemptionsAI,Pope Leo XIV,work")
Post Comment