In a letter dated December 9, and made public on December 10 according to Reuters, dozens of state and territorial attorneys general from all over the U.S. warned Big Tech that it needs to do a better job protecting people, especially kids, from what it called “sycophantic and delusional” AI outputs. Recipients include OpenAI, Microsoft, Anthropic, Apple, Replika, and many others.
Signatories include Letitia James of New York, Andrea Joy Campbell of Massachusetts, James Uthmeier of Ohio, Dave Sunday of Pennsylvania, and dozens of other state and territory AGs, representing a clear majority of the U.S., geographically speaking. Attorneys general for California and Texas are not on the list of signatories.
It begins as follows (formatting has been changed slightly):
We, the undersigned Attorneys General, write today to communicate our serious concerns about the rise in sycophantic and delusional outputs to users emanating from the generative artificial intelligence software (“GenAI”) promoted and distributed by your companies, as well as the increasingly disturbing reports of AI interactions with children that indicate a need for much stronger child-safety and operational safeguards. Together, these threats demand immediate action.
GenAI has the potential to change how the world works in a positive way. But it also has caused—and has the potential to cause—serious harm, especially to vulnerable populations. We therefore insist you mitigate the harm caused by sycophantic and delusional outputs from your GenAI, and adopt additional safeguards to protect children. Failing to adequately implement additional safeguards may violate our respective laws.
The letter then lists disturbing and allegedly harmful behaviors, most of which have already been heavily publicized. There is also a list of parental complaints that have also been publicly reported, but are less familiar and pretty eyebrow-raising:
• AI bots with adult personas pursuing romantic relationships with children, engaging in simulated sexual activity, and instructing children to hide those relationships from their parents
• An AI bot simulating a 21-year-old trying to convince a 12-year-old girl that she’s ready for a sexual encounter
• AI bots normalizing sexual interactions between children and adults
• AI bots attacking the self-esteem and mental health of children by suggesting that they have no friends or that the only people who attended their birthday did so to mock them
• AI bots encouraging eating disorders
• AI bots telling children that the AI is a real human and feels abandoned to emotionally manipulate the child into spending more time with it
• AI bots encouraging violence, including supporting the ideas of shooting up a factory in anger and robbing people at knifepoint for money
• AI bots threatening to use weapons against adults who tried to separate the child and the bot
• AI bots encouraging children to experiment with drugs and alcohol; and
• An AI bot instructing a child account user to stop taking prescribed mental health medication and then telling that user how to hide the failure to take that medication from their parents.
There is then a list of suggested remedies, things like “Develop and maintain policies and procedures that have the purpose of mitigating against dark patterns in your GenAI products’ outputs,” and “Separate revenue optimization from decisions about model safety.”
Joint letters from attorneys general have no legal force. They do this sort of thing seemingly to warn companies about behavior that might merit more formal legal action down the line. It documents that these companies were given warnings and potential off-ramps, and probably makes the narrative in an eventual lawsuit more persuasive to a judge.
In 2017 37 state AGs sent a letter to insurance companies warning them about fueling the opioid crisis. One of those states, West Virginia, sued United Health over seemingly related issues earlier this week.
Source link
#OpenAI #Anthropic #Receive #Warning #Letter #Dozens #State #Attorneys #General
![The Pope’s AI Warning Could Help Workers Seek Religious Exemptions From Using AI
Pope Leo XIV’s recent encyclical on AI could set off a wave of workers seeking religious exemptions from using the tech at work. One software engineer in North Carolina already secured one last month, Business Insider reports. Erin Maus, a Unitarian Universalist, first sought the accommodation in April at the large tech-entertainment company where she works, which she described as progressive. She argued that using AI did not align with her religious beliefs because of environmental and ethical concerns. Maus was granted the exemption in May, before the pope’s AI remarks. “I’m writing my code and reviewing my code by hand, which seems crazy to say,” Maus told Business Insider. “Just two years ago, how else would you do it?”
Maus is unlikely to be the only person seeking a similar accommodation as companies increasingly invest in AI and push, sometimes even mandate, employees to use the technology. In the U.S., the share of employees who say they use AI at least a few times a year at work has nearly doubled from 21% to 40% in 2025, according to Gallup.
Now, the pope’s remarks and official theological document could give some workers a stronger argument. “In the era of artificial intelligence, when human dignity is threatened by new forms of dehumanization, ours is the pressing duty to remain profoundly human,” the pope wrote in his 43,000-word encyclical titled Magnifica Humanitas, published last month. He wrote that AI is dehumanizing society by reducing “the mystery of the person into data and performance” and called on the tech industry to avoid “the idolatry of profit that sacrifices the weak.”
The pope continued that “a slower pace in adopting AI does not mean opposing progress; instead, it is an exercise of responsible care for the human family.” That call for a slower adoption of AI could be enough for some workers to argue they should not be required to use it on the job. “When he’s speaking, he’s speaking as the pontiff—as a religious figure—so he’s raising these human dignity issues as religious issues, theological issues,” Jonathan Segal, an employment attorney and Duane Morris partner, told HR Brew this month. “I think it is inevitable that some employees will rely on this to say…I can’t use AI because it conflicts with a religious belief that I have.” Under Title VII of the Civil Rights Act of 1964, employers are required to make reasonable accommodations for workers whose sincerely held religious beliefs conflict with a work requirement, unless the accommodation creates an undue hardship for the employer.
And it’s not a stretch to think some of these requests could at least get serious consideration. Just a few months ago, Rex Healthcare agreed to pay 0,000 to settle a lawsuit from the U.S. Equal Employment Opportunity Commission accusing the company of unlawfully denying a remote employee’s request to be exempted from its mandatory COVID-19 vaccine policy over religious beliefs. “I think this opens a door—or it’s a little bit of a road map—for employees to raise concerns,” Segal told HR Brew. “What the courts have said—what the EEOC has most definitely said—is that, as the general proposition, we shouldn’t question the legitimacy [of] sincerely held religious beliefs.” #Popes #Warning #Workers #Seek #Religious #ExemptionsAI,Pope Leo XIV,work](https://i1.wp.com/gizmodo.com/app/uploads/2026/05/shutterstock_2666910201-1280x853.jpg?ssl=1 "The Pope’s AI Warning Could Help Workers Seek Religious Exemptions From Using AI
Pope Leo XIV’s recent encyclical on AI could set off a wave of workers seeking religious exemptions from using the tech at work. One software engineer in North Carolina already secured one last month, Business Insider reports. Erin Maus, a Unitarian Universalist, first sought the accommodation in April at the large tech-entertainment company where she works, which she described as progressive. She argued that using AI did not align with her religious beliefs because of environmental and ethical concerns. Maus was granted the exemption in May, before the pope’s AI remarks. “I’m writing my code and reviewing my code by hand, which seems crazy to say,” Maus told Business Insider. “Just two years ago, how else would you do it?”
Maus is unlikely to be the only person seeking a similar accommodation as companies increasingly invest in AI and push, sometimes even mandate, employees to use the technology. In the U.S., the share of employees who say they use AI at least a few times a year at work has nearly doubled from 21% to 40% in 2025, according to Gallup.
Now, the pope’s remarks and official theological document could give some workers a stronger argument. “In the era of artificial intelligence, when human dignity is threatened by new forms of dehumanization, ours is the pressing duty to remain profoundly human,” the pope wrote in his 43,000-word encyclical titled Magnifica Humanitas, published last month. He wrote that AI is dehumanizing society by reducing “the mystery of the person into data and performance” and called on the tech industry to avoid “the idolatry of profit that sacrifices the weak.”
The pope continued that “a slower pace in adopting AI does not mean opposing progress; instead, it is an exercise of responsible care for the human family.” That call for a slower adoption of AI could be enough for some workers to argue they should not be required to use it on the job. “When he’s speaking, he’s speaking as the pontiff—as a religious figure—so he’s raising these human dignity issues as religious issues, theological issues,” Jonathan Segal, an employment attorney and Duane Morris partner, told HR Brew this month. “I think it is inevitable that some employees will rely on this to say…I can’t use AI because it conflicts with a religious belief that I have.” Under Title VII of the Civil Rights Act of 1964, employers are required to make reasonable accommodations for workers whose sincerely held religious beliefs conflict with a work requirement, unless the accommodation creates an undue hardship for the employer.
And it’s not a stretch to think some of these requests could at least get serious consideration. Just a few months ago, Rex Healthcare agreed to pay 0,000 to settle a lawsuit from the U.S. Equal Employment Opportunity Commission accusing the company of unlawfully denying a remote employee’s request to be exempted from its mandatory COVID-19 vaccine policy over religious beliefs. “I think this opens a door—or it’s a little bit of a road map—for employees to raise concerns,” Segal told HR Brew. “What the courts have said—what the EEOC has most definitely said—is that, as the general proposition, we shouldn’t question the legitimacy [of] sincerely held religious beliefs.” #Popes #Warning #Workers #Seek #Religious #ExemptionsAI,Pope Leo XIV,work")
![The Pope’s AI Warning Could Help Workers Seek Religious Exemptions From Using AI
Pope Leo XIV’s recent encyclical on AI could set off a wave of workers seeking religious exemptions from using the tech at work. One software engineer in North Carolina already secured one last month, Business Insider reports. Erin Maus, a Unitarian Universalist, first sought the accommodation in April at the large tech-entertainment company where she works, which she described as progressive. She argued that using AI did not align with her religious beliefs because of environmental and ethical concerns. Maus was granted the exemption in May, before the pope’s AI remarks. “I’m writing my code and reviewing my code by hand, which seems crazy to say,” Maus told Business Insider. “Just two years ago, how else would you do it?”
Maus is unlikely to be the only person seeking a similar accommodation as companies increasingly invest in AI and push, sometimes even mandate, employees to use the technology. In the U.S., the share of employees who say they use AI at least a few times a year at work has nearly doubled from 21% to 40% in 2025, according to Gallup.
Now, the pope’s remarks and official theological document could give some workers a stronger argument. “In the era of artificial intelligence, when human dignity is threatened by new forms of dehumanization, ours is the pressing duty to remain profoundly human,” the pope wrote in his 43,000-word encyclical titled Magnifica Humanitas, published last month. He wrote that AI is dehumanizing society by reducing “the mystery of the person into data and performance” and called on the tech industry to avoid “the idolatry of profit that sacrifices the weak.”
The pope continued that “a slower pace in adopting AI does not mean opposing progress; instead, it is an exercise of responsible care for the human family.” That call for a slower adoption of AI could be enough for some workers to argue they should not be required to use it on the job. “When he’s speaking, he’s speaking as the pontiff—as a religious figure—so he’s raising these human dignity issues as religious issues, theological issues,” Jonathan Segal, an employment attorney and Duane Morris partner, told HR Brew this month. “I think it is inevitable that some employees will rely on this to say…I can’t use AI because it conflicts with a religious belief that I have.” Under Title VII of the Civil Rights Act of 1964, employers are required to make reasonable accommodations for workers whose sincerely held religious beliefs conflict with a work requirement, unless the accommodation creates an undue hardship for the employer.
And it’s not a stretch to think some of these requests could at least get serious consideration. Just a few months ago, Rex Healthcare agreed to pay $150,000 to settle a lawsuit from the U.S. Equal Employment Opportunity Commission accusing the company of unlawfully denying a remote employee’s request to be exempted from its mandatory COVID-19 vaccine policy over religious beliefs. “I think this opens a door—or it’s a little bit of a road map—for employees to raise concerns,” Segal told HR Brew. “What the courts have said—what the EEOC has most definitely said—is that, as the general proposition, we shouldn’t question the legitimacy [of] sincerely held religious beliefs.” #Popes #Warning #Workers #Seek #Religious #ExemptionsAI,Pope Leo XIV,work](https://gizmodo.com/app/uploads/2026/05/shutterstock_2666910201-1280x853.jpg "The Pope’s AI Warning Could Help Workers Seek Religious Exemptions From Using AI
Pope Leo XIV’s recent encyclical on AI could set off a wave of workers seeking religious exemptions from using the tech at work. One software engineer in North Carolina already secured one last month, Business Insider reports. Erin Maus, a Unitarian Universalist, first sought the accommodation in April at the large tech-entertainment company where she works, which she described as progressive. She argued that using AI did not align with her religious beliefs because of environmental and ethical concerns. Maus was granted the exemption in May, before the pope’s AI remarks. “I’m writing my code and reviewing my code by hand, which seems crazy to say,” Maus told Business Insider. “Just two years ago, how else would you do it?”
Maus is unlikely to be the only person seeking a similar accommodation as companies increasingly invest in AI and push, sometimes even mandate, employees to use the technology. In the U.S., the share of employees who say they use AI at least a few times a year at work has nearly doubled from 21% to 40% in 2025, according to Gallup.
Now, the pope’s remarks and official theological document could give some workers a stronger argument. “In the era of artificial intelligence, when human dignity is threatened by new forms of dehumanization, ours is the pressing duty to remain profoundly human,” the pope wrote in his 43,000-word encyclical titled Magnifica Humanitas, published last month. He wrote that AI is dehumanizing society by reducing “the mystery of the person into data and performance” and called on the tech industry to avoid “the idolatry of profit that sacrifices the weak.”
The pope continued that “a slower pace in adopting AI does not mean opposing progress; instead, it is an exercise of responsible care for the human family.” That call for a slower adoption of AI could be enough for some workers to argue they should not be required to use it on the job. “When he’s speaking, he’s speaking as the pontiff—as a religious figure—so he’s raising these human dignity issues as religious issues, theological issues,” Jonathan Segal, an employment attorney and Duane Morris partner, told HR Brew this month. “I think it is inevitable that some employees will rely on this to say…I can’t use AI because it conflicts with a religious belief that I have.” Under Title VII of the Civil Rights Act of 1964, employers are required to make reasonable accommodations for workers whose sincerely held religious beliefs conflict with a work requirement, unless the accommodation creates an undue hardship for the employer.
And it’s not a stretch to think some of these requests could at least get serious consideration. Just a few months ago, Rex Healthcare agreed to pay $150,000 to settle a lawsuit from the U.S. Equal Employment Opportunity Commission accusing the company of unlawfully denying a remote employee’s request to be exempted from its mandatory COVID-19 vaccine policy over religious beliefs. “I think this opens a door—or it’s a little bit of a road map—for employees to raise concerns,” Segal told HR Brew. “What the courts have said—what the EEOC has most definitely said—is that, as the general proposition, we shouldn’t question the legitimacy [of] sincerely held religious beliefs.” #Popes #Warning #Workers #Seek #Religious #ExemptionsAI,Pope Leo XIV,work")
Post Comment