×
ChatGPT reveals approximately how many users discuss suicide with its AI

ChatGPT reveals approximately how many users discuss suicide with its AI

In a Monday blog post, ChatGPT touted the improvements its default model, GPT-5, has made in identifying and responding to users’ troubling responses, including suicidal ideation. While new safeguards and the introduction of psychiatrists in helping train GPT-5 are leading to improved AI responses to mental health prompts, the blog post also pointed out some numbers that are bound to raise eyebrows.

While explaining GPT-5’s abilities to detect serious mental health concerns, like psychosis and mania, the post noted that troubling user conversations with the chatbot are “rare.”

“While, as noted above, these conversations are difficult to detect and measure given how rare they are, our initial analysis estimates that around 0.07% of users active in a given week and 0.01% of messages indicate possible signs of mental health emergencies related to psychosis or mania.”

The percentage seems small, but ChatGPT has 800 million weekly users, according to Sam Altman, the CEO of OpenAI, which owns ChatGPT. Altman made that stunning announcement earlier this month at OpenAI’s DevDay. 

SEE ALSO:

Sam Altman: ChatGPT will get more ‘friendly’ again, even erotically so

If Altman’s numbers are correct, that equates to 560,000 ChatGPT users showing signs of psychosis or mania, and 80,000 of their messages indicating mental health emergencies, according to the site’s estimates. 

Mashable Light Speed

ChatGPT is continuing to work with its models to better identify signs of self-harm and steer those people to resources, like suicide hotlines or their own friends or family members. The blog post continues to suggest that ChatGPT conversations regarding self-harm are rare, but estimates that “0.15% of users active in a given week have conversations that include explicit indicators of potential suicidal planning or intent and 0.05% of messages contain explicit or implicit indicators of suicidal ideation or intent.”

With 800 million weekly users, that equates to 1.2 million ChatGPT users engaging in conversations with AI about suicide in a given week, and 400,000 messages from users that demonstrate direct or indirect indications of suicidal intent.

“Even a very small percentage of our large user base represents a meaningful number of people, and that’s why we take this work so seriously,” an OpenAI spokesperson told Mashable, adding that the company believes ChatGPT’s growing user base reflects society at large, where mental health symptoms and emotional distress are “universally present.”

The spokesperson also reiterated that the company’s numbers are estimates and “the numbers we provided may significantly change as we learn more.”

OpenAI is currently facing a lawsuit from the parents of Adam Raine, a 16-year-old who died by suicide earlier this year during a time of heavy ChatGPT use. In a recently amended legal complaint, the Raines allege OpenAI twice downgraded suicide prevention safeguards in order to increase engagement in the months prior to their son’s death.

Source link
#ChatGPT #reveals #approximately #users #discuss #suicide


As Artemis 2 flies around the Moon in real life, For All Mankind is looking well beyond. The Apple TV show is currently set on Mars, and everyone there has eyes looking even further into the cosmos. But how will they make that happen? Well, two women still on Earth seem to have the answer.

For All Mankind is currently in the midst of its fifth season, and this week’s third episode, titled “Home,” is one of the biggest and most memorable yet. Part of that is that two of the show’s most iconic characters, Margo Madison (Wrenn Schmidt, who has been on the show since season one) and Aleida Rosales (Coral Peña, who has played the character since season two), are about to have a very important chat. One that io9 has an exclusive clip from. Check it out.

https://youtu.be/gNlnf2JKIe8

To recap a bit, Margo, a former leader at NASA, is in jail for aiding Russia but still retains a relationship with Aleida, her former mentee and current CEO of Helios. They have regular discussions about what’s happening on Mars, and now, the problem is how to beat the competition to Titan, the largest moon of Saturn. And it’s Margo that gives Aleida an answer she never even thought of. Going back to the old ship, Sojourner.

What happens from there? We won’t spoil it. But we love that this clip brings together two of the show’s best, all-time characters having a conversation that’s so crucial to where things are going. Can Helios and/or NASA bring Sojourner back to life and send it even further into space? What, if anything, will they find there if they do? And what’s next for Margo and Aleida, a duo that has had quite the relationship over the years?

Trust us when we say you do not want to miss this week’s episode of For All Mankind. We’ll have more on it later this week.

Want more io9 news? Check out when to expect the latest Marvel, Star Wars, and Star Trek releases, what’s next for the DC Universe on film and TV, and everything you need to know about the future of Doctor Who.

#Watch #Mankind #Legends #Figure #Future #ExclusiveApple TV,Coral Peña,For All Mankind,Wrenn Schmidt">Watch Two ‘For All Mankind’ Legends Figure Out Its Future (Exclusive)
                As Artemis 2 flies around the Moon in real life, For All Mankind is looking well beyond. The Apple TV show is currently set on Mars, and everyone there has eyes looking even further into the cosmos. But how will they make that happen? Well, two women still on Earth seem to have the answer. For All Mankind is currently in the midst of its fifth season, and this week’s third episode, titled “Home,” is one of the biggest and most memorable yet. Part of that is that two of the show’s most iconic characters, Margo Madison (Wrenn Schmidt, who has been on the show since season one) and Aleida Rosales (Coral Peña, who has played the character since season two), are about to have a very important chat. One that io9 has an exclusive clip from. Check it out.

 https://youtu.be/gNlnf2JKIe8 To recap a bit, Margo, a former leader at NASA, is in jail for aiding Russia but still retains a relationship with Aleida, her former mentee and current CEO of Helios. They have regular discussions about what’s happening on Mars, and now, the problem is how to beat the competition to Titan, the largest moon of Saturn. And it’s Margo that gives Aleida an answer she never even thought of. Going back to the old ship, Sojourner. What happens from there? We won’t spoil it. But we love that this clip brings together two of the show’s best, all-time characters having a conversation that’s so crucial to where things are going. Can Helios and/or NASA bring Sojourner back to life and send it even further into space? What, if anything, will they find there if they do? And what’s next for Margo and Aleida, a duo that has had quite the relationship over the years?

 Trust us when we say you do not want to miss this week’s episode of For All Mankind. We’ll have more on it later this week.  Want more io9 news? Check out when to expect the latest Marvel, Star Wars, and Star Trek releases, what’s next for the DC Universe on film and TV, and everything you need to know about the future of Doctor Who.      #Watch #Mankind #Legends #Figure #Future #ExclusiveApple TV,Coral Peña,For All Mankind,Wrenn Schmidt

flies around the Moon in real life, For All Mankind is looking well beyond. The Apple TV show is currently set on Mars, and everyone there has eyes looking even further into the cosmos. But how will they make that happen? Well, two women still on Earth seem to have the answer.

For All Mankind is currently in the midst of its fifth season, and this week’s third episode, titled “Home,” is one of the biggest and most memorable yet. Part of that is that two of the show’s most iconic characters, Margo Madison (Wrenn Schmidt, who has been on the show since season one) and Aleida Rosales (Coral Peña, who has played the character since season two), are about to have a very important chat. One that io9 has an exclusive clip from. Check it out.

https://youtu.be/gNlnf2JKIe8

To recap a bit, Margo, a former leader at NASA, is in jail for aiding Russia but still retains a relationship with Aleida, her former mentee and current CEO of Helios. They have regular discussions about what’s happening on Mars, and now, the problem is how to beat the competition to Titan, the largest moon of Saturn. And it’s Margo that gives Aleida an answer she never even thought of. Going back to the old ship, Sojourner.

What happens from there? We won’t spoil it. But we love that this clip brings together two of the show’s best, all-time characters having a conversation that’s so crucial to where things are going. Can Helios and/or NASA bring Sojourner back to life and send it even further into space? What, if anything, will they find there if they do? And what’s next for Margo and Aleida, a duo that has had quite the relationship over the years?

Trust us when we say you do not want to miss this week’s episode of For All Mankind. We’ll have more on it later this week.

Want more io9 news? Check out when to expect the latest Marvel, Star Wars, and Star Trek releases, what’s next for the DC Universe on film and TV, and everything you need to know about the future of Doctor Who.

#Watch #Mankind #Legends #Figure #Future #ExclusiveApple TV,Coral Peña,For All Mankind,Wrenn Schmidt">Watch Two ‘For All Mankind’ Legends Figure Out Its Future (Exclusive)Watch Two ‘For All Mankind’ Legends Figure Out Its Future (Exclusive)
                As Artemis 2 flies around the Moon in real life, For All Mankind is looking well beyond. The Apple TV show is currently set on Mars, and everyone there has eyes looking even further into the cosmos. But how will they make that happen? Well, two women still on Earth seem to have the answer. For All Mankind is currently in the midst of its fifth season, and this week’s third episode, titled “Home,” is one of the biggest and most memorable yet. Part of that is that two of the show’s most iconic characters, Margo Madison (Wrenn Schmidt, who has been on the show since season one) and Aleida Rosales (Coral Peña, who has played the character since season two), are about to have a very important chat. One that io9 has an exclusive clip from. Check it out.

 https://youtu.be/gNlnf2JKIe8 To recap a bit, Margo, a former leader at NASA, is in jail for aiding Russia but still retains a relationship with Aleida, her former mentee and current CEO of Helios. They have regular discussions about what’s happening on Mars, and now, the problem is how to beat the competition to Titan, the largest moon of Saturn. And it’s Margo that gives Aleida an answer she never even thought of. Going back to the old ship, Sojourner. What happens from there? We won’t spoil it. But we love that this clip brings together two of the show’s best, all-time characters having a conversation that’s so crucial to where things are going. Can Helios and/or NASA bring Sojourner back to life and send it even further into space? What, if anything, will they find there if they do? And what’s next for Margo and Aleida, a duo that has had quite the relationship over the years?

 Trust us when we say you do not want to miss this week’s episode of For All Mankind. We’ll have more on it later this week.  Want more io9 news? Check out when to expect the latest Marvel, Star Wars, and Star Trek releases, what’s next for the DC Universe on film and TV, and everything you need to know about the future of Doctor Who.      #Watch #Mankind #Legends #Figure #Future #ExclusiveApple TV,Coral Peña,For All Mankind,Wrenn Schmidt

As Artemis 2 flies around the Moon in real life, For All Mankind is looking well beyond. The Apple TV show is currently set on Mars, and everyone there has eyes looking even further into the cosmos. But how will they make that happen? Well, two women still on Earth seem to have the answer.

For All Mankind is currently in the midst of its fifth season, and this week’s third episode, titled “Home,” is one of the biggest and most memorable yet. Part of that is that two of the show’s most iconic characters, Margo Madison (Wrenn Schmidt, who has been on the show since season one) and Aleida Rosales (Coral Peña, who has played the character since season two), are about to have a very important chat. One that io9 has an exclusive clip from. Check it out.

https://youtu.be/gNlnf2JKIe8

To recap a bit, Margo, a former leader at NASA, is in jail for aiding Russia but still retains a relationship with Aleida, her former mentee and current CEO of Helios. They have regular discussions about what’s happening on Mars, and now, the problem is how to beat the competition to Titan, the largest moon of Saturn. And it’s Margo that gives Aleida an answer she never even thought of. Going back to the old ship, Sojourner.

What happens from there? We won’t spoil it. But we love that this clip brings together two of the show’s best, all-time characters having a conversation that’s so crucial to where things are going. Can Helios and/or NASA bring Sojourner back to life and send it even further into space? What, if anything, will they find there if they do? And what’s next for Margo and Aleida, a duo that has had quite the relationship over the years?

Trust us when we say you do not want to miss this week’s episode of For All Mankind. We’ll have more on it later this week.

Want more io9 news? Check out when to expect the latest Marvel, Star Wars, and Star Trek releases, what’s next for the DC Universe on film and TV, and everything you need to know about the future of Doctor Who.

#Watch #Mankind #Legends #Figure #Future #ExclusiveApple TV,Coral Peña,For All Mankind,Wrenn Schmidt

Thousands of men are members of Telegram groups and channels that advertise and sell hacking and surveillance services that can be used to harass friends, wives and girlfriends, and former partners, new research has uncovered. The findings, from a European nonprofit group, also say that the communities are involved in extensive trading, selling, and promotion of a huge variety of abusive content, including nonconsensual intimate images of women, so-called nudifying services, plus folders of images that sellers claim include child sexual abuse material and depictions of incest and rape.

Over six weeks earlier this year, researchers at the algorithmic auditing group AI Forensics analyzed nearly 2.8 million messages sent across 16 Italian and Spanish Telegram communities that are regularly posting abusive content targeting women and girls. More than 24,000 members of the Telegram groups and channels took part in posting 82,723 images, videos, and audio files over the course of the study, the analysis says. Many posts target celebrities and influencers, but men in the groups also frequently victimize women they know.

“We tend to forget that most victims are ordinary women who sometimes don’t even know that their pictures are shared or manipulated in these types of channels,” says Silvia Semenzin, a researcher at AI Forensics who previously exposed Italian Telegram channels engaging in similar behavior as far back as 2019. “The majority of this violence is directed towards people who the perpetrators know,” she says, suggesting that Telegram, which has over 1 billion monthly active users, according to company founder Pavel Durov, should be subject to stricter regulation and classed as a “very large online platform” under Europe’s online safety rules.

The findings come as Durov is fighting back against Russia’s efforts to block the messaging app in that country, which has long positioned itself as a messaging app that allows free speech but has simultaneously been used by some to share terrorist, sexual abuse, and cybercrime materials. Durov is under criminal investigation in France relating to alleged criminal activity taking place on Telegram, although he has consistently denied the allegations.

A Telegram spokesperson tells WIRED that the company removes “millions” of pieces of content per day using “custom AI tools” and has policies in Europe that do not allow the promotion of violence, illegal sexual content including nonconsensual imagery, and other content such as doxing and selling illegal goods and services.

Among the extensive types of abusive content and services observed by the AI Forensics researchers were frequent references to the access, publishing, and doxing of women’s private information, sharing their Instagram or TikTok content, as well as references to spying or hacking. “Victims are often named, tagged, and locatable via shared profile links,” the group’s report says.

One translated post on Telegram titled “Professional hacking on commission” claimed to be able to give customers “access to phone gallery and extraction of photos and videos,” as well as “anonymous social media hacking.” Another message says: “I hack and recover any type of social media service. I can spy on your partner’s account. Send me a private message.”

Across the dataset there were more than 18,000 references to spying or spy content. One post reads: “Hi, do you have the desire to spy on a girl’s gallery? We sell a bot that does it for info DM.” Meanwhile, users were observed asking if people could find phone numbers connected to Instagram accounts and other requests, “who exchanges spy photos and videos?”

#Men #Buying #Hacking #Tools #Wives #Friendscrime,privacy,security,cybersecurity,hacking,surveillance,telegram">Men Are Buying Hacking Tools to Use Against Their Wives and FriendsThousands of men are members of Telegram groups and channels that advertise and sell hacking and surveillance services that can be used to harass friends, wives and girlfriends, and former partners, new research has uncovered. The findings, from a European nonprofit group, also say that the communities are involved in extensive trading, selling, and promotion of a huge variety of abusive content, including nonconsensual intimate images of women, so-called nudifying services, plus folders of images that sellers claim include child sexual abuse material and depictions of incest and rape.Over six weeks earlier this year, researchers at the algorithmic auditing group AI Forensics analyzed nearly 2.8 million messages sent across 16 Italian and Spanish Telegram communities that are regularly posting abusive content targeting women and girls. More than 24,000 members of the Telegram groups and channels took part in posting 82,723 images, videos, and audio files over the course of the study, the analysis says. Many posts target celebrities and influencers, but men in the groups also frequently victimize women they know.“We tend to forget that most victims are ordinary women who sometimes don’t even know that their pictures are shared or manipulated in these types of channels,” says Silvia Semenzin, a researcher at AI Forensics who previously exposed Italian Telegram channels engaging in similar behavior as far back as 2019. “The majority of this violence is directed towards people who the perpetrators know,” she says, suggesting that Telegram, which has over 1 billion monthly active users, according to company founder Pavel Durov, should be subject to stricter regulation and classed as a “very large online platform” under Europe’s online safety rules.The findings come as Durov is fighting back against Russia’s efforts to block the messaging app in that country, which has long positioned itself as a messaging app that allows free speech but has simultaneously been used by some to share terrorist, sexual abuse, and cybercrime materials. Durov is under criminal investigation in France relating to alleged criminal activity taking place on Telegram, although he has consistently denied the allegations.A Telegram spokesperson tells WIRED that the company removes “millions” of pieces of content per day using “custom AI tools” and has policies in Europe that do not allow the promotion of violence, illegal sexual content including nonconsensual imagery, and other content such as doxing and selling illegal goods and services.Among the extensive types of abusive content and services observed by the AI Forensics researchers were frequent references to the access, publishing, and doxing of women’s private information, sharing their Instagram or TikTok content, as well as references to spying or hacking. “Victims are often named, tagged, and locatable via shared profile links,” the group’s report says.One translated post on Telegram titled “Professional hacking on commission” claimed to be able to give customers “access to phone gallery and extraction of photos and videos,” as well as “anonymous social media hacking.” Another message says: “I hack and recover any type of social media service. I can spy on your partner’s account. Send me a private message.”Across the dataset there were more than 18,000 references to spying or spy content. One post reads: “Hi, do you have the desire to spy on a girl’s gallery? We sell a bot that does it for info DM.” Meanwhile, users were observed asking if people could find phone numbers connected to Instagram accounts and other requests, “who exchanges spy photos and videos?”#Men #Buying #Hacking #Tools #Wives #Friendscrime,privacy,security,cybersecurity,hacking,surveillance,telegram

Telegram groups and channels that advertise and sell hacking and surveillance services that can be used to harass friends, wives and girlfriends, and former partners, new research has uncovered. The findings, from a European nonprofit group, also say that the communities are involved in extensive trading, selling, and promotion of a huge variety of abusive content, including nonconsensual intimate images of women, so-called nudifying services, plus folders of images that sellers claim include child sexual abuse material and depictions of incest and rape.

Over six weeks earlier this year, researchers at the algorithmic auditing group AI Forensics analyzed nearly 2.8 million messages sent across 16 Italian and Spanish Telegram communities that are regularly posting abusive content targeting women and girls. More than 24,000 members of the Telegram groups and channels took part in posting 82,723 images, videos, and audio files over the course of the study, the analysis says. Many posts target celebrities and influencers, but men in the groups also frequently victimize women they know.

“We tend to forget that most victims are ordinary women who sometimes don’t even know that their pictures are shared or manipulated in these types of channels,” says Silvia Semenzin, a researcher at AI Forensics who previously exposed Italian Telegram channels engaging in similar behavior as far back as 2019. “The majority of this violence is directed towards people who the perpetrators know,” she says, suggesting that Telegram, which has over 1 billion monthly active users, according to company founder Pavel Durov, should be subject to stricter regulation and classed as a “very large online platform” under Europe’s online safety rules.

The findings come as Durov is fighting back against Russia’s efforts to block the messaging app in that country, which has long positioned itself as a messaging app that allows free speech but has simultaneously been used by some to share terrorist, sexual abuse, and cybercrime materials. Durov is under criminal investigation in France relating to alleged criminal activity taking place on Telegram, although he has consistently denied the allegations.

A Telegram spokesperson tells WIRED that the company removes “millions” of pieces of content per day using “custom AI tools” and has policies in Europe that do not allow the promotion of violence, illegal sexual content including nonconsensual imagery, and other content such as doxing and selling illegal goods and services.

Among the extensive types of abusive content and services observed by the AI Forensics researchers were frequent references to the access, publishing, and doxing of women’s private information, sharing their Instagram or TikTok content, as well as references to spying or hacking. “Victims are often named, tagged, and locatable via shared profile links,” the group’s report says.

One translated post on Telegram titled “Professional hacking on commission” claimed to be able to give customers “access to phone gallery and extraction of photos and videos,” as well as “anonymous social media hacking.” Another message says: “I hack and recover any type of social media service. I can spy on your partner’s account. Send me a private message.”

Across the dataset there were more than 18,000 references to spying or spy content. One post reads: “Hi, do you have the desire to spy on a girl’s gallery? We sell a bot that does it for info DM.” Meanwhile, users were observed asking if people could find phone numbers connected to Instagram accounts and other requests, “who exchanges spy photos and videos?”

#Men #Buying #Hacking #Tools #Wives #Friendscrime,privacy,security,cybersecurity,hacking,surveillance,telegram">Men Are Buying Hacking Tools to Use Against Their Wives and Friends

Thousands of men are members of Telegram groups and channels that advertise and sell hacking and surveillance services that can be used to harass friends, wives and girlfriends, and former partners, new research has uncovered. The findings, from a European nonprofit group, also say that the communities are involved in extensive trading, selling, and promotion of a huge variety of abusive content, including nonconsensual intimate images of women, so-called nudifying services, plus folders of images that sellers claim include child sexual abuse material and depictions of incest and rape.

Over six weeks earlier this year, researchers at the algorithmic auditing group AI Forensics analyzed nearly 2.8 million messages sent across 16 Italian and Spanish Telegram communities that are regularly posting abusive content targeting women and girls. More than 24,000 members of the Telegram groups and channels took part in posting 82,723 images, videos, and audio files over the course of the study, the analysis says. Many posts target celebrities and influencers, but men in the groups also frequently victimize women they know.

“We tend to forget that most victims are ordinary women who sometimes don’t even know that their pictures are shared or manipulated in these types of channels,” says Silvia Semenzin, a researcher at AI Forensics who previously exposed Italian Telegram channels engaging in similar behavior as far back as 2019. “The majority of this violence is directed towards people who the perpetrators know,” she says, suggesting that Telegram, which has over 1 billion monthly active users, according to company founder Pavel Durov, should be subject to stricter regulation and classed as a “very large online platform” under Europe’s online safety rules.

The findings come as Durov is fighting back against Russia’s efforts to block the messaging app in that country, which has long positioned itself as a messaging app that allows free speech but has simultaneously been used by some to share terrorist, sexual abuse, and cybercrime materials. Durov is under criminal investigation in France relating to alleged criminal activity taking place on Telegram, although he has consistently denied the allegations.

A Telegram spokesperson tells WIRED that the company removes “millions” of pieces of content per day using “custom AI tools” and has policies in Europe that do not allow the promotion of violence, illegal sexual content including nonconsensual imagery, and other content such as doxing and selling illegal goods and services.

Among the extensive types of abusive content and services observed by the AI Forensics researchers were frequent references to the access, publishing, and doxing of women’s private information, sharing their Instagram or TikTok content, as well as references to spying or hacking. “Victims are often named, tagged, and locatable via shared profile links,” the group’s report says.

One translated post on Telegram titled “Professional hacking on commission” claimed to be able to give customers “access to phone gallery and extraction of photos and videos,” as well as “anonymous social media hacking.” Another message says: “I hack and recover any type of social media service. I can spy on your partner’s account. Send me a private message.”

Across the dataset there were more than 18,000 references to spying or spy content. One post reads: “Hi, do you have the desire to spy on a girl’s gallery? We sell a bot that does it for info DM.” Meanwhile, users were observed asking if people could find phone numbers connected to Instagram accounts and other requests, “who exchanges spy photos and videos?”

#Men #Buying #Hacking #Tools #Wives #Friendscrime,privacy,security,cybersecurity,hacking,surveillance,telegram

Post Comment