×
Anthropic says some Claude models can now end ‘harmful or abusive’ conversations  | TechCrunch

Anthropic says some Claude models can now end ‘harmful or abusive’ conversations  | TechCrunch

Anthropic has announced new capabilities that will allow some of its newest, largest models to end conversations in what the company describes as “rare, extreme cases of persistently harmful or abusive user interactions.” Strikingly, Anthropic says it’s doing this not to protect the human user, but rather the AI model itself.

To be clear, the company isn’t claiming that its Claude AI models are sentient or can be harmed by their conversations with users. In its own words, Anthropic remains “highly uncertain about the potential moral status of Claude and other LLMs, now or in the future.”

However, its announcement points to a recent program created to study what it calls “model welfare” and says Anthropic is essentially taking a just-in-case approach, “working to identify and implement low-cost interventions to mitigate risks to model welfare, in case such welfare is possible.”

This latest change is currently limited to Claude Opus 4 and 4.1. And again, it’s only supposed to happen in “extreme edge cases,” such as “requests from users for sexual content involving minors and attempts to solicit information that would enable large-scale violence or acts of terror.”

While those types of requests could potentially create legal or publicity problems for Anthropic itself (witness recent reporting around how ChatGPT can potentially reinforce or contribute to its users’ delusional thinking), the company says that in pre-deployment testing, Claude Opus 4 showed a “strong preference against” responding to these requests and a “pattern of apparent distress” when it did so.

As for these new conversation-ending capabilities, the company says, “In all cases, Claude is only to use its conversation-ending ability as a last resort when multiple attempts at redirection have failed and hope of a productive interaction has been exhausted, or when a user explicitly asks Claude to end a chat.”

Anthropic also says Claude has been “directed not to use this ability in cases where users might be at imminent risk of harming themselves or others.”

Techcrunch event

San Francisco
|
October 27-29, 2025

When Claude does end a conversation, Anthropic says users will still be able to start new conversations from the same account, and to create new branches of the troublesome conversation by editing their responses.

“We’re treating this feature as an ongoing experiment and will continue refining our approach,” the company says.

Source link
#Anthropic #Claude #models #harmful #abusive #conversations #TechCrunch

Samsung’s flagship Galaxy Book 6 Ultra laptop has the premium build, processor and graphics muscle required by creative pros. Can it replace a MacBook Pro?

#Samsung #Galaxy #Book #Ultra #MacBook #Pro">Samsung Galaxy Book 6 Ultra vs MacBook ProSamsung’s flagship Galaxy Book 6 Ultra laptop has the premium build, processor and graphics muscle required by creative pros. Can it replace a MacBook Pro?#Samsung #Galaxy #Book #Ultra #MacBook #Pro

Samsung’s flagship Galaxy Book 6 Ultra laptop has the premium build, processor and graphics muscle required by creative pros. Can it replace a MacBook Pro?

#Samsung #Galaxy #Book #Ultra #MacBook #Pro">Samsung Galaxy Book 6 Ultra vs MacBook ProSamsung Galaxy Book 6 Ultra vs MacBook ProSamsung’s flagship Galaxy Book 6 Ultra laptop has the premium build, processor and graphics muscle required by creative pros. Can it replace a MacBook Pro?#Samsung #Galaxy #Book #Ultra #MacBook #Pro

Samsung’s flagship Galaxy Book 6 Ultra laptop has the premium build, processor and graphics muscle required by creative pros. Can it replace a MacBook Pro?

#Samsung #Galaxy #Book #Ultra #MacBook #Pro

Microsoft says it built the new Run menu using code from Command Palette, a utility available through PowerToys that allows you to quickly run commands, open websites, search files, and more. Windows 11 Insiders can enable the new Run menu by going to Settings > System > Advanced and turning the option on. An early version of the redesigned Run menu started appearing in preview builds last year.

“We’ve collaborated tightly with partners across the platform to get these UI surfaces loading snappy,” Microsoft’s blog post says. “Improvements we’ve made to the platform don’t just make Run fast, but they help make the whole OS more efficient.”

#Microsoft #tests #redesigned #Windows #Run #menu #dark #modeMicrosoft,News,Tech,Windows">Microsoft tests redesigned Windows 11 Run menu with dark mode and moreIn a blog post explaining the changes, Microsoft says it decided to drop the Run menu’s “Browse” button — a shortcut to user files — after finding “very low usage.” Instead, Microsoft added support for a new “~\” command, which leads to your user directory.Microsoft says it built the new Run menu using code from Command Palette, a utility available through PowerToys that allows you to quickly run commands, open websites, search files, and more. Windows 11 Insiders can enable the new Run menu by going to Settings > System > Advanced and turning the option on. An early version of the redesigned Run menu started appearing in preview builds last year.“We’ve collaborated tightly with partners across the platform to get these UI surfaces loading snappy,” Microsoft’s blog post says. “Improvements we’ve made to the platform don’t just make Run fast, but they help make the whole OS more efficient.”#Microsoft #tests #redesigned #Windows #Run #menu #dark #modeMicrosoft,News,Tech,Windows

from Command Palette, a utility available through PowerToys that allows you to quickly run commands, open websites, search files, and more. Windows 11 Insiders can enable the new Run menu by going to Settings > System > Advanced and turning the option on. An early version of the redesigned Run menu started appearing in preview builds last year.

“We’ve collaborated tightly with partners across the platform to get these UI surfaces loading snappy,” Microsoft’s blog post says. “Improvements we’ve made to the platform don’t just make Run fast, but they help make the whole OS more efficient.”

#Microsoft #tests #redesigned #Windows #Run #menu #dark #modeMicrosoft,News,Tech,Windows">Microsoft tests redesigned Windows 11 Run menu with dark mode and more

In a blog post explaining the changes, Microsoft says it decided to drop the Run menu’s “Browse” button — a shortcut to user files — after finding “very low usage.” Instead, Microsoft added support for a new “~\” command, which leads to your user directory.

Microsoft says it built the new Run menu using code from Command Palette, a utility available through PowerToys that allows you to quickly run commands, open websites, search files, and more. Windows 11 Insiders can enable the new Run menu by going to Settings > System > Advanced and turning the option on. An early version of the redesigned Run menu started appearing in preview builds last year.

“We’ve collaborated tightly with partners across the platform to get these UI surfaces loading snappy,” Microsoft’s blog post says. “Improvements we’ve made to the platform don’t just make Run fast, but they help make the whole OS more efficient.”

#Microsoft #tests #redesigned #Windows #Run #menu #dark #modeMicrosoft,News,Tech,Windows

Post Comment