No Result
View All Result
SUBMIT YOUR ARTICLES
  • Login
Monday, October 6, 2025
TheAdviserMagazine.com
  • Home
  • Financial Planning
    • Financial Planning
    • Personal Finance
  • Market Research
    • Business
    • Investing
    • Money
    • Economy
    • Markets
    • Stocks
    • Trading
  • 401k Plans
  • College
  • IRS & Taxes
  • Estate Plans
  • Social Security
  • Medicare
  • Legal
  • Home
  • Financial Planning
    • Financial Planning
    • Personal Finance
  • Market Research
    • Business
    • Investing
    • Money
    • Economy
    • Markets
    • Stocks
    • Trading
  • 401k Plans
  • College
  • IRS & Taxes
  • Estate Plans
  • Social Security
  • Medicare
  • Legal
No Result
View All Result
TheAdviserMagazine.com
No Result
View All Result
Home Market Research Startups

Anthropic says some Claude models can now end ‘harmful or abusive’ conversations 

by TheAdviserMagazine
2 months ago
in Startups
Reading Time: 2 mins read
A A
Anthropic says some Claude models can now end ‘harmful or abusive’ conversations 
Share on FacebookShare on TwitterShare on LInkedIn


Anthropic has announced new capabilities that will allow some of its newest, largest models to end conversations in what the company describes as “rare, extreme cases of persistently harmful or abusive user interactions.” Strikingly, Anthropic says it’s doing this not to protect the human user, but rather the AI model itself.

To be clear, the company isn’t claiming that its Claude AI models are sentient or can be harmed by their conversations with users. In its own words, Anthropic remains “highly uncertain about the potential moral status of Claude and other LLMs, now or in the future.”

However, its announcement points to a recent program created to study what it calls “model welfare” and says Anthropic is essentially taking a just-in-case approach, “working to identify and implement low-cost interventions to mitigate risks to model welfare, in case such welfare is possible.”

This latest change is currently limited to Claude Opus 4 and 4.1. And again, it’s only supposed to happen in “extreme edge cases,” such as “requests from users for sexual content involving minors and attempts to solicit information that would enable large-scale violence or acts of terror.”

While those types of requests could potentially create legal or publicity problems for Anthropic itself (witness recent reporting around how ChatGPT can potentially reinforce or contribute to its users’ delusional thinking), the company says that in pre-deployment testing, Claude Opus 4 showed a “strong preference against” responding to these requests and a “pattern of apparent distress” when it did so.

As for these new conversation-ending capabilities, the company says, “In all cases, Claude is only to use its conversation-ending ability as a last resort when multiple attempts at redirection have failed and hope of a productive interaction has been exhausted, or when a user explicitly asks Claude to end a chat.”

Anthropic also says Claude has been “directed not to use this ability in cases where users might be at imminent risk of harming themselves or others.”

Techcrunch event

San Francisco
|
October 27-29, 2025

When Claude does end a conversation, Anthropic says users will still be able to start new conversations from the same account, and to create new branches of the troublesome conversation by editing their responses.

“We’re treating this feature as an ongoing experiment and will continue refining our approach,” the company says.



Source link

Tags: abusiveAnthropicClaudeconversationsHarmfulModels
ShareTweetShare
Previous Post

Insider trades: Eli Lilly, Boeing, Nike among notable names this week

Next Post

Not in my back pocket (NIMBP)

Related Posts

edit post
Heidi Health raises M Series B led by Steve Cohen’s Point72

Heidi Health raises $65M Series B led by Steve Cohen’s Point72

by TheAdviserMagazine
October 6, 2025
0

Dr. Tom Kelly is a trauma surgeon, and everywhere, he sees doctors drowning in administrative work. He wanted change, so...

edit post
OpenAI and Jony Ive may be struggling to figure out their AI device

OpenAI and Jony Ive may be struggling to figure out their AI device

by TheAdviserMagazine
October 5, 2025
0

OpenAI and Jony Ive face significant technical challenges as they work to develop a screen-less, AI-powered device, according to the...

edit post
Gen Z Hiring Trends You Can’t Afford to Ignore

Gen Z Hiring Trends You Can’t Afford to Ignore

by TheAdviserMagazine
October 5, 2025
0

Gen Z is officially entering the workforce. The generation famously known for reshaping consumer markets with TikTok trends is now...

edit post
Startups and the U.S. government: It’s getting complicated

Startups and the U.S. government: It’s getting complicated

by TheAdviserMagazine
October 4, 2025
0

The tie between startups and the U.S. government have strengthened in recent years, a shift buoyed by an interest in...

edit post
Instacrops will demo its water-saving, crop-boosting AI at TechCrunch Disrupt 2025

Instacrops will demo its water-saving, crop-boosting AI at TechCrunch Disrupt 2025

by TheAdviserMagazine
October 4, 2025
0

Agriculture is a thirsty industry, consuming 70% of all fresh water used worldwide. In some countries, like India or Chile,...

edit post
In other news this week: Monterro launches new €1.7B funds, Teylor lands €150M, Vibe.co raises €42.5M and more

In other news this week: Monterro launches new €1.7B funds, Teylor lands €150M, Vibe.co raises €42.5M and more

by TheAdviserMagazine
October 4, 2025
0

The past few weeks have been very busy in the tech startup sector. There have been many announcements, including funding...

Next Post
edit post
Not in my back pocket (NIMBP)

Not in my back pocket (NIMBP)

edit post
How to Score Them + HUGE List!

How to Score Them + HUGE List!

  • Trending
  • Comments
  • Latest
edit post
What Happens If a Spouse Dies Without a Will in North Carolina?

What Happens If a Spouse Dies Without a Will in North Carolina?

September 14, 2025
edit post
California May Reimplement Mask Mandates

California May Reimplement Mask Mandates

September 5, 2025
edit post
Does a Will Need to Be Notarized in North Carolina?

Does a Will Need to Be Notarized in North Carolina?

September 8, 2025
edit post
DACA recipients no longer eligible for Marketplace health insurance and subsidies

DACA recipients no longer eligible for Marketplace health insurance and subsidies

September 11, 2025
edit post
‘Quiet luxury’ is coming for the housing market, The Corcoran Group CEO says. It’s not just the Hamptons, Aspen, and Miami anymore

‘Quiet luxury’ is coming for the housing market, The Corcoran Group CEO says. It’s not just the Hamptons, Aspen, and Miami anymore

September 9, 2025
edit post
Tips to Apply for Mental Health SSDI Without Therapy

Tips to Apply for Mental Health SSDI Without Therapy

September 19, 2025
edit post
Paul Tudor Jones says ingredients are in place for massive rally before a ‘blow off’ top to bull market

Paul Tudor Jones says ingredients are in place for massive rally before a ‘blow off’ top to bull market

0
edit post
Mongolia to join data center frenzy with Chinggis Khaan sovereign wealth fund

Mongolia to join data center frenzy with Chinggis Khaan sovereign wealth fund

0
edit post
Ethereum’s Price as Grayscale Launches Staking ETPs – ,331?

Ethereum’s Price as Grayscale Launches Staking ETPs – $7,331?

0
edit post
When Moving to a “Resort-Like” Senior Living Community Isn’t Worth It

When Moving to a “Resort-Like” Senior Living Community Isn’t Worth It

0
edit post
AMD signs AI chip-supply deal with OpenAI, shares surge 38%

AMD signs AI chip-supply deal with OpenAI, shares surge 38%

0
edit post
Gen Z has a different attitude about dining from baby boomers and millennials—and it shows in smaller tickets at chain restaurants

Gen Z has a different attitude about dining from baby boomers and millennials—and it shows in smaller tickets at chain restaurants

0
edit post
Ethereum’s Price as Grayscale Launches Staking ETPs – ,331?

Ethereum’s Price as Grayscale Launches Staking ETPs – $7,331?

October 6, 2025
edit post
Paul Tudor Jones says ingredients are in place for massive rally before a ‘blow off’ top to bull market

Paul Tudor Jones says ingredients are in place for massive rally before a ‘blow off’ top to bull market

October 6, 2025
edit post
AMD signs AI chip-supply deal with OpenAI, shares surge 38%

AMD signs AI chip-supply deal with OpenAI, shares surge 38%

October 6, 2025
edit post
Gen Z has a different attitude about dining from baby boomers and millennials—and it shows in smaller tickets at chain restaurants

Gen Z has a different attitude about dining from baby boomers and millennials—and it shows in smaller tickets at chain restaurants

October 6, 2025
edit post
Should You Consider Adding Chipotle Mexican Grill (CMG) to Your Portfolio?

Should You Consider Adding Chipotle Mexican Grill (CMG) to Your Portfolio?

October 6, 2025
edit post
Are South Korean retail traders the only thing keeping Ethereum treasury companies alive?

Are South Korean retail traders the only thing keeping Ethereum treasury companies alive?

October 6, 2025
The Adviser Magazine

The first and only national digital and print magazine that connects individuals, families, and businesses to Fee-Only financial advisers, accountants, attorneys and college guidance counselors.

CATEGORIES

  • 401k Plans
  • Business
  • College
  • Cryptocurrency
  • Economy
  • Estate Plans
  • Financial Planning
  • Investing
  • IRS & Taxes
  • Legal
  • Market Analysis
  • Markets
  • Medicare
  • Money
  • Personal Finance
  • Social Security
  • Startups
  • Stock Market
  • Trading

LATEST UPDATES

  • Ethereum’s Price as Grayscale Launches Staking ETPs – $7,331?
  • Paul Tudor Jones says ingredients are in place for massive rally before a ‘blow off’ top to bull market
  • AMD signs AI chip-supply deal with OpenAI, shares surge 38%
  • Our Great Privacy Policy
  • Terms of Use, Legal Notices & Disclosures
  • Contact us
  • About Us

© Copyright 2024 All Rights Reserved
See articles for original source and related links to external sites.

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • Home
  • Financial Planning
    • Financial Planning
    • Personal Finance
  • Market Research
    • Business
    • Investing
    • Money
    • Economy
    • Markets
    • Stocks
    • Trading
  • 401k Plans
  • College
  • IRS & Taxes
  • Estate Plans
  • Social Security
  • Medicare
  • Legal

© Copyright 2024 All Rights Reserved
See articles for original source and related links to external sites.