Leading tech groups including Microsoft and Meta also invest in similar safety systems

Financial Times

London

Greater London

England

United Kingdom

Anthropic makes ‘jailbreak’ advance to stop AI models producing harmful results

Ad Fontes Media

All Sides

Media Bias/Fact Check

Nikkei Inc.

Top news and commentary for technology's leaders, from all around the web.

Techmeme

California

United States

Anthropic details Constitutional Classifiers, a protective LLM layer designed to stop AI model jailbreaking by monitoring inputs and outputs for harmful content

Anthropic announced the development of a new system on Monday that can protect artificial intelligence (AI) models from jailbreaking attempts. Dubbed Constitutional Classifiers, it is a safeguarding...

NDTV Gadgets 360

Gautam Adani

Anthropic’s New Technique Can Protect AI From Jailbreak Attempts

The new Claude safeguards have already technically been broken but Anthropic says this was due to a glitch — try again.

VentureBeat

San Francisco

San Francisco County

Anthropic claims new AI security method blocks 95% of jailbreaks, invites red teamers to try

Two years after ChatGPT hit the scene, there are numerous large language models (LLMs), and nearly all remain ripe for jailbreaks — specific prompts and other workarounds that trick them into producing harmful content.  Model developers have yet to come up with an effective defense — and, truthfully, they may never be able to deflect such attacks 100% — yet they continue to work toward that aim.  To that end, OpenAI rival Anthropic, make of the …

DNyuz

Explore more offers.Then $75 per month. Complete digital access to quality FT journalism. Cancel anytime during your trial.Global news & analysisExpert opinionFT App on Android & iOSFT Edit appFirstFT: the day's biggest stories20+ curated newslettersFollow topics & set alerts with myFTFT Videos & Podcasts20 monthly gift articles to shareLex: FT's flagship investment column15+ Premium newsletters by leading expertsFT Digital Edition: our digitise…

Jingletree

AI startup Anthropic has demonstrated a new technique to prevent users from eliciting harmful content from its models, as leading tech groups including Microsoft and Meta race to find ways that protect against dangers posed by the cutting-edge technology. From a report: In a paper released on Monday...

slashdot.org

Anthropic Makes 'Jailbreak' Advance To Stop AI Models Producing Harmful Results

The new Claude safeguards have already technically been broken but Anthropic says this was due to a glitch — try again. This article has been indexed from Security News | VentureBeat Read the original article: Anthropic claims new AI security… Read more → The post Anthropic claims new AI security method blocks 95% of jailbreaks, invites red teamers to try appeared first on IT Security News.

IT Security News - cybersecurity, infosecurity news

2025-02-04 05:34:00 www.infoworld.com “In our new paper, we describe a system based on Constitutional Classifiers that guards models against jailbreaks,” Anthropic said. “These Constitutional Classifiers are input and output classifiers trained on synthetically generated data that filter the overwhelming majority of jailbreaks with minimal over-refusals and without incurring a large… Source

Anthropic makes ‘jailbreak’ advance to stop AI models producing harmful results

Coverage Details

Bias Distribution

Ownership

Similar News Topics

Similar News Topics