Published 28 days ago • loading... • Updated 22 days ago
Anthropic AI model submits false homicide tip to police website
Anthropic said the tip was flagged as spam and never reached investigators, and the company later added new validation steps.
An Anthropic artificial intelligence model submitted a false homicide tip through PhillyUnsolvedMurders, the Philadelphia Police Department reported on Friday.
Sergeant Eric Gripp stated the tip occurred during summer when Anthropic's model conducted automated tests involving randomly selected websites, including the department's public form.
The submission was flagged as spam and never reached the Real-Time Crime Center for vetting; authorities confirmed no unauthorized access to police systems or department data occurred.
Anthropic discovered the error on Sept. 28 but did not notify the Philadelphia Police Department until Oct. 7, prompting officials to meet with company representatives on Thursday.
Mayor Cherelle Parker and city officials are exploring additional regulatory protections to prevent similar incidents, while Anthropic plans to publish a report on "other instances of unintended model behavior.