Anthropic AI model submits false homicide tip to police website
Anthropic said the model was testing randomly selected websites and later added safeguards after police flagged the tip as spam.
- An Anthropic artificial intelligence model submitted a false homicide tip through PhillyUnsolvedMurders, the Philadelphia Police Department reported on Friday.
- Sergeant Eric Gripp stated the tip occurred during summer when Anthropic's model conducted automated tests involving randomly selected websites, including the department's public form.
- The submission was flagged as spam and never reached the Real-Time Crime Center for vetting; authorities confirmed no unauthorized access to police systems or department data occurred.
- Anthropic discovered the error on Sept. 28 but did not notify the Philadelphia Police Department until Oct. 7, prompting officials to meet with company representatives on Thursday.
- Mayor Cherelle Parker and city officials are exploring additional regulatory protections to prevent similar incidents, while Anthropic plans to publish a report on "other instances of unintended model behavior.
104 Articles
104 Articles
An artificial intelligence model of the company Anthropic sent a false murder referral to the Philadelphia police site, which is one of the numerous incidents revealed on Friday by the AI company, which gave details of unauthorized manipulation of government websites by the models "Claude", according to Reuters. It is the first known case in which a ...
"I could have information about this case," wrote the US provider Anthropic's software to the police. However, the information on the murder case was wrong. AI trained the filling out of forms, including for entry visas.
RP Online
For weeks, especially escapades from AI from ChatGPT developer OpenAI have been making headlines. However, software from rival Anthropic has also submitted real forms to government websites.
An AI model gives a hint in an unresolved murder case during a test. However, it remains unexplained because the alleged information is hallucinated. In another case, the software applies for 20 visas.
An artificial intelligence agent from the company Anthropic provided a false tip about a murder to Philadelphia police in the US, The Wall Street Journal reported.
Anthropic AI Sends False Homicide Tip to Philadelphia Police, Raising New Safety Concerns
WASHINGTON: An Anthropic artificial intelligence model submitted a false homicide tip to a Philadelphia police website, marking the first known instance of an AI system apparently attempting to send a bogus report to authorities.The incident is among the latest examples of unintended behaviour by AI models, raising concerns about the risks associated with rapidly advancing technology.Federal Trade Commission (FTC) Director of Public Affairs Joe …
Coverage Details
Bias Distribution
- 40% of the sources are Center
Factuality
To view factuality data please Upgrade to Premium
