‘Significant inaccuracies’ found in AI-generated news summaries: BBC

Over half of LLM-written news summaries have “significant issues”—BBC analysis

Here at Ars, we've done plenty of coverage of the errors and inaccuracies that LLMs often introduce into their responses. Now, the BBC is trying to quantify the scale of this confabulation problem, at least when it comes to summaries of its own news content. In an extensive report published this week, the BBC analyzed how four popular large language models used or abused information from BBC articles when answering questions about the news. The …

The BBC put ChatGPT, Copilot, Gemini and Perplexity to the test. AI use in news is a "game with fire"

AI can’t accurately summarize news: BBC

The BBC asked four top AI platforms to summarize news stories. The British public broadcaster found that more than 51% of their responses had "significant issues." They included factual errors and altered quotes. Researchers are concerned about the potential harm caused by inaccuracies and distortions in AI-generated news summaries. They fear it could undermine trust in news. Nineteen percent of AI-generated summaries introduced factual errors…

AI chatbots distort the news, BBC finds - see what they get wrong

ChatGPT, Copilot, Gemini, and Perplexity were asked to summarize 100 news stories. Here's how they did.

AI summaries turn real news into nonsense, BBC finds

Research after Apple Intelligence fiasco shows bots still regularly make stuff up

This BBC Study Shows How Inaccurate AI News Summaries Actually Are

It turns out that getting your news from robots playing telephone with actual sources might not be the best idea. In a BBC study of OpenAI, Google Gemini, Microsoft Copilot, and Perplexity’s news prowess, the news organization found that “51% of all AI answers” about news topics had “significant issues of some form.”The study involved asking each bot to answer 100 questions about the news, using BBC sources when available, with their answers the…