‘Significant inaccuracies’ found in AI-generated news summaries: BBC
- Four major artificial intelligence chatbots inaccurately summarize news stories, according to research carried out by the BBC.
- The BBC report stated that the chatbots contained 'significant inaccuracies' and distortions.
- Nine out of ten AI chatbot responses about news queries contained at least some issues, BBC research has claimed.
- The research indicated that the 'companies developing Gen AI tools are playing with fire.
24 Articles
24 Articles
Over half of LLM-written news summaries have “significant issues”—BBC analysis
Here at Ars, we've done plenty of coverage of the errors and inaccuracies that LLMs often introduce into their responses. Now, the BBC is trying to quantify the scale of this confabulation problem, at least when it comes to summaries of its own news content. In an extensive report published this week, the BBC analyzed how four popular large language models used or abused information from BBC articles when answering questions about the news. The …
The BBC put ChatGPT, Copilot, Gemini and Perplexity to the test. AI use in news is a "game with fire"
AI can’t accurately summarize news: BBC
The BBC asked four top AI platforms to summarize news stories. The British public broadcaster found that more than 51% of their responses had "significant issues." They included factual errors and altered quotes. Researchers are concerned about the potential harm caused by inaccuracies and distortions in AI-generated news summaries. They fear it could undermine trust in news. Nineteen percent of AI-generated summaries introduced factual errors…
AI Models Are Terrible At Relaying or Summarizing News
A new study has showed that the leading AI models are terrible at summarizing or relaying news stories, casting doubt on their role in journalistic applications. The study was conducted by the BBC and looked OpenAI’s ChatGPT, Microsoft’s Copilot, Google’s Gemini, and Perplexity AI. The study involved giving the AI models content from the outlet’s website and then asking questions about the news stories. Deborah Turness, CEO of BBC News and Curre…
A BBC study showed that Gemini makes mistakes more often than competitors.
Coverage Details
Bias Distribution
- 59% of the sources are Center
Factuality
To view factuality data please Upgrade to Premium
