US EditionGoogle’s AI Overviews Are Making Mistakes at Massive Scale. Here’s What to Know
Oumi’s analysis found Gemini 3 raised accuracy to 91% on 4,326 searches, but source links were wrong more than 56% of the time.
- A report from The New York Times and Oumi found one in 10 Google queries generated summaries with incorrect information, with the analysis also indicating the AI often links to sources that do not support its claims.
- Oumi found Gemini 3 improved accuracy to 91 percent from 85 percent in Gemini 2, though sourcing degraded with Gemini 3 producing erroneous links more than 56 percent of the time compared to 37 percent previously.
- Studies suggest users often trust AI responses without verification, a trend researchers call "cognitive surrender," while the AI model adopts an authoritative tone making it difficult for users to verify claims.
- Google spokesman Ned Adriance claimed the study has "serious holes" and does not reflect real user behavior, arguing the SimpleQA benchmark contains errors and does not represent typical search queries.
- With Google processing five trillion queries annually, the analysis calculated AI Overviews could provide wrong answers to millions of users every hour as the company continues implementing the technology across Google Discover and Search.
13 Articles
13 Articles
Google’s AI Overviews spew out millions of false answers per hour, bombshell study reveals
Google’s AI-generated search results are spewing out tens of millions of inaccurate answers per hour – even as the tech giant siphons visitors and ad revenue from cash-strapped news outlets, according to a bombshell analysis.
Analysis Finds That Google's AI Overviews Are Providing Misinformation at a Scale Possibly Unprecedented in the History of Human Civilization
Google’s AI Overviews are peddling misinformation on a scale that may be virtually unprecedented in human history. A recent analysis conducted by the AI startup Oumi at the behest of The New York Times found that the AI-generated summaries, which appear above Google search results, are accurate around 91 percent of the time. In a sense, that may sound like an impressive figure. But here’s an even more impressive one: five trillion. That’s rough…
der Standard AT
der Standard DEThe AI summaries are more and more replacing the classic link list. However, they are regularly based on unsavory sources or quote wrongly.
Coverage Details
Bias Distribution
- 50% of the sources lean Left
Factuality
To view factuality data please Upgrade to Premium
