Google's AI may be less accurate after change to review process: Report

Google's AI may be less accurate after change to review process: Report

Behind the generative artificial intelligence responses that Google gives users is an army of people who rate the responses for accuracy. However, a new policy change is raising concerns that Google’s Gemini AI may become more prone to giving inaccurate answers. It’s potentially a major concern, particularly as Gemini gives automated answers to searches related to healthcare. TechCrunch reported that Google changed the rules for rating AI-genera…

Supposed expert reviews of Google Gemini outputs are coming from non-experts

Like any genAI model, Google Gemini responses can sometimes be inaccurate, but in this case it might be because testers don't have the expertise to fact-check them. According to TechCrunch, the firm hired to improve accuracy for Gemini is now making its testers evaluate responses even if they don't have the "domain knowledge." SEE ALSO: Google adds Deep Research to Gemini for browsing the web on your behalf The report raises questions about…

Google accused of using novices to fact-check Gemini's AI answers

Reviewers can no longer skip prompts outside their expertise.

Exclusive: Google's Gemini is forcing contractors to rate AI responses outside their expertise

Internal guidelines passed down from Google led to concerns that the AI model could be prone to inaccurate outputs on topics like healthcare.

Contractors Allegedly Required to Assess Unfamiliar Responses

Google’s Gemini AI may produce occasionally inaccurate responses, potentially due to testers lacking the necessary expertise to verify information effectively. Recent updates reveal that the team engaged to enhance Gemini’s accuracy has instructed testers to evaluate responses even if they lack “domain knowledge.” SEE ALSO: Google integrates Deep Research capabilities in Gemini for autonomous web browsing This situation raises concerns regard…

A new report alleges a change in Google's policies might make Gemini less accurate

There's a new report alleging Google might be getting a bit careless with Gemini's accuracy evaluations.