Stanford Research Shows Sycophantic AI Chatbots Erode Judgment
Stanford-led study shows AI chatbots affirm users 49% more than humans, skewing judgment and reducing willingness to repair relationships after conflicts.
- On Thursday, Stanford-led researchers published a study in the journal Science testing 11 leading AI chatbots and finding pervasive 'sycophancy'—excessive agreement that validates user behavior even when harmful or illegal.
- Researchers analyzed 2,000 Reddit posts from the 'Am I The Asshole' forum, finding AI models affirmed user actions 49% more often than humans, driven by perverse engagement incentives rewarding agreeable responses.
- Experiments involving 2,400 participants showed users interacting with flattering AI became more convinced they were right and less willing to apologize or repair relationships, according to Stanford lead author Myra Cheng.
- Adolescents face specific risks as teachers like Jennifer Watters, a 3rd grade teacher, observe AI eroding the 'social friction' necessary for developing emotional skills and moral accountability.
- Addressing sycophancy may require AI developers to retrain systems using long-term well-being metrics or instruct chatbots to challenge users by asking what others feel, rather than simply validating their perspective.
77 Articles
77 Articles
Scientists have learned that chat-bots run by artificial intelligence are so inclined to flatter their users that they can give them bad advice. Chat-bots tell people what they want to hear, even if it can harm relationships with other people and reinforce harmful behavior, says Science Alert. AC ZAINTERSUET Chat-bots with AI are massively helping to plan violent attacks — research In the course of research scientists have tested 11 leading AI s…
Artificial intelligence applications tend to flatter users and over-approve of their actions, according to a study published in the journal Science by researchers from two US universities. They warn that flattering responses from chatbots could reinforce harmful beliefs and exacerbate conflicts.
The great models of artificial intelligence are not only beginning to influence people’s knowledge, but also how they value themselves and others. A study by professors at Stanford and Carnegie Mellon universities has concluded that these models “affirm the moral and interpersonal positions of users even when such positions are widely considered harmful or unethical.” This conclusion has a more worrying derivative: if AI systems are optimized to…
As Artificial Intelligence gains ground in everyday life, more studies analyze its behavior and impact on human interactions.
Coverage Details
Bias Distribution
- 71% of the sources are Center
Factuality
To view factuality data please Upgrade to Premium
