Mixing Cat Trivia Into Math Problems Increases Ai Errors by 300%

GIGAZINE

Factuality

Ownership

In recent years, large-scale language models (LLMs) have achieved remarkable performance improvements in the fields of mathematics and coding thanks to the emergence of "inference models" that solve complex problems step by step. However, their robustness, i.e., their resistance to unexpected inputs, has not yet been fully understood. A team of researchers from Stanford University and Collinear AI has published research results showing that "ins…