Large Language Models Struggle with Coordination in Social and Cooperative Games

Large language models struggle with coordination in social and cooperative games

Large language models (LLMs), such as the model underpinning the functioning of the popular conversational platform ChatGPT, are now widely used by people worldwide to source information, as well as to summarize, analyze and generate texts. Studies examining the responses provided by LLMs in different scenarios could help to gain a deeper understanding of their tendencies during social interactions, which could fuel their future advancement.

How good are large language models at playing games?

Video games, with their demands on perception, memory, and strategic planning, seem like a natural arena for testing the capabilities of modern Large Language Models (LLMs). However, researchers have found that simply “dropping” LLMs into popular games often fails to provide an effective evaluation. A new benchmark, LMGAME-BENCH, developed by a team from UC San Diego, MBZUAI, and UC Berkeley, aims to change that by creating a more reliable and i…