US EditionScientist turns people’s mental images into text using ‘mind-captioning’ technology
The AI-driven method decodes brain activity into detailed text with about 50% accuracy in identifying viewed or imagined videos among 100 candidates, advancing communication aid research.
- On November 25, 2025, Tomoyasu Horikawa published in Science Advances a method converting mental images into descriptive sentences using brain activity at NTT's Communication Science Laboratories.
- The research sought to bridge nonverbal mental representations and language by addressing limits of prior decoding methods reliant on verbal activity, aiming to help aphasia and other conditions limiting access to language.
- In the experiment, six adult participants underwent fMRI while viewing 2,180 silent videos and recalling 72 test videos repeated five times; researchers used DeBERTa, linear decoders, and RoBERTa with 100 optimization iterations.
- The method generated coherent descriptions without relying on the brain's traditional language regions, suggesting it could help people with aphasia or amyotrophic lateral sclerosis communicate.
- Ethicists such as Marcello Ienca and Aukasz Szoszkiewicz warned about mental-privacy risks and urged strict consent and regulation as study participants provided about 17 hours of data each.
14 Articles
14 Articles
A scientist in Japan developed a technique that uses brain scanners and artificial intelligence to convert a person’s mental images into descriptive and precise sentences. While there have been advances in the use of brain activity scanners to translate the words we think into text, converting our complex mental images into language has proved to be a challenge, according to Tomoyasu Horikawa, author of a study published on November 5 in Science…
'Mind Captioning' Brain Tech Translates What You're Seeing (And Imagining) Into Words
Plenty of people turn the captions on while watching TV, but what about captions for your thoughts? The post ‘Mind Captioning’ Brain Tech Translates What You’re Seeing (And Imagining) Into Words appeared first on Study Finds.
Mind captioning: This scientist just used AI to translate brain activity into text
A new study published in Science Advances presents a method that converts human brain activity into coherent, descriptive text—even when the brain is not actively processing language. Instead of decoding words or sentences directly, the method interprets the nonverbal representations that occur before thoughts are put into words. The study suggests that even when individuals are only watching or recalling silent video clips, their brain activity…
New AI technique converts brain activity into words
Scientists have developed a groundbreaking technique called ‘mind captioning’. Using this method, they can convert brain activity into descriptive sentences, effectively making it possible to translate a person’s thoughts. This non-invasive method employs brain imaging and artificial intelligence (AI) to interpret what someone visualises with remarkable accuracy. Researchers have long been able to predict what [… The post New AI technique conver…
Coverage Details
Bias Distribution
- 91% of the sources are Center
Factuality
To view factuality data please Upgrade to Premium
