Gå til innholdet
Global sound
Learn AI in Bits

Learn AI in Bits

052 - Chain of Thought and Neuralese: Does AI Need Language to Think?

· 5 min · Sesong 1 Episode 52

Episodebeskrivelse

What does an AI model actually use when it reasons? This episode explores chain of thought, why written reasoning is useful but imperfect, and the research history behind "Neuralese," a term originally used for learned machine-to-machine communication protocols. It also looks at Coconut and continuous latent reasoning, and why less human-readable reasoning creates new interpretability and safety questions.

Voice narration is AI-generated.

REFERENCES

OpenAI — Reasoning models struggle to control their chains of thought, and that's good
https://openai.com/index/reasoning-models-chain-of-thought-controllability/

OpenAI — Evaluating chain-of-thought monitorability
https://openai.com/index/evaluating-chain-of-thought-monitorability/

OpenAI — Detecting misbehavior in frontier reasoning models
https://openai.com/index/chain-of-thought-monitoring/

Anthropic — Measuring faithfulness in Chain-of-Thought reasoning
https://www.anthropic.com/research/measuring-faithfulness-in-chain-of-thought-reasoning

Anthropic — Reasoning models don't always say what they think
https://www.anthropic.com/research/reasoning-models-dont-say-think

ACL Anthology — Translating Neuralese, Andreas, Dragan, Klein, 2017
https://aclanthology.org/P17-1022/

ArXiv — Training Large Language Models to Reason in a Continuous Latent Space, Coconut
https://arxiv.org/abs/2412.06769

ACL Anthology — Cognitively Inspired Developmental Trajectories Improve Explore-Exploit Dynamics in Neural Agent Emergent Communication, 2026
https://aclanthology.org/2026.conll-main.8/

ACL Anthology — Unsupervised Translation of Emergent Communication, 2025
https://ojs.aaai.org/index.php/AAAI/article/view/34489

Nettsted: podcasters.spotify.com

Live, siste time: 8 848 låter på 3 470 stasjoner i 90 land

Oppdag verden gjennom radioen

Flere måter å oppdage på (7)

Hørt noe fint? Lagre det, eller åpne det rett i Spotify.

★ Artist of the week The fastest riser on the radio this week
Your song here? From € 9 per week →
Onești City RadioFortsett å lytte