A global workspace in language models

[This is the blog post for our new paper Verbalizable Representations Form a Global Workspace in Language ModelsReaders might also be interested in: the Public commentary, Github and Neuronpedia]As you read this sentence, circuits in your brain are adjusting your posture, controlling your breathing, and transforming lines and curves on the screen into recognizable words. Most of this processing is invisible to you. But some of what takes place in your brain you do have access to—an image that po...