Trying to grok Anthropic's Global Workspace paper and the J-space
IntroductionThe aim of this post is to share a quick attempt at grokking the conceptual ideas that lie behind the notion of J-space and how it is calculated in the paper Verbalizable Representations Form a Global Workspace in Language Models. Specifically, I am trying to understand Section 2.1 of the paper, rather than the abundant empirical findings. I also share a few quick takes.I make no claim for originality or insight, and only a light claim on correctness. Nevertheless, I believe it will ...
Read full article →