Axes of Planning in LLMs + Partial Lit Review

Epistemic Status: Written over the course of a couple days at Inkhaven. Some of the info is old so some newer papers are excluded.TL;DR: People talk about "interpreting planning and goals" in models all the time, but people have different understandings of what exactly "planning" means. I try to decompose this into a few axes, and categorize some work these ways.We give a model a prompt, it produces and output. How does it work?Do language models Plan?When people look at language models, and wan...