What happens when an LLM never sees material beyond fifth grade?

LittleLearner Chat Findings Models Sandbox Cite LittleLearner Language Models Under Pedagogically-Controlled Knowledge Exposure A language model that only knows what a 5th grader knows. Fanfei Li1,2*† · Jana Zeller1,2,3* · Manuel Prada-Corral1,2,3 · Thaddäus Wiedemer1,2 · Prasanna Mayilvahanan1,2 · Ryan Cotterell3 · Wieland Brendel1,2 1MPI for Intelligent Systems  ·  2ELLIS Institute Tübingen  ·  3ETH Zürich *Equal contribution  ·  †Correspondence to fanfei.li@tuebi