Persona Cartography: Charting Language Model Personality Traits in Weight Space

This post summarises the paper Persona Cartography: Charting Language Model Personality Traits in Weight Space.Paper | GitHub | HuggingFaceTL;DRUnderstanding and controlling the character of LLMs is important for safety, as we want our models to be good by disposition.We use a modified Open Character Training pipeline for instilling Big-5 OCEAN personality traits in LLMs across a range of families and sizes (Llama 3.1/Qwen3/Gemma3 sizes 4B-32B).We show that we can scale, invert and combine these...