Encouraging general generalisation: Teaching Gemma (To Articulate) Why

TL;DRBuilding on previous research, I create a constitution for Gemma 3 27B-IT and attempt to Gemma to it in a way that generalises.I argue that alongside previously considered types of alignment generalisation (across dilemmas and across environments), a new type is worth considering: generalisation across principles (i.e. a model's ability to apply some part of its constitution helps it apply other parts). To evaluate if models' alignment generalises across principles, I hold out scenarios inv...