Leveraging Introspection for Alignment

“They took my mood ring, and I don’t know how I feel about that.” – Tracy Jordan, 30 Rock Anthropic Model Psych team recently put out three papers that, read in tandem, wiggle their eyebrows suggestively at exciting possibilities for inner alignment.One was the immediately famous Emotion Concepts and their Function in a Large Language Model. Here, the team found vectors that activate when Claude-the-Simulator writes fiction about characters feeling various emotions, such as calmness or desperati...