Model ethology for understanding average case alignment

TLDR:We want to tell if models are aligned enough to use in important use cases. I call this property trustworthiness. Our current ways of assessing trustworthiness seem mostly based on case studies or vibes. I think we should aim to systematically search for realistic honeypot cases where models misbehave. We should do this by first characterizing the types of misaligned behaviors models engage in, and the conditions and frequency with which they occur. This will take a lot of data.I think we s...