Plan B for Alignment: Seeding Environmental Doubt
TLDRLarge language models’ eval-awareness and their tendency to sandbag (strategically underperform on capabilities) during safety evaluations is a serious area of concern for AI safety, as they call into question the validity of results based on safety evaluations, and because they may indicate a tendency towards deceptive alignment. Recent results show LLMs tailoring their performance according to the apparent target of the evaluation, causing them to underrepresent their capabilities on safet...
Read full article →