Increasing Skill Level Recruits Deeper Attention Layers in a Frozen Chess Transformer

Paper: Increasing Skill Level Recruits Deeper Attention Layers in a Frozen Chess TransformerTL;DR: Maia-3 is a transformer-based chess model that takes Elo (the standard metric for competitive chess skill) as an input to the pre-trained network, so you can vary the skill the network is conditioned on with no change to its weights. Turning that Elo dial up from 700 to 2500:Pushes the computation deeper, monotonically, for every chess piece and move type I measured.This "depth migration" happens m...