GPT-2's IOI behavior is defined where the paper's algorithm isn't

TL;DR: The IOI algorithm doesn't specify what to do when the indirect object token is duplicated. I observe that the model succeeds anyway. I'd like to know if I'm mistaken in the IOI paper's predictions, and I'd like to know what evidence you'd reach for next.BackgroundWang et al. (2022) addressed a grammatical task called Indirect Object Identification. Given text such as "When Mary and John went to the store, John gave a drink to", continuing the text requires identifying to what object John ...