Gemma The Unstopping: a Behavioral Experiment
Following up on my previous experiment - studying Gemma's behavior on agentic tasks when given the number of steps left across the run - I endeavored to see whether giving Gemma a stop_run tool meaningfully changes it's behavior.My initial assumption was that it would not change the completion rate of these tasks, and that has been correct.What I wanted to test:Whether Gemma would "give up" when nearing the end of the run after hitting a dead end. Interesting.Whether Gemma would "want to stop" -...
Read full article →