What Did Astra See?
The Sparks of Weight Space Programming blog post describes some surprising capabilities Astra has for working directly with model weights. In one experiment, Astra is able to produce a diagram of the maze for a small Pacman game just by looking at the weights of a policy network trained to play it. This inspired us to look into what kind of visual reasoning Astra is able to do, and how that might help explain some of the impressive results found in the blog post.We found evidence that Astra can ...
Read full article →