J-Lens can't detect what a subliminal learning teacher is transmitting (in 7B-32B models)
I ran the trademark experimental setup from the subliminal learning paper. I reproduced the subliminal learning effect, but I also found that on a teacher model that's been prompted to imbue its answers with a love for owls, a J-Lens reports that the model is rarely thinking about owls (top-1 at any point in ~1.5% of trials). This is really surprising if we grant that J-Lens looks at something like a "global workspace". The lens is not broken, since it seems to perform well on other tasks. This ...
Read full article →