Measuring Subliminal Trait Transfer with Confusion Matrices

Subliminal Learning [Cloud et al] demonstrated the transfer of owl preference by performing SFT on lists of numbers generated by a teacher model that was system prompted (or fine tuned) to imbue its outputs with a love of owls.In this work IPropose a methodology for studying subliminal learning that aims to help avoid selection bias and street-light effect pitfalls.Demonstrate a working experimental setup for small pretrained/base-models (PolyPythias). Previous work uses large language models th...