SFT Also Drives Safety Eval Results in Olmo 3
tl;drEngels et al. 2026 found that most safety-relevant properties of Gemini 3.1 Pro and Gemini 3 Flash were already present after SFT: post-SFT and production models score nearly identically across their safety evals. The authors were surprised by this and were unsure whether it would hold for other model families.We find it holds for Olmo 3 32B Think. The released SFT, DPO, and RLVR checkpoints are within noise of each other on every Petri dimension, ODCV-Bench, StrongREJECT, ImpossibleBench, ...
Read full article →