Avoiding steering awareness by optimizing steering parameters

Steering effectiveness and detection depend heavily on the target concept and model combination. Why this is a concern for safety evaluations and how to mitigate it.TL;DR:Recent research provides robust evidence about models being able to detect steering being performed on them.This capability could help the model infer it’s being evaluated and elicit unwanted or unexpected behavior that might compromise benchmarks or evaluations employing steering as a measurement tool.The relationship between ...