Measuring Chain-of-Thought Necessity and the Effect of Reasoning Constraints

·LessWrong··

Why readCoT monitoring is a key oversight tool for AI safety, but only if the CoT faithfully reflects the reasoning behind the answer. If it doesn't, monitoring it tells us less about why the model chose that answer.I extend the CoT faithfulness interventions from Lanham et al. (2023) to ethical reasoning. These interventions measure CoT necessity - whether the answer is dependent on the CoT content - which is one element in establishing faithfulness, though not sufficient on its own. Consistent...

Read full article →

Related Articles

Why there are still no non-WebKit browsers on iOS
lapcat · Hacker News · 9h ago
OpenSSL: Buffer overflow in EVP_EncodeBlock() (CVE-2026-121481, CVSS 9.8)
JacobHenner · Hacker News · 22h ago
Unauthenticated remote code execution in Nginx
speedping · Hacker News · 2d ago
GIMP now has UI tests
qtqtqt · Hacker News · 20h ago
Pancreatic cancer halted by virus injection in three patients
cybermango · Hacker News · 1d ago