Oversight of automated research via summarisation: a toy model

Executive SummarySummarisation is one approach to oversight of automated research: a non-scheming agent distils insights from a large body of research into an informative short summary for a human overseer. We investigate a toy setting for this: translation of synthetic languages.A strong summariser model infers a synthetic language’s grammar from worked examples and produces a token-capped summary. A weaker student must use the summary to either translate held-out phrases (generation) or judge ...