How to Measure Intelligence Beyond Human Scale?

Based on the academic paper: Measuring Intelligence Beyond Human Scale[1]TLDR: Historically, intelligence benchmarks have been composed of human-generated questions. However, current techniques do not scale to AI, as capabilities surpass human intelligence. We propose the paradigm of adversarial psychometrics, in which participants generate questions and are rewarded for separating each other’s capabilities, without requiring an external judge.A brief history of measuring intelligenceWhat does i...