AI safety prizes by OscarD🔸

·Nuno Sempere··

Rather than pay­ing up front for AI safety re­search (push fund­ing), per­haps we should pay af­ter the fact for the work that made the most progress (pull fund­ing). This way, you only pay for work that was ac­tu­ally valuable.[1] When we know what the tar­get is, but not how to get there or who is best placed to solve the prob­lem, a prize is a use­ful in­cen­tive struc­ture.Benefits of prizesPrizes work well to in­cen­tivise in­no­va­tion when:The even­tual win­ner is un­pre­dictable (oth­er­...

Read full article →

Related Articles

Will an AI agent cause a plane crash in 2026?
Alex · Manifold Markets · 4d ago
Will the worst day in cyber security in 2026 be after 10/21/2026?
Zvi Mowshowitz · Manifold Markets · 7d ago
Will there be a massive internet outage before 2028?
Plant · Manifold Markets · 8d ago
Spread it out vs keep it in one place: testing two ways to protect a model’s refusal behaviour by Amirtha_Yazhini
Amirtha_Yazhini · Nuno Sempere · 9d ago
Nobody is measuring whether humans can still catch AI’s mistakes by ANTHONIO OLADIMEJI
ANTHONIO OLADIMEJI · Nuno Sempere · 9d ago