My research: a computational cognitive neuroscience perspective on alignment

·Alignment Forum··

Note - title edited to be more descriptive.This is a summary of the work I've done and work I plan to do, and the theories of change and AI progress that motivate my work. I've been working full-time on alignment for three years and change, and thinking about brainlike AGI and its alignment increasingly often since 2004. Here's the research agenda in one breath: I'm trying to predict what the first transformative AI will be, in enough mechanistic detail that we can predict likely failure modes o...

Read full article →

Related Articles

A basic case for accelerating conceptual reasoning capabilities
Emery Cooper · Redwood Research · 3h ago
MIT's New Method Flags AI Models Trained on CASM Without Generating It
sdoering · Hacker News · 3mo ago
Red-Teaming OpenAI's Internal Agent Monitoring Systems
Buck Shlegeris · Redwood Research · 4d ago
Monitorability evaluations and policy proposals
evhub · Alignment Forum · 4d ago
Neural nets are exceptionally vulnerable to goal self-hack
Stuart_Armstrong · Alignment Forum · 5d ago