Indirect lessons from human alignment

(Inspired by a post from Eli Tyre.) Many people make some variant of the following argument: Evolution is an “outer optimizer”. It is trying to make us maximize reproductive fitness. We are “inner optimizers”. We just do what feels good. But what feels good has been set by evolution, which is hoping that it will make us maximize reproductive fitness. But we don’t maximize reproductive fitness. In fact, birth rates are dropping everywhere. Therefore evolution failed. The standard interpretation i...