Compute growth doesn't make a software intelligence explosion more likely
This is a nitpick of a claim that I sometimes see in discussions of a software intelligence explosion. There is a careful analysis of the conditions under which an SIE will occur, assuming a fixed stock of compute. Then the argument concludes with "And in reality, compute is not fixed and is in fact growing exponentially, so an SIE is even more likely than this analysis suggests." This conclusion is false. Exponentially growing physical compute has no effect on the likelihood of an SIE. To see t...
Read full article →