Backprop Alternative: Augmented Lagrangian Predictive Coding

We introduce PC-ALM, a local alternative to backpropagation. PC-ALM trains residual MLPs up to 1000 layers, nearly matching backprop