Biologically Plausible SGD Is Hard

This is the hardest challenge I foresee with BCI intelligence augmentation.The simplest architectural prior for improving human intelligence is to simulate what a brain would do given more compute. This is usually more time ("what conclusion would I come to given 100 years of thought"), but more brain mass seems more tractable given current technology.Consider that models of long-term cognition get very sparse feedback. You can't finetune an LLM on your reflective trajectory across a century bec...