Towards LoRA science

Attribution: Nesiacel planned and executed all experiments. Analysis of the experiments was shared between the authors. Thanks to Clement Dumas for his input while we did this research. TLDR;1)We have developed a framework for reverse engineering LoRAs trained on MLP downprojection. We posit that it's extendable to all LoRAs and welcome further research.2) We reverse engineered a simple case of backdoored Weird Generalization3) In this post, we discuss the four experiments that developed this fr...