I trained a small transformer in 1.5hrs and it beats many LLMs

You are using an outdated browser. Please upgrade your browser to improve your experience. Mithil Vakde's HomepageAbout MeBlogMisc Mithil VakdeIIT Bombay '23Engineering Physics Follow Bangalore, India Twitter LinkedIn44% on ARC-AGI-1 in 67 centsI trained a small transformer from scratch in 1.5hrs on a 5090 Beats many LLMs, and scores the same as TRM/HRMThis is an upgrade to my previous model Faster, better, cheaper and still open source.Also gets 7% on ARC-2Discussion on Twitter, Code on github