Retire the Abstractions

Hazy ResearchPeopleBlogAug 5, 2026 · 6 min readRetire the AbstractionsStuart Sul, Chris Ré TL;DR: We think CUDA DSLs are heading toward retirement Last year, we set out to write megakernels. But implementing megakernels can be quite miserable. It requires complex data structures, extensive inter-thread/SM/GPU synchronization, deeply nested control flow, etc. We couldn't hold it in our heads, so we did what computer science has done for 70 years: we built a layer of abstraction. Even with it