Why Is Speculative Decoding Fast?

It's not because you do less work. It's because you change the kind of work the GPU is doing.