after a cursory read, I can confidently say I could not, in fact, have come up with Kimi Delta Attention.

why are you using braket notation?

I like the math vs physics toggle.

I could never get this about modern machine/deep learning or even the Transformers. Yes, it's not exactly rocket science, but when I see the data flow diagrams, it's not clear what is calculated in real time or multiple steps.

Is it really one big computation f(g(h(x)))?

You know its a doozy when the author writes a disclaimer at the top saying that bra-ket notation was chosen in order to make the algorithm and data structures clearer.

The toggle is really useful. Liked it!!