selfattn.com

Attention is all you need.

softmax(QKT / √dk) V

COMING SOON