Transformers Deep Dive
Tutorial · Intermediate · 21 min
Self-attention lets every token look at every other token and decide, per token, which ones matter. Query, key, value, and a quadratic cost.
AttentionSelf-attention
Includes Colab notebook
By: Anacodic Team
Start Reading →