02 / 06 · Transformer self-attention

Attention visualizer

Type a sentence and see the Q·Kᵀ scores turn into a softmax heatmap, with a causal mask and a temperature control.