The decoder writes one token per round
A 22-second loop. 0 to 2.5 s: The encoder reads I love you once, and its output arrow stays lit. Then four rounds of 4.6 s each: The output so far passes through masked self-attention, cross-attention and the MLP; the next token box shows 我, 爱, 你, then [end]; the first three tokens loop back into the output. The final state holds for about 2 seconds.
Encoder block
Decoder block
encoder
output
append
to input
Next token
?
我
爱
你
[end]
MLP
Cross-attention
Masked self-attention
MLP
Self-attention
Input tokens
I love you
Output tokens
[start]
我
爱
你