1 · Language
Training step
characters read
loss on unseen text ↓
weight spread (std)
What the model writes after the prompt (same random seed every time):
A 32 × 32 corner of one weight matrix (red +, blue −)
How all its 36,864 numbers are spread
2 · Loss on unseen text while training (lower is better)