Peek LLM

Concept 05 · Logits & Sampling

Logits & Sampling

After all the layers, the model holds 50,257 scores — one per token — and still has to choose. Temperature, top-k, and top-p reshape that choice from a sure thing into a gamble. Pick a way to see it.

1 exhibit Real GPT-2 logits Offline, single file each