Logits & Sampling
After all the layers, the model holds 50,257 scores — one per token — and still has to choose. Temperature, top-k, and top-p reshape that choice from a sure thing into a gamble. Pick a way to see it.
Concept 05 · Logits & Sampling
After all the layers, the model holds 50,257 scores — one per token — and still has to choose. Temperature, top-k, and top-p reshape that choice from a sure thing into a gamble. Pick a way to see it.