Peek LLM

Concept 02 · Embeddings

Embeddings

Token IDs are just integers — the model can't compute with those. Each ID is exchanged for a row of 768 numbers, and suddenly meaning has geometry. Pick a way to see it.

1 exhibit Real GPT-2 vectors Offline, single file each