Studio · Computed tiny MLP

Fig. 1

Input activations are ready.

A computed four by three by three neural network Four input activations connect to three ReLU neurons, which connect to three candidate token outputs. Select a neuron or wire to inspect its calculation.
Input. Four values stand in for one tiny hidden state. Select any node or wire to inspect it.