How does a talking computer work?

Some computers can write stories and answer questions. Today we are going to peek inside one and see how it does it.

The journey · about 30 minutes

01Words become blocksBlocks
02It read lots and lots of storiesReading
03Guess the next wordGuessing
04Turn up the silly dialThe silly dial
05It only knows what you tell itTelling it
06Can it make things up?Careful!
07What we found outRemember

Running it with a class? Put it on the big screen with P (present mode) and move with ← →. Students can follow along on their own devices.

Everything here is real: a real tokenizer, real training data and real model probabilities, recorded or running in your browser. Nothing students type is sent anywhere.