How a chatbot writes
A chatbot reads one long line of numbers and guesses the next one. Chats, stories, homework help: it all comes from that one idea. Let’s take it apart.
The journey · about 50 minutes
- 01Your words become numbersTokens
- 02One token at a timePrediction
- 03What did it read?Training data
- 04How does it learn?Learning
- 05A chat is one long tapeConversation
- 06The words you don’t seeHidden context
- 07When it doesn’t knowMaking things up
- 08Better words in, better guesses outTakeaways
Running it with a class? Put it on the big screen with P (present mode) and move with ← →. Students can follow along on their own devices.
Everything here is real: a real tokenizer, real training data and real model probabilities, recorded or running in your browser. Nothing students type is sent anywhere.