A chatbot like ChatGPT writes its answer one small piece at a time. For each piece it guesses what most likely comes next, using odds it learned from huge amounts of text. Then it adds that piece and guesses again. A whole answer is many guesses in a row.
Try it. Pick the word you think comes next.
Turn on JavaScript to play this bite.
ROUND 1 OF 3
AI guesses the next word. Can you?
I'd like a cup of ___
The bars show the odds: how likely each word is to come next. Common phrases get high odds. They were measured from the AI model named under the bars, on its first guess at the next word. Chat AIs are often very sure, so these puzzles are ones where it was split.
QUIZ
Does the model look words up in a database?
The pieces it guesses are called tokens. They are often whole words, but not always. That is the next bite.