AI guesses the next word

A chatbot like ChatGPT writes its answer one small piece at a time. For each piece it asks one question: what most likely comes next?

Try it. Pick the word you think comes next.

Turn on JavaScript to play this bite.

The bars show the odds: how likely each word is to come next. The model learned odds like these from huge amounts of text, so common phrases get high odds. These numbers are made up to show the idea.

Then it adds the word it picked and asks again, for the next piece, and the next. A whole answer is many guesses in a row.

The pieces it guesses are called tokens. They are often whole words, but not always. That is the next bite.