Concepts

token

A small chunk of text — roughly three-quarters of a word — that ChatGPT uses internally to read and generate language; token limits determine how long a conversation or document can be.

Alternate definitions 2

Definition 2Concepts

A small chunk of text (roughly a word or part of a word) that Gemini uses to measure how much it has read or generated; larger context windows allow more tokens.

Concepts · curriculum materials

Definition 3Concepts

A chunk of text (~¾ of a word) the model reads or writes; context limits are measured in tokens.

Concepts · curriculum materials

Return to all terms