HomeBriefFor youTrackersTopicsCompaniesGlossaryNewsletterSecurityHealth & medicineFinance & marketsRoboticsModels & researchPolicy & regulationEnterprise & businessDeveloper tools
Glossary

Token

The unit models read and write; roughly three-quarters of an English word. Pricing and context limits are counted in tokens.

A token is a chunk of text produced by the model's tokenizer: common words are one token, rare words or code split into several. A million tokens is about 750,000 words of English. Different models tokenise the same text into different counts, so compare cost per task rather than per token.

Related terms

Context windowModel Context Protocol (MCP)PromptWeights

← All terms

Get the brief in your inbox

One email every morning: the stories that mattered in AI, each with a one-line "why it matters" for your role. Free, no ads, unsubscribe any time.

Published daily by AI Briefing. We never share your address.
Like this? Get tomorrow's brief by email, free.