Glossary
Attention
The mechanism that lets a transformer weigh which earlier tokens matter when producing the next one.
Attention cost grows with sequence length, which is why very long context windows are expensive and were slow to arrive.
Related terms
Context windowModel Context Protocol (MCP)PromptTokenTransformer
Get the brief in your inbox
One email every morning: the stories that mattered in AI, each with a one-line "why it matters" for your role. Free, no ads, unsubscribe any time.
Published daily by AI Briefing. We never share your address.