Glossary
Batch API
A way to submit many requests to be processed asynchronously, usually within hours, at about half price.
Offered by OpenAI, Anthropic and Google. Ideal for backfills, evaluations and nightly jobs.
Related terms
GPUInferenceMixture of experts (MoE)Token
Get the brief in your inbox
One email every morning: the stories that mattered in AI, each with a one-line "why it matters" for your role. Free, no ads, unsubscribe any time.
Published daily by AI Briefing. We never share your address.