Glossary
Inference
Also: inference · вывод модели
Using an already trained model: a prompt in, a response out. Inference is billed by tokens and drives an agent's latency and cost.
Example
Every step of the agentic loop is a separate inference, which is why an agent spends many times more tokens than one chat request.