Evaluation, Cost Control, and Observability·Lesson 18 of 24·18 min
Token budgets, caching, batching, and model selection
This lesson is for enrolled learners
Concept Module 1 established that every agent decision is also a cost decision. This lesson turns that principle into concrete techniques for controlling cost and latency once an agent is handling real traffic, not just a handful of test calls. Token budgets set explicit per-request and per-user ceilings — a maximum number of planning-loop steps (from Module 1's step limit),……
Enroll to continue Already enrolled? Sign in