← Table of Contents · Page 266 of 868

BUDGETS AND RESOURCE LIMITS

Part 9 of 9

KEY TERMS REVIEW Budget: a limit on how much of a resource a run may use. Token: a small chunk of text a model reads or writes. Workspace: a shared area in which several agents run. Graceful termination: stopping in a planned, tidy way. Runaway loop: a loop whose stopping condition is never reached. Exponential backoff: waiting longer after each failed attempt. Jitter: a small random addition to a wait time. CHECK YOUR UNDERSTANDING • Why should the harness, not the model, enforce budgets? ◦ Answer: A confused model cannot be trusted to stop itself, while harness code always applies the limit. • Why track both per-agent and per-workspace budgets? ◦ Answer: The personal meter limits one agent, and the shared meter protects the whole team if several agents overspend. • Why hold back a reserve when setting a token budget? ◦ Answer: Without a reserve there would be nothing left to write the shutdown report. • What does exponential backoff do? ◦ Answer: It waits longer after each failure so a struggling service is not overloaded. • What should an agent do after its retry limit is reached? ◦ Answer: It should change its approach or stop, not repeat the same failing call.
Advertisement
Read Aloud:
0:00 / 0:00