← Table of Contents · Page 259 of 868

BUDGETS AND RESOURCE LIMITS

Part 2 of 9

MONEY BUDGETS A money budget is a cap on the cost of a run, measured in a currency such as dollars. Model providers charge by the token, and tools may charge by the call, so the harness converts usage into money using a price table. A money budget is the one the finance department cares about most. USING ALL THREE TOGETHER The three budgets guard against different problems. A run might use few tokens but wait a very long time for a slow tool, which only a time budget catches. A run might be fast but call an expensive tool again and again, which only a money budget catches. Most harnesses therefore track all three and stop the run when any one is used up.
Advertisement
Read Aloud:
0:00 / 0:00