← Table of Contents · Page 379 of 868
THE SAFETY ARCHITECTURE
Part 4 of 13
SCHEMA-LEVEL TOOL GATING
A schema is a formal description of the shape of something, such as a tool's name, what inputs it accepts, and what values are allowed.
From Part Four you know that the model only knows about the tools the harness describes to it.
Schema-level tool gating means controlling safety by controlling what the model can even ask for.
If a dangerous tool is simply not described to the model for a given task, the model cannot call it in the normal way.
You can also tighten the schema of tools that are available.
For example, a file tool might accept only paths inside one folder, or a database tool might accept only read queries.
This is stronger than a prompt rule because it does not depend on the model choosing to obey.
The harness enforces the limit in code.
Different tasks can get different tool sets.
A summarization task needs no ability to send email, so the email tool is removed from its list.
Advertisement
Read Aloud:
0:00 / 0:00