← Table of Contents · Page 376 of 868
THE SAFETY ARCHITECTURE
Part 1 of 13
LEARNING GOALS
By the end of this chapter you will be able to explain defense in depth, describe prompt-level guardrails, explain schema-level tool gating and dual-agent separation, understand runtime approval systems with persistent permissions, and describe tool-level validation and user-defined lifecycle hooks.
WHY NO SINGLE SAFEGUARD IS ENOUGH
Imagine protecting a bank.
The bank does not rely on a single front door lock.
It has a locked door, cameras, an alarm, a guard, a vault with its own lock, and procedures that require two people to open the vault.
If a thief defeats one protection, others still stand in the way.
Safety for AI agents works the same way.
Language models are not perfectly predictable.
A model may sometimes ignore an instruction, misread a situation, or be tricked by clever wording.
So a safe system cannot depend on the model always behaving well.
Advertisement
Read Aloud:
0:00 / 0:00