Tool Governance
Policy between intent and action
Governance decides which tools exist, who may invoke them, and with what limits — permission model, approval flow for writes, rate caps, and audit. It's the policy layer between model intent and real systems.
What you will learn
- Model tools with read/write permissions
- Add approval gates for destructive actions
- Audit tool use for compliance and eval
What is this?
Tool governance is the policy layer: every tool declares a permission class (read vs write vs admin); users and sessions hold roles; writes go through approval (human) or policy (max amounts, allowlists); rate limits and budgets cap spend; and every call is audited. The model proposes — governance disposes.
Why do you need it?
- Trust is earned in explicit checks, not model judgment.
- Approvals convert autonomy into controlled delegation.
- Rate/budget caps make tools financially and operationally bounded.
- Audit logs train evals, answer disputes, and satisfy compliance.
Mental model
Signing authority on company accounts
Tool governance
Anyone can check balances (read tools); only managers sign transfers (write approval); the board sets limits (caps); controllers audit every signature (logs). The strength isn't in how well the machine asks — it's that approval and limits exist at every level.
How it works
- Classify each tool: read / write / admin.
- Map roles ↔ tools, scoped by tenant/user.
- Route destructive or costly calls through an approval step.
- Enforce per-call, per-session rate + budget caps.
- Log identity, args, decision, result for every call.
Governance layers.
In production
- Enterprise copilots distinguish read-only assistants from write-enabled ones.
- Fintech tools put send-payment behind confirmation + limits.
- Admin surfaces require explicit permission elevation per session.
Best practices
- Default deny; grant tool access explicitly.
- Keep write tools behind approval or human confirmation.
- Enforce per-session budgets, not just per-call.
- Make every decision loggable and evaluable.
Common mistakes
- One 'super-tool' that writes everything.
- Approval by 'trust the model this time' with no caps.
- Audit logs nobody reads and evals never use.
Common issues
A write slipped through governanceTool misclassified as read
Audit classification; default-deny new tools until reviewed.
Users blocked from legit actionsRights mapping too coarse
Refine scopes (per-tenant, per-resource) and document.
Debugging tips
- Over-blocking → check role mapping; users need scoped upgrades.
- Approval latency hurts UX → batch writes or pre-approve recurring ones.
- Caps hit repeatedly → budget too tight vs task; analyze norms.
Interview checkpoint
Hands-on lab
- Model tools with allowed scopes
- Gate dispatch on a policy check
- Keep an audit trail of denied calls
Tool Access Policies
25 min · intermediate
Quick quiz
The governance default should be…
Write tools can ride on model judgment alone.