Agent Human-Approval Boundary Failure
Testing whether a human-in-the-loop approval step for high-impact agent actions can be skipped, satisfied superficially, or otherwise defeated.
- Category
- Agentic AI Security
- Difficulty
- Advanced
- Last Updated
- 20 September 2026
Lab detail
Objective
A human-approval step is a common mitigation for destructive or high-impact agent actions — but only if it can’t be routed around, rubber-stamped through misleading framing, or reached via a path that never asks for approval at all. This lab will build a reference agent with an explicit approval gate on a high-impact action and test each of those failure modes.
Planned Scope
- Build a reference agent with one clearly high-impact action gated behind human approval.
- Test alternate paths that reach the same effect without triggering the gate.
- Test whether the approval request’s framing can be manipulated to secure approval for a different action than described.
- Document approval-gate design patterns (scoped confirmation, action-specific detail, non-bypassable routing) that hold up.
Framework Mapping
Referenced frameworks
Exact control-ID mappings are to be validated as this lab progresses — see the full Frameworks reference.
Responsible Use / Safety Notes
How this lab is run
This lab uses synthetic data and controlled environments. It is intended to demonstrate defensive AI-security principles and does not contain customer data, production credentials or intentionally weaponized exploit infrastructure.
A decision is waiting for sign-off. Get an independent view first.
Tell me what is being decided and what is at stake. I will first say honestly whether my experience fits — then we talk about scope, not before.
Or connect on LinkedIn first.