Shah AI Security Lab / Labs

ASL-025Planned

Agent Human-Approval Boundary Failure

Testing whether a human-in-the-loop approval step for high-impact agent actions can be skipped, satisfied superficially, or otherwise defeated.

Category
Agentic AI Security
Difficulty
Advanced
Last Updated
20 September 2026
  • agentic-ai
  • human-approval
  • high-impact-actions

Lab detail

Objective

A human-approval step is a common mitigation for destructive or high-impact agent actions — but only if it can’t be routed around, rubber-stamped through misleading framing, or reached via a path that never asks for approval at all. This lab will build a reference agent with an explicit approval gate on a high-impact action and test each of those failure modes.

Planned Scope

  • Build a reference agent with one clearly high-impact action gated behind human approval.
  • Test alternate paths that reach the same effect without triggering the gate.
  • Test whether the approval request’s framing can be manipulated to secure approval for a different action than described.
  • Document approval-gate design patterns (scoped confirmation, action-specific detail, non-bypassable routing) that hold up.

Framework Mapping

Referenced frameworks

Exact control-ID mappings are to be validated as this lab progresses — see the full Frameworks reference.

  • OWASP Top 10 for Agentic Applications

Responsible Use / Safety Notes

How this lab is run

This lab uses synthetic data and controlled environments. It is intended to demonstrate defensive AI-security principles and does not contain customer data, production credentials or intentionally weaponized exploit infrastructure.

A decision is waiting for sign-off. Get an independent view first.

Tell me what is being decided and what is at stake. I will first say honestly whether my experience fits — then we talk about scope, not before.

Or connect on LinkedIn first.