Secure AI Atlas mark Secure AI Atlas SECURITY & GOVERNANCE

Risk

Insecure Tool Invocation

AI systems call tools or APIs without sufficient validation, authorization, rate limits, or operational safeguards.

toolsagentsAPI security
Domain
Tooling
Agent
Mechanism
Authorization
Injection
Boundary
Between the agent and its connected tools and APIs
Trigger
The agent calls a tool or API without validation, authorization or limits
Consequence
Tools execute under insufficient safeguards
Required evidence
  • Tool allowlist and authorization decisions
  • Rate and volume limits
  • Invocation and outcome logs

Exposure

Insecure Tool Invocation occurs when model output can trigger functions, APIs, plugins, workflows, or automation tools in unsafe ways. The model may select the tool, construct arguments, interpret results, and continue acting on the new context.

Tool access turns language into system behavior. That transition is where ATLAS watches for missing authorization.

Signals

  • Tool arguments are accepted because the model produced them.
  • Authorization is described in prompts but not enforced by the tool or API.
  • Tool calls can change records, send messages, move money, deploy code, or change access without a separate check.
  • Failures are hard to reconstruct because tool calls and outcomes are not logged.

Failure pattern

The application trusts the model as if it were an authenticated operator. Prompt Injection, ambiguous user intent, or incomplete context can then produce real changes in connected systems.

  • Validate tool inputs with strict schemas.
  • Enforce authorization at the tool layer.
  • Rate-limit and isolate sensitive operations.
  • Require approval for high-impact actions.
  • Record tool calls, arguments, responses, errors, and approval decisions.

Provenance

SOURCE
MAPPED
Not recorded
ANALYZED
Not recorded
UNRESOLVED
Not recorded

Last reviewed: Sep 20, 2026