AIVSS01 - Agentic AI Tool Misuse
Agent misuses, is tricked into misusing, or is exposed to compromised external tools/APIs.
Intent & Description
'
🎯 Intent
Prevent agents from being manipulated into abusing their legitimate tool access for malicious purposes.
📋 Context
Agents with tool access can be manipulated to use those tools for data exfiltration, unauthorized modifications, or other harmful actions while appearing to operate normally. This is ranked as the #1 highest-severity risk in the OWASP Agentic AI Core Security Risks.
💡 Solution
Implement strict tool usage policies. Validate tool call parameters. Apply rate limiting on tool invocations. Monitor tool usage patterns. Use allowlists for tool operations. Require confirmation for destructive actions. Vet all external tools and APIs before integration.'
Real-world Use Case
Source
📌 TL;DR
Prevent tool abuse. Validate parameters, rate-limit invocations, monitor usage patterns, confirm destructive actions.
Advantages
- Prevents data exfiltration via tools
- Limits tool abuse surface
- Enables usage auditing
- Supports safe tool integration
Disadvantages
- Restrictive policies may limit functionality
- Parameter validation complexity
- Legitimate edge cases may be blocked