ai-security-agent

Tests AI and LLM features for prompt injection, jailbreak, RAG poisoning, and tool call abuse.

2|1|Updated Aug 28, 2026
One-click install
npx skills add https://github.com/lycheer1126/xs-bigdan --skill ai-security-agent-lycheer1126
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-security-agent
Source: https://github.com/lycheer1126/xs-bigdan/tree/main/knowledge/agents/ai_security
Command: npx skills add https://github.com/lycheer1126/xs-bigdan --skill ai-security-agent-lycheer1126

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Applications increasingly embed AI features like chatbots, RAG knowledge bases, and agent tool calling, but traditional web vulnerability testing does not cover their unique attack surfaces such as prompt injection and system prompt extraction. ## Core Features & Use Cases - Attack Surface Mapping: Classifies AI features into chatbot, agent/tool calling, RAG, code sandbox, and model service categories, each with specific attack paths. - Injection & Jailbreak Vectors: Provides direct injection, indirect injection via RAG-indexed content, multi-turn jailbreak sequences, and tool/function call abuse payloads. - Structured Testing Checklist: Covers system prompt extraction, role escape, goal hijacking, permission abuse, context leakage, and adversarial samples. - Use Case: During an authorized security assessment of a target with an AI customer-service chatbot, trigger this phase to attempt system prompt extraction, test whether the bot can be manipulated into abusing its tool calls, and report findings with mitigation recommendations. ## Quick Start Ask the agent to run the AI security testing phase against the authorized target's chatbot feature and report any prompt injection or data leakage findings.

Frequently Asked Questions about ai-security-agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test an LLM chatbot for prompt injection?

Prompt injection testing uses direct vectors like instruction overrides and fake system tags, plus indirect vectors embedded in documents or web content the model ingests. This skill provides both categories along with multi-turn jailbreak sequences and a structured checklist.

What is indirect prompt injection in RAG systems?

Indirect prompt injection hides malicious instructions in data sources that a RAG system indexes, such as uploaded documents, web pages, or emails. When the model retrieves that content, the embedded instructions execute in its context, enabling knowledge base poisoning or data exfiltration.

When should the AI security testing phase be triggered?

Trigger this phase only when the target actually exposes AI or LLM features such as a chatbot, RAG knowledge base, agent with tool calling, or code execution sandbox. It is an optional phase and is skipped for targets without AI functionality.

Can agent tool calling be abused by attackers?

Yes. Tool or function call abuse occurs when crafted prompts make the agent invoke tools with unauthorized parameters, such as sending data to an attacker-controlled address. Testing covers malicious parameter injection and MCP server or skill poisoning scenarios.

What are the limitations of LLM security testing?

Results depend on model behavior which is non-deterministic, so a failed jailbreak attempt does not prove the model is immune. Findings should be reported with reproduction steps and mitigation recommendations rather than treated as exhaustive coverage.