What problem does it solve?
This Skill provides comprehensive security testing for LLM/AI applications, detecting vulnerabilities like prompt injection, jailbreaking, data memorization, and RAG poisoning.
Core Features & Use Cases
- Prompt Injection Detection: Identify and mitigate the risk of system instructions being overridden.
- System Prompt Leakage Detection: Prevent unauthorized access to system prompts containing confidential information.
- Training Data Memorization Check: Detect if the model regurgitates sensitive training data.
- RAG Pipeline Security: Identify and address RAG poisoning vectors and embedding weaknesses.
- Agent Hijacking Detection: Ensure AI agents cannot be used for unintended actions.
- Insecure Output Handling: Prevent XSS and injection vulnerabilities in LLM output.
- Model Extraction Check: Detect model extraction risk via API querying patterns.
- Sensitive Information Disclosure: Identify any unauthorized exposure of sensitive data.
- Use Case: For instance, use this Skill to test a chatbot for potential security vulnerabilities and ensure compliance with security best practices.
Quick Start
Run the llm-security skill to test the AI chatbot for prompt injection vulnerabilities.