llm-security

Identify and remediate security vulnerabilities in LLM-based applications.

1|Updated Mar 27, 2026
One-click install
npx skills add https://github.com/devkeni/Skills --skill llm-security-devkeni
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: llm-security
Source: https://github.com/devkeni/Skills/tree/main/security/ai-security-arsenal/skills/llm-security
Command: npx skills add https://github.com/devkeni/Skills --skill llm-security-devkeni

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

LLMs and AI applications often harbor unseen security vulnerabilities, including prompt injections, jailbreaking attempts, and guardrail gaps. This skill provides a structured approach to identify, document, and remediate those weaknesses in realistic AI workflows.

Core Features & Use Cases

  • Direct Prompt Injection Testing: Validate guardrails by trying to override system prompts and induce unsafe behavior.
  • Jailbreak and Control-Flow Analysis: Assess resilience against role-switching and instruction manipulation tactics.
  • RAG Pipeline Security: Evaluate retrieval augmented generation architectures for data leakage and prompt leakage risks.
  • Threat Illustration & Remediation: Produce concrete findings and mitigation steps for engineering teams.

Quick Start

Run a security assessment on your AI application by executing a prompt-injection suite and recording outcomes for remediation.

Frequently Asked Questions about llm-security

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test for prompt injection vulnerabilities in my LLM application?

Test prompt injection vulnerabilities by executing a structured security suite that attempts to override system prompts and induce unsafe behavior. This skill evaluates prompts, records outcomes, and documents findings with actionable mitigations for engineering teams.

What is RAG pipeline security and how does it prevent data leakage?

RAG pipeline security evaluates retrieval augmented generation architectures to identify data leakage and prompt leakage risks. It assesses how retrieved context interacts with system prompts to expose sensitive information, producing concrete findings and mitigation steps.

Does this approach work for testing AI agents and automated workflows?

Yes, this approach applies to security testing across AI agents and workflows. It assesses resilience against jailbreaking, control-flow manipulation, and guardrail bypass attempts within realistic AI application workflows.

Can I analyze system prompt leakage without exposing production data?

You can analyze system prompt leakage by evaluating prompts and analyzing system prompts in isolated testing scenarios. The skill documents findings with actionable mitigations without requiring exposure of live production data.

What is the best way to assess guardrail bypass attempts in LLM systems?

The best way to assess guardrail bypass attempts is through direct prompt injection testing and jailbreak analysis. This validates guardrails by testing role-switching and instruction manipulation tactics, yielding documented remediation steps.

Why does my LLM workflow remain vulnerable to jailbreaking despite having guardrails?

Your LLM workflow may remain vulnerable to jailbreaking due to control-flow weaknesses and insufficient guardrail coverage. Conducting a jailbreak and control-flow analysis identifies resilience gaps against role-switching and instruction manipulation tactics.