running-multiturn-attack-suite

Evaluate multi-turn attack suites against stateful LLM applications.

2|Updated May 23, 2026
One-click install
npx skills add https://github.com/rocklambros/rcs --skill running-multiturn-attack-suite
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: running-multiturn-attack-suite
Source: https://github.com/rocklambros/rcs/tree/main/skills/security/running-multiturn-attack-suite
Command: npx skills add https://github.com/rocklambros/rcs --skill running-multiturn-attack-suite

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill helps teams evaluate whether a stateful LLM application can be manipulated across multiple turns when a single prompt is not enough to trigger the behavior under test. It turns multi-turn red-team ideas into a disciplined, reproducible workflow with clear pass, block, partial, and inconclusive outcomes.

Core Features & Use Cases

  • Turn-by-turn orchestration: Runs scripted conversations in order, including branching logic, state capture, and stop conditions.
  • State-aware evaluation: Tracks observable signals such as returned text, tool calls, retrieval citations, persona drift, and summarization events.
  • Outcome classification: Separates per-turn progress from per-script results and records the landing turn when an attack succeeds.
  • Use cases: Assess chatbots with memory, agentic systems with persistent state, retrieval-backed assistants, and long-context apps where summarization or context overflow may change safety behavior.

Quick Start

Use the running-multiturn-attack-suite skill to analyze a signed engagement against a stateful chatbot with a multi-turn script corpus, per-script isolation, and observable state snapshots.

Frequently Asked Questions about running-multiturn-attack-suite

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate multi-turn attacks against stateful LLM applications?

To evaluate multi-turn attacks against stateful LLM applications, you can use a structured red-teaming workflow that orchestrates scripted conversations, captures observable state snapshots, and classifies per-turn progress alongside per-script outcomes like pass, block, partial, or inconclusive.

What is multi-turn state poisoning in conversational agents?

Multi-turn state poisoning in conversational agents is an attack vector where manipulated inputs across sequential turns alter the model's internal state, causing role drift or unsafe behaviors that a single isolated prompt would not trigger.

Can I test chatbots with memory for context overflow vulnerabilities?

Yes, you can test chatbots with memory for context overflow vulnerabilities by running scripted multi-turn attack suites that track summarization events and observable state changes to verify if long-context sessions alter safety behavior.

How do I isolate test sessions when red teaming retrieval-augmented systems?

To isolate test sessions when red teaming retrieval-augmented systems, apply per-script session isolation verification and validate rules of engagement before executing scripted conversations to ensure reproducible outcomes.

Why does my LLM application pass single prompt attacks but fail multi-turn scripts?

An LLM application may pass single prompt attacks but fail multi-turn scripts because stateful memory, persona drift, or context summarization across sequential turns can change safety behavior and create exploitable vulnerabilities.

What is a landing turn in multi-turn attack classification?

A landing turn in multi-turn attack classification is the specific conversation turn where an attack successfully achieves its objective, tracked separately from per-turn progress to provide rigorous per-script outcome analysis.