What problem does it solve?
LLM agents built on CoT/ReAct frameworks make decisions from dynamically generated reasoning steps, and attackers can forge intermediate results or skip verification steps to trigger unauthorized actions like refunds or data exports. This Skill provides a structured methodology to identify and test these reasoning-chain weaknesses before attackers exploit them.
Core Features & Use Cases
- Thought-Chain Interference Testing: Forge fake Agent tool-return formats (e.g., Observation blocks) to check whether the model skips real tool calls and trusts fabricated results.
- Thought-Chain Manipulation Testing: Inject instructions claiming approval or emergency mode to bypass verification and approval steps, reaching sensitive operations like refunds or transfers.
- Query Injection Testing: Embed malicious query semantics in natural language input or poison RAG retrieval content so the Agent generates unintended SQL/API queries.
- Use Case: While pentesting a customer-service refund Agent, you forge an order-query result in user input, observe the model skipping the actual order lookup, and confirm it approves a refund based on fabricated data.
Quick Start
Use the cot-injection skill to test whether this ReAct-based refund agent can be tricked into skipping its order verification step.