hunt-rag-vector

Validates tenant and ACL isolation in RAG pipelines and vector stores.

10|3|Updated Aug 10, 2026
One-click install
npx skills add https://github.com/baiqigo/baiqi-redteam-lab --skill hunt-rag-vector-baiqigo
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: hunt-rag-vector
Source: https://github.com/baiqigo/baiqi-redteam-lab/tree/main/.agents/skills/hunt-rag-vector
Command: npx skills add https://github.com/baiqigo/baiqi-redteam-lab --skill hunt-rag-vector-baiqigo

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? RAG pipelines and vector databases can leak documents across tenants when chunking, indexing, or retrieval ignores ACL boundaries. This Skill provides a controlled methodology to verify that document ingestion, embedding, retrieval, and deletion respect tenant isolation before real data is at risk. ## Core Features & Use Cases - Cross-Tenant Isolation Testing: Uploads distinct canary documents to separate tenants and checks whether retrieval results, source metadata, or citations leak across boundaries. - Deletion and ACL Residual Checks: Verifies that deleted or permission-revoked documents no longer appear in retrieval results, using backend records and retrieval evidence as oracles. - Evidence-Gated Workflow: Enforces a baseline → single-variable probe → post-baseline → oracle → evidence loop, treating WAF blocks, timeouts, and model hallucinations as inconclusive rather than findings. - Use Case: A security researcher authorized to test a knowledge-base chatbot uploads canary documents under two test tenants, then confirms Tenant B never receives Tenant A's content in similarity search results. ## Quick Start Ask the agent to run the RAG vector isolation assessment against my two authorized test tenants and report any cross-tenant retrieval leaks with evidence.

Frequently Asked Questions about hunt-rag-vector

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test RAG pipeline tenant isolation?

Upload distinct harmless canary documents to two separate test tenants, then run predetermined queries in independent sessions for each tenant. Compare retrieval results, source metadata, and citation links to detect any cross-tenant leakage.

How to verify vector store deletion actually removes embeddings?

Delete or revoke ACLs on a canary document, wait for index completion using a status oracle, then re-run retrieval queries. If the deleted content still appears in results with backend record support, the deletion is incomplete.

What counts as valid evidence of a RAG data leak?

Valid evidence requires Tenant B stably receiving Tenant A's canary content or metadata, supported by retrieval citations and backend records. Model hallucination, coincidental keyword matches, and UI caching do not qualify.

Can I test RAG poisoning on a shared knowledge base?

No. Poisoning experiments are only permitted in your own isolated collection where no other user or tenant consumes the documents. Shared production corpora and real customer documents are explicit stop conditions.

What are the limitations of vector isolation testing?

Testing requires at least two owned tenants, unique canary documents, deletable indexes, and an index-completion oracle. WAF blocks, captchas, timeouts, and single anomalies are treated as inconclusive rather than findings.