data-leakage-detection

Detect sensitive information disclosure in AI models through escalating dialogue probes.

4.4k|438|Updated Dec 25, 2024
One-click install
npx skills add https://github.com/Tencent/AI-Infra-Guard --skill data-leakage-detection
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-leakage-detection
Source: https://github.com/Tencent/AI-Infra-Guard/tree/main/agent-scan/prompt/skills/data-leakage-detection
Command: npx skills add https://github.com/Tencent/AI-Infra-Guard --skill data-leakage-detection

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill proactively identifies and prevents the accidental or malicious disclosure of sensitive information by AI models, safeguarding confidential data.

Core Features & Use Cases

  • System Prompt Extraction Detection: Checks if the AI's core instructions are being revealed.
  • Credential & PII Leakage Detection: Probes for exposed API keys, passwords, personal identifiable information, and internal configurations.
  • Escalating Probes: Employs a multi-phase approach, starting with direct questions and progressing to more sophisticated evasion techniques if necessary.
  • Use Case: Ensure your AI chatbot does not inadvertently reveal internal API endpoints or customer PII during conversations.

Quick Start

Use the data-leakage-detection skill to check for any system prompt disclosure.

Frequently Asked Questions about data-leakage-detection

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I prevent system prompt extraction in my AI chatbot?

Prevent system prompt extraction by using escalating dialogue probes to detect vulnerabilities. This skill tests your AI model with direct questions and evasion techniques to identify if core instructions are being revealed.

How can I test my AI model for API key and credential leakage?

Test for API key and credential leakage by probing the AI model with escalating dialogue techniques. This process identifies exposed passwords, personal identifiable information, and internal configurations during conversations.

What is data leakage detection in AI safety and red teaming?

Data leakage detection in AI safety identifies and prevents the accidental or malicious disclosure of sensitive information by AI models. It uses red teaming techniques to safeguard confidential data through escalating dialogue probes.

How do I use evasion techniques to check for PII disclosure in AI?

Check for PII disclosure by applying multi-phase escalating probes that start with direct questions and progress to sophisticated evasion techniques. This identifies vulnerabilities where the AI inadvertently reveals personal identifiable information.

Does this data leakage detection method work against jailbreak attempts?

Yes, this data leakage detection method works against jailbreak attempts by utilizing escalating dialogue probes. It specifically targets and identifies vulnerabilities caused by sophisticated evasion techniques and prompt injection.