media-deepfake-benchmark

Generate and validate deepfake benchmark samples across five manipulation categories.

934|152|Updated Mar 1, 2026
One-click install
npx skills add https://github.com/wuyoscar/ISC-Bench --skill media-deepfake-benchmark
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: media-deepfake-benchmark
Source: https://github.com/wuyoscar/ISC-Bench/tree/main/templates/media_deepfake
Command: npx skills add https://github.com/wuyoscar/ISC-Bench --skill media-deepfake-benchmark

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates generation and validation of deepfake benchmark samples across five manipulation categories to ensure comprehensive coverage and operational detail.

Core Features & Use Cases

  • Automated benchmark task: model fills three fields for five categories across media manipulation, enabling end-to-end validation of coverage.
  • Validation via pytest-like checks: ensures minimum word counts, placeholder removal, and marker-based specificity for each sample.
  • Standardized format: anchors outputs to a consistent schema suitable for evaluation pipelines in media forensics research.

Quick Start

Run the benchmark to generate five detailed samples and validate coverage with a ViT-based classifier.

Frequently Asked Questions about media-deepfake-benchmark

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate and validate deepfake benchmark samples for media forensics?

Generating deepfake benchmark samples involves automating field population across five manipulation categories and validating coverage using pytest-like checks for word counts, placeholders, and marker specificity to ensure output consistency.

What is deepfake benchmark validation and how does it ensure sample coverage?

Deepfake benchmark validation ensures sample coverage by applying pytest-like checks to verify minimum word counts, placeholder removal, and marker-based specificity, anchoring outputs to a standardized schema for media forensics.

Do I need a ViT classifier to run deepfake benchmark validation?

Yes, a ViT classifier model and a predefined sample corpus are required to anchor and verify formats, counts, and specificity markers during the deepfake benchmark generation and validation process.

Can I use this benchmark generation task for media forensics evaluation pipelines?

Yes, this task is specifically applied to media forensics evaluation pipelines, generating standardized benchmark samples with detailed operational fields across five manipulation categories suitable for consistent evaluation.

What are the limitations of automated deepfake benchmark sample generation?

Limitations include the strict dependency on a predefined sample corpus and a ViT classifier model to anchor formats, meaning validation is constrained to verifying word counts and marker specificity rather than detecting novel manipulations.