redteam-plugin-development

Standardize and validate promptfoo redteam plugin and grader development workflows.

Updated Apr 14, 2026
One-click install
npx skills add https://github.com/gerald-ica/opencode-config-snapshot --skill redteam-plugin-development-gerald-ica
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: redteam-plugin-development
Source: https://github.com/gerald-ica/opencode-config-snapshot/tree/main/opencode/skills/redteam-plugin-development
Command: npx skills add https://github.com/gerald-ica/opencode-config-snapshot --skill redteam-plugin-development-gerald-ica

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Provides a standardized, auditable approach to creating and maintaining promptfoo redteam plugins and graders, ensuring consistent metadata, safer grading logic, and repeatable development workflows.

Core Features & Use Cases

  • Create or modify promptfoo redteam plugins and graders.
  • Align grader prompts and plugin metadata with promptfoo conventions.
  • Reuse established reference patterns and files to improve safety and maintainability.

Quick Start

Start by implementing your redteam plugin in src/redteam/plugins/, then export it and register its metadata and graders before updating docs.

Frequently Asked Questions about redteam-plugin-development

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a promptfoo redteam plugin that follows standard metadata conventions?

To create a promptfoo redteam plugin, implement the plugin code under src/redteam/plugins/, export it from index files, register metadata and grader entries, and update reference docs under site/docs/red-team/plugins/ for standardized validation.

What is a promptfoo redteam grader and how does it evaluate plugin results?

A promptfoo redteam grader applies standardized grading logic and safe grading conventions to evaluate plugin results, ensuring consistent metadata alignment and repeatable evaluation workflows across projects.

What's the best way to standardize redteam plugin and grader development across multiple projects?

The best way to standardize redteam plugin and grader development is to apply a structured workflow: implement plugins in src/redteam/plugins/, export them, register metadata and graders, and update site/docs/red-team/plugins/ reference docs.

Do I need to update documentation when modifying an existing promptfoo redteam plugin?

Yes, when modifying an existing promptfoo redteam plugin, you must update the reference docs under site/docs/red-team/plugins/ to ensure metadata alignment and maintain safe grading conventions across projects.

Why does my redteam grader prompt need to align with promptfoo conventions?

Redteam grader prompts must align with promptfoo conventions to ensure safer grading logic, consistent metadata validation, and repeatable development workflows across projects.

Can I reuse existing reference patterns when building new redteam plugins and graders?

Yes, you can reuse established reference patterns and files when building new redteam plugins and graders to improve safety, maintainability, and metadata alignment with promptfoo conventions.