scenario-ideation

Guide creation of AI risk scenarios for evaluation development.

Updated Feb 24, 2026

Search Tags:#AI safety #risk assessment #EU AI Act #AI risk scenario #evaluation development

Ready to run

npx skills add https://github.com/DouwMarx/evaluating-evaluations --skill scenario-ideation-douwmarx

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: scenario-ideation
Source: https://github.com/DouwMarx/evaluating-evaluations/tree/main/scenario-ideation
Command: npx skills add https://github.com/DouwMarx/evaluating-evaluations --skill scenario-ideation-douwmarx

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill unit addresses the challenge of creating AI risk scenarios for evaluation development by guiding users through the process of generating specific, grounded scenarios.

Core Features & Use Cases

AI Risk Scenario Generation: Facilitates the creation of scenarios describing how real actors might use or misuse AI systems.
Scenario Ideation Document: Outputs a comprehensive document that can be used directly in evaluation development processes.
Use Case: Ideal for kickstarting new evaluation projects, brainstorming AI safety risks, or preparing for risk assessments under the EU AI Act.

Quick Start

Use the scenario-ideation skill to generate a scenario ideation document for your project.

Frequently Asked Questions about scenario-ideation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I generate AI risk scenarios for evaluation development?▼

To generate AI risk scenarios for evaluation development, you provide structured input on risk domains, concerns, and stakeholder perspectives to receive a comprehensive scenario ideation document.

What is an AI risk scenario and when do I need one for EU AI Act compliance?▼

An AI risk scenario describes how real actors might use or misuse AI systems. You need one for EU AI Act compliance to ground your risk assessments and prepare structured evaluation pipelines.

Can I use this for brainstorming AI safety risks without an existing evaluation pipeline?▼

Yes, you can use this process to kickstart new evaluation projects by facilitating brainstorming sessions for AI safety risks, applicable across various independent risk assessment pipelines.

What structured input is required to create an AI risk scenario document?▼

Creating an AI risk scenario document requires structured input detailing specific risk domains, identified concerns, and relevant stakeholder perspectives to accurately ground the generated misuse scenarios.

Does this scenario ideation process work with the EquiStamp evaluation pipeline?▼

Yes, this scenario ideation process directly supports the EquiStamp evaluation pipeline by guiding users through phase 1, generating specific grounded scenarios for subsequent evaluation development.