experiment

Plan, execute, and log auditable quest experiments with PLAN.md and CHECKLIST.md.

3.3k|331|Updated Sep 26, 2025
One-click install
npx skills add https://github.com/ResearAI/DeepScientist --skill experiment-researai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: experiment
Source: https://github.com/ResearAI/DeepScientist/tree/main/src/skills/experiment
Command: npx skills add https://github.com/ResearAI/DeepScientist --skill experiment-researai

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This skill provides a structured workflow to plan, execute, and record auditable quest experiments from idea selection to durable main runs, ensuring repeatability and governance.

Core Features & Use Cases

  • Plan the run contract using PLAN.md and CHECKLIST.md to formalize intent, constraints, and acceptance criteria.
  • Execute bounded pilots, smoke tests, and main runs with traceable logs, artifacts, and decision points for reliable progress.
  • Use the references templates (evidence ladder, plan and checklist templates) to guide planning, evaluation, and documentation.

Quick Start

Define the run contract in PLAN.md and start a bounded pilot against the active idea workspace.

Frequently Asked Questions about experiment

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I plan and execute auditable experiments with traceable logs?

You plan auditable experiments by defining a run contract in PLAN.md and CHECKLIST.md to formalize intent, constraints, and acceptance criteria. Execution applies bounded pilots, smoke tests, and main runs with traceable logs and artifact logging for transparent decision-making.

What is a run contract and when do I need it for experiment traceability?

A run contract formalizes experiment intent, constraints, and acceptance criteria before execution. You need it to ensure experiment traceability and repeatability, serving as the baseline document governing bounded pilots and durable main runs.

How do I document experiment baselines and ensure reproducibility?

Document experiment baselines using PLAN.md and CHECKLIST.md alongside reference templates like the evidence ladder. This ensures reproducibility by applying artifact logging and traceable decision points across smoke tests and main runs.

Can I use checklist templates and evidence ladders for experiment evaluation?

Yes, you can use reference templates including the evidence ladder, plan, and checklist templates to guide experiment evaluation. These templates support transparent decision-making by formalizing acceptance criteria and documenting progress through bounded pilots and main runs.

What is the best way to structure smoke tests and bounded pilots before main runs?

The best way to structure smoke tests and bounded pilots is by defining a run contract in PLAN.md first, then executing bounded tests against the active idea workspace. This approach applies artifact logging and traceable decision points to validate before durable main runs.

Do I need a specific environment setup to start an experiment workflow?

You need an active idea workspace to define the run contract and start a bounded pilot. No specific external dependencies are required, as the workflow uses standard documentation formats like PLAN.md and CHECKLIST.md to orchestrate auditable experiments.