skills.rest
featbit
featbitOFFICIAL
Explore all skills by this author →
Website𝕏@RealFeatBitGitHub

evidence-analysis

Classify experiment outcomes into operational categories from statistical analysis.

1|Updated Mar 16, 2026
Search Tags:#release management#decision analysis#statistical analysis#AB testing#experimental data
One-click install
npx skills add https://github.com/featbit/featbit-release-decision-agent --skill evidence-analysis
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: evidence-analysis
Source: https://github.com/featbit/featbit-release-decision-agent/tree/main/skills/evidence-analysis
Command: npx skills add https://github.com/featbit/featbit-release-decision-agent --skill evidence-analysis

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Analyzes collected data from AB testing or experiments to determine if there is enough evidence to make a definitive decision on the outcome, such as continue, pause, or rollback.

Core Features & Use Cases

  • Data Evaluation: Reads experiment input data and analysis results to assess evidence sufficiency.
  • Decision Framing: Classifies the experiment outcome into categories like CONTINUE, PAUSE, ROLLBACK CANDIDATE, or INCONCLUSIVE based on statistical analysis.
  • Operational Guidance: Provides structured reasoning and next steps, supporting automated decision-making in release workflows.

Quick Start

Use the evidence-analysis skill to evaluate your current experimental results and determine whether to proceed or hold.

Frequently Asked Questions about evidence-analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I decide if AB testing evidence is sufficient for a release decision?▼

To decide if AB testing evidence is sufficient, you analyze collected experimental data to assess evidence strength and interpret statistical results. This classifies outcomes into operational categories like CONTINUE, PAUSE, or ROLLBACK CANDIDATE.

What do statistical analysis categories like CONTINUE or ROLLBACK mean in release management?▼

In release management, statistical analysis categories like CONTINUE or ROLLBACK mean the experimental data has been evaluated and classified. These categories provide structured reasoning and operational guidance for automated deployment workflows.

When should I pause or rollback a deployment based on experimental data?▼

You should pause or rollback a deployment based on experimental data when the statistical analysis classifies the outcome into the PAUSE or ROLLBACK CANDIDATE categories. This indicates the evidence does not support proceeding with the release.

Can I use statistical analysis to automate deployment decisions from experimental data?▼

Yes, you can use statistical analysis to automate deployment decisions from experimental data. The analysis evaluates evidence sufficiency and provides structured next steps, supporting automated decision-making in release workflows.

What should I do if my AB testing results are INCONCLUSIVE?▼

If your AB testing results are INCONCLUSIVE, the evidence is insufficient to make a definitive deployment decision. The statistical analysis classifies this outcome to provide structured reasoning and operational guidance for holding the release.

Related Skills

Explore More Product & Management Skills→
daffy0208daffy0208
34

growth-experimenter

Design and analyze A/B tests for growth metrics optimization.

Community
Intermediate
aimasteraccaimasteracc
46

land-and-deploy

Merge PRs after CI passes and trigger production deployment with canary health checks.

Community
Advanced
cody-hutsoncody-hutson

release-hub

Orchestrate release pipelines by assessing milestone readiness and sequencing stages.

Community
Advanced
galeepgaleep

scientific-critical-thinking

Evaluate research methodology, biases, statistical analysis, and evidence quality.

Community
Advanced