skills.rest
swarm-ai-safety
swarm-ai-safetyOFFICIAL
Explore all skills by this author →
GitHub

regression-check

Re-run pytest suites and compare performance metrics against historical baselines.

39|4|Updated Feb 3, 2026
Search Tags:#testing#devops#ci/cd#metrics#regression#baseline
One-click install
npx skills add https://github.com/swarm-ai-safety/swarm --skill regression-check-swarm-ai-safety
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: regression-check
Source: https://github.com/swarm-ai-safety/swarm/tree/main/.skills/regression-check
Command: npx skills add https://github.com/swarm-ai-safety/swarm --skill regression-check-swarm-ai-safety

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automatically detects regressions in your codebase by running tests and comparing key performance metrics against a known-good baseline.

Core Features & Use Cases

  • Automated Testing: Executes the full pytest suite to catch functional bugs.
  • Metric Drift Detection: Compares critical metrics (welfare, toxicity, etc.) from a baseline scenario run against historical data.
  • Behavioral Change Analysis: Flags significant deviations in metrics, indicating potential emergent issues or unintended consequences of code changes.
  • Use Case: Before merging a new feature, run this Skill to ensure it hasn't broken existing functionality or negatively impacted system performance metrics.

Quick Start

Run the regression check skill with the 'full' argument to execute tests and compare the baseline.

Frequently Asked Questions about regression-check

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I detect metric drift in a pytest baseline run?▼

To detect metric drift in a pytest baseline run, you can re-run the test suite and compare key performance metrics against the last known-good historical data to flag significant deviations.

What is regression detection in multi-agent systems?▼

Regression detection in multi-agent systems involves running tests and comparing baseline metrics to identify behavioral changes, metric drift, or unintended consequences caused by recent code modifications.

Do I need pytest and historical baseline data to check for test regressions?▼

Yes, you need pytest, swarm, and access to historical baseline run data to successfully execute tests and compare current metrics against previous known-good performance results.

How do I compare performance metrics against a known-good baseline before merging?▼

Run a regression check with the 'full' argument to execute the pytest suite and compare critical metrics like welfare and toxicity against historical baseline data before merging new features.

What is the best way to automate behavioral change analysis in CI/CD pipelines?▼

Automating behavioral change analysis in CI/CD pipelines requires re-running baseline test suites to flag metric drift and test failures, ensuring new code does not negatively impact existing functionality.

Why does my multi-agent system show metric drift after code changes?▼

Metric drift after code changes occurs when new modifications introduce significant deviations in critical metrics, indicating potential emergent issues or unintended consequences affecting system behavior.

Related Skills

Explore More Software Engineering Skills→
lucas-flatwhitelucas-flatwhite
43

benchmark

Automates web performance audits to detect regressions via page timing metrics.

Community
Advanced
aziglerazigler
8

/fix — Fix-and-guard

Fix identified bugs with mandatory regression guard tests.

Community
Advanced
manastalukdarmanastalukdar
1

canary

Poll logs, error rates, and endpoints to verify post-deployment health.

Community
Advanced
cloudofgeorgecloudofgeorge

canary

Monitors deployed apps for errors, performance regressions, and page failures via screenshots and baselines.

Community
Advanced