performance-regression-detection

Detect performance regressions against baseline metrics above a 10% threshold.

2|Updated Sep 30, 2025
One-click install
npx skills add https://github.com/krzemienski/shannon-framework --skill performance-regression-detection
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: performance-regression-detection
Source: https://github.com/krzemienski/shannon-framework/tree/main/skills/performance-regression-detection
Command: npx skills add https://github.com/krzemienski/shannon-framework --skill performance-regression-detection

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Establish baseline performance, detect regressions beyond a threshold, and analyze trends over time.

Core Features & Use Cases

  • Baseline establishment and continuous monitoring
  • Regression scoring and alerting
  • Trend analysis with Serena integration

Quick Start

Start monitoring performance regressions: /shannon:performance-regression-detection

Frequently Asked Questions about performance-regression-detection

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I detect performance regressions in my application?

Performance regression detection identifies when your application slows down beyond a 10% threshold by comparing current metrics against established baselines. It calculates a regression score from 0.00 to 1.00, tracks mean, standard deviation, min, and max statistics for each component, and requires at least 10 baseline iterations to establish reliable comparison points.

What's the best way to set up baseline performance metrics for monitoring?

Establish baselines by running your performance benchmarks at least 10 times to capture statistical variance. The Skill records mean, standard deviation, min, and max values for each component, creating a foundation for continuous monitoring and regression detection across future test runs.

Can I use performance regression detection with continuous integration?

Yes, performance regression detection integrates with Serena for alerts and trend visualization, enabling continuous performance monitoring across branches and builds. This allows you to catch regressions early in your CI/CD pipeline and validate whether performance fixes actually resolve identified slowdowns.

How does regression scoring work for identifying slow components?

Regression scoring generates a normalized score from 0.00 to 1.00 that quantifies how far current performance deviates from baseline. Scores above the 10% threshold flag components as regressed, helping you prioritize which slow components to optimize and track whether fixes improve performance.

What statistics does performance monitoring track for each component?

The Skill records mean, standard deviation, minimum, and maximum metrics for each component across baseline and monitoring runs. These statistics enable statistical trend analysis and help distinguish genuine regressions from normal performance variation.

When should I use performance regression detection versus one-off benchmarking?

Use regression detection for continuous performance health monitoring, trend analysis over time, and automated alerting when performance degrades. One-off benchmarks capture a single snapshot; regression detection establishes baselines and flags anomalies systematically across development cycles.