regression-performance

Compare benchmark latency, throughput, and memory across software versions with statistical significance testing.

175|26|Updated Aug 14, 2025
One-click install
npx skills add https://github.com/jmagly/aiwg --skill regression-performance-jmagly
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: regression-performance
Source: https://github.com/jmagly/aiwg/tree/main/plugins/sdlc/skills/regression-performance
Command: npx skills add https://github.com/jmagly/aiwg --skill regression-performance-jmagly

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill automatically detects performance regressions in software by comparing benchmarks across different versions, ensuring that updates don't introduce slowdowns or resource inefficiencies.

Core Features & Use Cases

  • Automated Benchmark Comparison: Compares latency, throughput, and memory usage between baseline and current versions.
  • Statistical Significance Testing: Applies statistical methods to confirm if observed changes are real regressions or just noise.
  • Use Case: Before merging a new feature branch, use this Skill to automatically run load tests and verify that the changes haven't negatively impacted the application's response time or resource consumption.

Quick Start

Use the regression-performance skill to compare the performance of the current branch against the main branch.

Frequently Asked Questions about regression-performance

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I detect performance regressions before merging a new branch?

Performance regressions are detected by comparing benchmark metrics like latency, throughput, and memory usage between a baseline and the current branch. This Skill automates that comparison and applies statistical significance testing to verify changes.

What is the best way to automate load testing and benchmark comparison across software versions?

Automating load testing across software versions is achieved by running tools like k6 and Artillery to generate metrics, then comparing baseline and current benchmarks. The process yields detailed reports identifying root causes of degradation.

How does statistical significance testing work for performance benchmarking?

Statistical significance testing for performance benchmarking confirms whether observed latency or throughput changes are actual regressions or just noise. It compares baseline and current metrics to validate that software updates cause real performance degradation.

Can I use k6 and Artillery to analyze memory degradation and latency in my application?

Yes, k6 and Artillery are used to execute load tests that measure application latency and throughput. The resulting metrics are compared across versions to identify memory degradation and generate actionable performance reports.

Why does my software update introduce memory leaks and response time slowdowns?

Updates introduce memory leaks and response time slowdowns when code changes degrade resource consumption or latency. Comparing baseline and current benchmarks with statistical testing isolates these regressions and identifies root causes.

What are the limitations of using automated benchmarking to detect throughput degradation?

Automated benchmarking for throughput degradation relies on consistent load testing environments and baseline data. Without accurate baseline metrics or controlled test execution, statistical significance results may not reliably identify real regressions versus environmental noise.