sdlc-evaluate

Evaluate observed product behavior against acceptance criteria and emit normalized failure events.

7|5|Updated Jul 22, 2025
One-click install
npx skills add https://github.com/nebius/nebius-ps-services --skill sdlc-evaluate-nebius
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: sdlc-evaluate
Source: https://github.com/nebius/nebius-ps-services/tree/main/skills/sdlc-evaluate
Command: npx skills add https://github.com/nebius/nebius-ps-services --skill sdlc-evaluate-nebius

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and assets (resource) components.

What problem does it solve? After validation and tests pass, teams still need evidence-based judgment on whether a feature and its end-to-end slice actually meet acceptance criteria, plus deterministic classification of every failed criterion. ## Core Features & Use Cases - Evidence-Based Evaluation: Grades each acceptance criterion as pass, fail, or inconclusive using GUI, TUI, API, service, observability, or manual review routes, with evidence recorded in a structured template. - Bounded Observability: Uses Grafana-backed telemetry only for predefined operational criteria with a complete query-admission record, signal provenance, and strict query budgets. - Normalized Failure Events: Emits an immutable failure-event-v1 per failed criterion via scripts/failure_contract.py, binding expected/observed behavior, evidence digests, commit, and spec fingerprints, then routes to proven-owner or diagnosis-required dispositions. - Use Case: Within an Agentic SDLC run, after tests pass for FEAT-001, evaluate its acceptance criteria against the locked plan, observe the end-to-end slice, and record a classified failure event for any criterion that fails. ## Quick Start Ask the Agentic SDLC coordinator to run sdlc-evaluate for the active feature after validation and tests pass so each acceptance criterion is graded with recorded evidence.

Frequently Asked Questions about sdlc-evaluate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate acceptance criteria in an Agentic SDLC workflow?

Run sdlc-evaluate through the verified SDLC coordinator after validation and tests pass. It selects an evaluation route such as GUI, TUI, API, service, observability, or manual review, records evidence, and marks each criterion pass, fail, or inconclusive.

When does sdlc-evaluate use Grafana observability evidence?

Grafana is used only for predefined runtime operational criteria like release, canary, performance, or reliability. It requires a complete query-admission record, non-Grafana signal provenance, candidate/control attribution, and explicit grading conditions before any readiness or data call.

Can sdlc-evaluate run live experiments in production?

No. Live experiments require a confirmed non-production or disposable environment with recorded allowed actions. Passive production telemetry is read-only evidence and never permission to execute workloads or grade functional behavior.

What happens when an acceptance criterion fails evaluation?

Each failed criterion emits an immutable failure-event-v1 through scripts/failure_contract.py, binding expected and observed behavior, evidence digests, and commit fingerprints. Proven causes route directly to their owner; ambiguous failures enter conditional diagnosis via sdlc-classify-failure.

Why is a criterion marked inconclusive instead of pass or fail?

A criterion is inconclusive when required specifications, attribution, coverage, or signal provenance are missing, typically classified as SPEC_GAP. Underspecified required criteria are never silently passed.