allcll-graduation-qa

Cluster graduation QA reports and classify root causes against the wiki.

26|1|Updated Jan 8, 2025
One-click install
npx skills add https://github.com/allcll/allcll-backend --skill allcll-graduation-qa
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: allcll-graduation-qa
Source: https://github.com/allcll/allcll-backend/tree/main/.agents/skills/graduation-qa
Command: npx skills add https://github.com/allcll/allcll-backend --skill allcll-graduation-qa

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps diagnose and resolve user-reported graduation requirement QA issues by grouping similar reports, verifying expected behavior against the graduation wiki, and separating data drift from code defects or conflicting rules.

Core Features & Use Cases

  • Issue clustering: Groups repeated QA reports by underlying cause so related failures can be handled together.
  • Ground-truth verification: Confirms the intended behavior using the graduation-llm-wiki as the reference source.
  • Root-cause classification: Distinguishes sheet/data drift, code bugs, and rule inconsistencies before proposing a fix.
  • Regression validation: Requires fixture-based tests for reported student cases and wiki citations in pull requests.
  • Use Case: A student claims a specific graduation requirement is being judged incorrectly; this Skill traces the report to the source, verifies the expected outcome, and recommends the corrective action.

Quick Start

Analyze this graduation QA report, cluster it with related cases, verify the correct behavior against the wiki, and return the root cause with the needed regression test.

Frequently Asked Questions about allcll-graduation-qa

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find the root cause of incorrect graduation requirement evaluations?

To find the root cause of incorrect graduation evaluations, you can analyze QA reports by clustering similar cases, verifying expected behavior against the graduation wiki, and distinguishing data drift from code defects or rule conflicts.

How do I cluster similar graduation QA bug reports for triage?

Cluster graduation QA bug reports by grouping repeated user-reported issues and false positives by their underlying cause, allowing related failures to be handled together during the triage process.

How do I verify if a disputed graduation judgment is a false positive?

Verify a disputed graduation judgment as a false positive by confirming the intended student evaluation behavior using the graduation-llm-wiki as the ground-truth reference source before proposing a fix.

How do I separate data drift from code bugs in graduation requirement QA?

Separate data drift from code bugs in graduation QA by performing root-cause classification on reported student cases and applying fixture-based regression validation to identify the exact source of the discrepancy.

Do I need fixture-based regression tests to fix graduation QA issues?

Yes, fixture-based regression tests are required for reported student cases to validate fixes, and you must include wiki citations in your pull requests to ensure the graduation rule changes are accurately verified.

What is the best way to resolve conflicting graduation rules in student evaluations?

The best way to resolve conflicting graduation rules is to trace user-reported bugs to the source, verify the expected outcome against the graduation wiki, and classify whether the issue stems from rule inconsistencies or code defects.