Run unit tests and ground truth evaluations for the doc-code-sync skill.
npx skills add https://github.com/stanah/dotagents --skill skill-eval-stanah
Please help me install this Agent Skill. Skill: skill-eval Source: https://github.com/stanah/dotagents/tree/main/.claude/skills/skill-eval Command: npx skills add https://github.com/stanah/dotagents --skill skill-eval-stanah
This Skill automates the quality evaluation of the 'doc-code-sync' skill by performing a two-layer validation process, thereby saving time on manual evaluations and ensuring consistency in the assessment.
Use the skill-eval skill to evaluate the 'doc-code-sync' skill's performance with the provided fixtures.
High-intent search queries and answers about installing and using this skill.
Automate quality assurance validation by running a two-layer process that executes unit tests on individual extractors and evaluates the overall workflow detection rate against ground truth data to ensure accuracy.
Evaluating accuracy requires comprehensive validation against ground truth data, automatically verifying the completeness and accuracy of extracted data to ensure the workflow performs exactly as expected.
Run unit tests for data extractors as the first layer of validation, verifying the functionality of individual extraction components to ensure they operate correctly before evaluating the full workflow.
Yes, ground truth data is a required dependency for performance testing. It serves as the baseline to check the accuracy and completeness of extracted data during the second layer of validation.
No, the skill-eval validation process requires the doc-code-sync dependency to function, as it specifically automates the quality evaluation of the doc-code-sync skill's extraction workflow performance.
whichguyBenchmark code-reviewer agent prompts with parallel test runs and F1 metrics.
tylerbutlerValidate Fluid Framework API reports, export tiers, and backward compatibility.
DigiStrique-SolutionsAutomate AI prompt and output evaluation against ground-truth fixtures.
projectmilujuAutomates test validation across frontend, backend, and API layers using PyTest or Playwright.
