Skills
.Work. You
Rest

diff-eval-func

Community

Deterministic, function-level diff evaluation.

Software Engineering#automation#code-quality#deterministic#patch#pr-review#diff-eval#function-level
Authorwzh4464
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Evaluate agent-generated code changes against a human-approved PR, using deterministic file coverage and function-level coverage analysis to ensure reproducible evaluation of patch quality across repos and languages.

Core Features & Use Cases

  • Deterministic file coverage computed via bash scripts to ensure consistent results across runs.
  • Function-level coverage that identifies which functions are modified by diffs.
  • Dual semantic + data-based analysis with structured scoring and auto-generated file filtering.
  • Ground-truth vs generated patch comparison for PR validation and AI coding tool benchmarking.

Quick Start

Provide the PR diff, the ground-truth patch, and the repository path to run a deterministic, function-level diff evaluation and generate a structured evaluation report.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: diff-eval-func
Download link: https://github.com/wzh4464/claude-skills/archive/main.zip#diff-eval-func

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.