codility-review

Evaluate Codility Legal Document Management API submissions with a two-pass rubric.

1|Updated May 15, 2026
One-click install
npx skills add https://github.com/mslshao/claude-harness --skill codility-review
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: codility-review
Source: https://github.com/mslshao/claude-harness/tree/main/dotclaude/skills/codility-review
Command: npx skills add https://github.com/mslshao/claude-harness --skill codility-review

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps hiring teams review Codility submissions for a Legal Document Management API task using a consistent two-pass rubric. It reduces subjective judgment by separating authorship authenticity concerns from actual level calibration, so reviewers can make clearer advance, reject, or second-review decisions.

Core Features & Use Cases

  • Two-pass evaluation: First checks whether the code, transcript, and claimed skills align authentically, then grades engineering level only if the authenticity gate clears.
  • Evidence-based scoring: Requires concrete support such as file-and-line references, transcript quotes, resume excerpts, and Codility timeline events for every scored row.
  • Hiring recommendation support: Produces a structured recommendation against the target level and can draft a recruiter-facing Slack reply when the submission should be passed on or escalated.
  • Use case: Review a candidate submission that includes solution files, a Cody transcript, verify history, and resume claims to determine whether the work appears authentic and whether the candidate fits L3, L4, or L5 expectations.

Quick Start

Ask the codility-review skill to assess a candidate's Codility submission using the target level, claimed skills, verify timeline, Cody transcript, and submitted Python files.

Frequently Asked Questions about codility-review

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate a Codility submission for authorship authenticity and engineering level?

To evaluate a Codility submission, use a two-pass rubric that first checks code, transcript, and resume alignment for authorship authenticity, then grades engineering level against L3, L4, or L5 expectations using evidence-backed scoring.

What is a two-pass rubric for candidate code review?

A two-pass rubric for candidate code review separates authorship authenticity checks from engineering level calibration, requiring evidence like file-and-line references and transcript quotes to reduce subjective judgment in hiring decisions.

How do I score Python FastAPI Codility submissions using a hiring rubric?

Score Python FastAPI Codility submissions by applying evidence-based row scoring against a target level, using tally-based decisions for pass or inconclusive outcomes, and performing median level voting for final calibration.

Do I need a Cody transcript and verify timeline to assess a candidate's Codility submission?

Yes, assessing a Codility submission requires the Cody transcript and verify timeline alongside submitted Python files and resume claims to validate authorship authenticity and calibrate the engineering level accurately.

Can I draft a recruiter reply for a candidate who fails Codility code review without alleging AI misuse?

Yes, you can draft a recruiter-facing Slack reply for passing on or escalating a submission without directly alleging AI misuse, using the structured recommendation generated from the tally-based pass or inconclusive decision.

What are the limitations of using a two-pass rubric for Codility candidate evaluation?

The two-pass rubric requires complete evidence including solution files, Cody transcript, verify history, and resume claims; if authenticity is inconclusive, it cannot proceed to grade the engineering level, resulting in an inconclusive decision.