coreml-validate

Validate CoreML model numerical accuracy against PyTorch reference models.

57|18|Updated Jul 9, 2025
One-click install
npx skills add https://github.com/mattmireles/kokoro-coreml --skill coreml-validate
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: coreml-validate
Source: https://github.com/mattmireles/kokoro-coreml/tree/main/.claude/skills/coreml-validate
Command: npx skills add https://github.com/mattmireles/kokoro-coreml --skill coreml-validate

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the challenge of validating CoreML models' numerical accuracy against PyTorch reference models, ensuring the model outputs are consistent and reliable.

Core Features & Use Cases

  • Numerical Parity Validation: Compares CoreML model outputs against PyTorch reference model outputs, providing detailed correlation and error analysis.
  • Multi-Precision Comparison: Allows comparison of both FP16 and FP32 precision outputs for accuracy assessment.
  • Pipeline Comparison: Validates full inference pipelines, isolating and identifying any discrepancies at each stage.

Quick Start

Trigger the 'coreml-validate' skill with the specific model file and reference pipeline, e.g., 'coreml-validate path/to/model.mlpackage path/to/reference'

Frequently Asked Questions about coreml-validate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate CoreML model accuracy against a PyTorch reference model?

To validate CoreML model accuracy against a PyTorch reference model, use numerical parity validation to compare outputs, providing detailed correlation and error analysis to ensure consistent results.

Can I compare FP16 and FP32 precision outputs during Core ML model validation?

Yes, you can compare both FP16 and FP32 precision outputs during Core ML model validation. Multi-precision comparison allows you to assess accuracy variations across different floating-point formats.

How do I debug numerical discrepancies in a Core ML inference pipeline?

To debug numerical discrepancies in a Core ML inference pipeline, run a full pipeline comparison against your PyTorch reference to isolate and identify exactly where output mismatches occur at each stage.

What is numerical parity validation for Core ML models?

Numerical parity validation for Core ML models is the process of comparing Core ML outputs against PyTorch reference outputs to verify that the converted model maintains consistent and reliable numerical accuracy.

How do I test a Core ML model pipeline against a PyTorch reference?

You test a Core ML model pipeline against a PyTorch reference by triggering validation with your model file and reference path, which validates the full inference pipeline to isolate any stage discrepancies.