quark-onnx-ptq

Execute end-to-end post-training quantization workflows for ONNX models with AMD Quark.

154|27|Updated Jun 19, 2024
One-click install
npx skills add https://github.com/amd/Quark --skill quark-onnx-ptq
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: quark-onnx-ptq
Source: https://github.com/amd/Quark/tree/main/.claude/skills/quark-onnx-ptq
Command: npx skills add https://github.com/amd/Quark --skill quark-onnx-ptq

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill removes the complexity of preparing, calibrating, and executing an end-to-end post-training quantization workflow for ONNX models with AMD Quark.

Core Features & Use Cases

  • Full ONNX PTQ workflow: Handles model intake, quantization planning, calibration-script generation, manifest creation, and execution confirmation.
  • Model optimization scenarios: Supports common ONNX quantization requests such as XINT8, A8W8, BFP16, and MXFP variants for vision models and LLM weight-only compression.
  • Use Case: A user can provide an ONNX model and request a complete quantization pipeline that prepares calibration artifacts and runs the final optimized model generation steps.

Quick Start

Ask the skill to run an end-to-end quantization workflow for your ONNX model and specify the target quantization format and any external weights file if present.

Frequently Asked Questions about quark-onnx-ptq

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run post-training quantization for an ONNX model end to end?

Post-training quantization for an ONNX model is executed end to end by generating calibration scripts, creating manifests, and running final optimized model generation steps for deterministic results.

What quantization formats are supported for ONNX model optimization with AMD Quark?

AMD Quark supports common ONNX quantization formats including XINT8, A8W8, BFP16, and MXFP variants for vision models, as well as LLM weight-only compression.

Can I use external weight files when quantizing ONNX models?

Yes, you can use external weight files when quantizing ONNX models. The workflow requires support for ONNX inputs and optional external-weight files during the quantization process.

How does calibration work in an ONNX PTQ workflow?

Calibration in an ONNX PTQ workflow operates through multi-step coordination that generates calibration scripts and manifests to plan quantization before executing the optimized model.

Does AMD Quark support ONNX quantization for both vision models and LLMs?

AMD Quark supports ONNX quantization for both vision models and LLMs, applying multi-step workflow coordination for vision scenarios and LLM weight-only compression tasks.

What is the best way to prepare an ONNX model for XINT8 or A8W8 quantization?

The best way to prepare an ONNX model for XINT8 or A8W8 quantization is through an end-to-end workflow that handles calibration planning, manifest generation, and execution confirmation.