gemm-perf

Measure GPU matrix computation throughput with standardized TFLOPs or TOPs metrics.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/dongg622/china-ai-chip-skill --skill gemm-perf
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: gemm-perf
Source: https://github.com/dongg622/china-ai-chip-skill/tree/main/TIANSHU/gemm-perf
Command: npx skills add https://github.com/dongg622/china-ai-chip-skill --skill gemm-perf

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill enables hardware developers and FAEs to measure the matrix computation performance of GPU accelerators efficiently.

Core Features & Use Cases

  • Hardware Performance Evaluation: Conducts detailed tests of GEMM operations across multiple data types, such as FP32, FP16, BF16, and INT8.
  • Benchmarking & Comparison: Outputs precise TFLOPs or TOPs metrics, allowing performance comparison before deployment or during hardware validation.
  • Use Case: A FAEs tests the matrix calculation capacity of a new AI accelerator card to ensure it meets specifications for deployment in AI workflows.

Quick Start

Run the gemm_perf tool directly on your system with the default parameters to measure your device's matrix computation speed.

Frequently Asked Questions about gemm-perf

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I benchmark GPU matrix multiplication performance for different data types?

To benchmark GPU matrix performance, you can run tests that evaluate GEMM computational throughput across data types like FP32, FP16, BF16, and INT8. This process outputs standardized TFLOPs or TOPs metrics for direct hardware comparison.

What is the best way to test an AI accelerator card's GEMM capacity before deployment?

Testing GEMM capacity involves conducting comprehensive matrix performance tests on the GPU hardware. This validates whether the AI accelerator meets required specifications by measuring computational throughput and providing precise TFLOPs or TOPs metrics.

Do I need specific drivers or tools to measure GPU matrix computation speed?

Yes, measuring GPU matrix computation speed requires compatible GPU drivers and the corex-toolbox. These prerequisites ensure the environment can accurately execute the performance tests and report standardized throughput metrics.

Can I compare hardware validation results using standardized performance metrics?

Yes, you can compare hardware validation results using standardized TFLOPs or TOPs metrics. The performance benchmarking tests output these standardized metrics to enable direct comparison of matrix computation speed across different GPU hardware.

How does matrix performance testing handle multiple data formats during benchmarking?

Matrix performance testing handles multiple data formats by executing GEMM operations across supported types like FP32, FP16, BF16, and INT8. This allows comprehensive evaluation of computational throughput for each specific data format.