benchmark

Write EmbodiChain benchmark scripts measuring runtime, CPU/RAM, GPU/VRAM, and correctness.

206|20|Updated Oct 24, 2025
One-click install
npx skills add https://github.com/DexForce/EmbodiChain --skill benchmark-dexforce
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: benchmark
Source: https://github.com/DexForce/EmbodiChain/tree/main/skills/benchmark
Command: npx skills add https://github.com/DexForce/EmbodiChain --skill benchmark-dexforce

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill solves the problem of producing consistent, accurate benchmark scripts so you can quantify speed, memory usage, and quality for EmbodiChain modules.

Core Features & Use Cases

  • Benchmark-script authoring: Create benchmark modules that follow EmbodiChain conventions for timing, metrics, and reporting.
  • CPU/GPU comparison: Evaluate implementations (e.g., Warp/CUDA vs CPU or vectorized vs loop-based) while reporting both performance and correctness.
  • Required report outputs: Automatically structure results into one Markdown file containing exactly three tables (Time & Memory, Success & Other Metrics, and Leaderboard).

Quick Start

Ask the AI to generate a benchmark script that measures throughput and memory for a specific EmbodiChain component and writes a single Markdown report with the required three-table format.

Frequently Asked Questions about benchmark

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I benchmark EmbodiChain modules for runtime, memory usage, and accuracy?

To benchmark EmbodiChain modules, generate a script that uses time.perf_counter for consistent timing, tracks memory via psutil and torch CUDA peak tracking, and outputs a single Markdown report with three structured tables.

Can I compare CPU vs GPU performance for solvers and FK/IK routines?

Yes, you can compare CPU vs GPU performance for solvers, samplers, and FK/IK routines by generating benchmark scripts that evaluate both implementations and report performance and correctness metrics side by side.

What is the required Markdown format for EmbodiChain performance profiling reports?

The required Markdown format for EmbodiChain performance profiling reports consists of exactly three tables: Time and Memory metrics, Success and Other Metrics, and a success-rate-sorted Leaderboard.

How do I measure GPU VRAM behavior when CUDA hardware is unavailable?

When CUDA hardware is unavailable, benchmark scripts apply skip-safe execution to bypass GPU tests gracefully while still measuring CPU and RAM behavior, ensuring the benchmark completes without hardware errors.

Does EmbodiChain benchmarking require Apache 2.0 headers in generated scripts?

Yes, EmbodiChain benchmarking requires Apache 2.0 headers in all generated benchmark scripts to maintain consistent licensing conventions across solvers, samplers, metrics, and data-pipeline components.

What is the best way to profile data-pipeline components and metrics in EmbodiChain?

The best way to profile data-pipeline components and metrics in EmbodiChain is to use benchmark scripts that quantify runtime, memory, and correctness, applying time.perf_counter for timing and psutil for memory tracking.