udf-benchmark

Official

Benchmark CPU vs GPU UDF performance fast.

AuthorNVIDIA
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill helps you validate and benchmark a Spark UDF conversion by comparing the original CPU implementation against the GPU implementation, so you can confirm correctness and measure performance gains with confidence.

Core Features & Use Cases

  • Benchmark Workflow Guidance: Walks through the full benchmarking process from implementing BenchUtils to running validation and large-scale performance tests.
  • CPU vs GPU Comparison: Supports side-by-side benchmarking of CPU UDFs and RapidsUDF or SQL equivalents.
  • Microbenchmark Support: Includes optional cuDF microbenchmarks for deeper GPU-only performance analysis after Spark-level benchmarking.
  • Use Case: A developer has converted a UDF to GPU and needs to validate small-sample correctness, generate production-sized benchmark data, and compare throughput across CPU and GPU runs.

Quick Start

Use this skill to validate your BenchUtils implementation, generate benchmark data, run CPU and GPU benchmarks, and complete cuDF microbenchmarks when applicable.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: udf-benchmark
Download link: https://github.com/NVIDIA/cudf-spark/archive/main.zip#udf-benchmark

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 536,000+ vetted skills library on demand.