NVIDIAOfficial·7 Agent Skills Included

cudf-spark

Convert Spark UDFs to GPU with tests, benchmarks, and optimization

Converts Apache Spark CPU UDFs into GPU-accelerated versions using cuDF, native CUDA, or Spark SQL. Generates unit tests, CPU-vs-GPU comparison tests, and coverage reports to prove the conversion is correct. Benchmarks and profiles GPU performance, then iteratively optimizes the implementation with measurable results. Includes a review skill that audits conversions for hardcoded test values and hidden CPU fallbacks.

993|294

↗

npx skills add NVIDIA/cudf-spark --all -g -y

Available:

Gives AI coding agents the repository's safety rules, GPU resource management patterns, build commands, and shim-layer conventions so they modify the plugin correctly without bypassing project policies.

All Skills in This Repository (7)

Pure Emerald Level Indicators

📦 In Repo

NVIDIA

udf-convert-to-cudf

Convert Apache Spark UDFs into GPU-accelerated RapidsUDF implementations.

udf-convert-to-cuda

Convert Apache Spark CPU UDFs into native CUDA RapidsUDF implementations.

udf-gen-test

Generate ScalaTest unit tests for Apache Spark UDFs before GPU conversion.

udf-optimize-cudf

Optimize cuDF RapidsUDF implementations for GPU performance with profiling and benchmarking.

udf-benchmark

Validate and compare Spark UDF implementations across CPU and GPU paths.

udf-judge-conversion

Review converted UDFs for correctness gaps and hidden fallback risks.

udf-convert-to-sql

Convert Apache Spark UDFs into equivalent Spark SQL expressions.

Official

Intermediate

Frequently Asked Questions

FAQPage Schema

How to install cudf-spark skills?▼

Run `npx skills add NVIDIA/cudf-spark --all -g -y` in your terminal to install all UDF conversion skills globally.

How to run a Spark UDF on the GPU?▼

The skills guide your agent through a three-step workflow: generate a unit test, convert the UDF to a cuDF, CUDA, or SQL implementation, then benchmark CPU against GPU.

How do I know my GPU UDF matches the CPU version?▼

The generated comparison test runs both implementations on the same data and directly compares outputs, while the judge skill audits for hardcoded values and hidden CPU fallbacks.

Can I optimize a slow GPU UDF automatically?▼

Yes. The udf-optimize-cudf skill profiles your UDF with nsys, applies one targeted change at a time, and keeps only changes that measurably improve benchmark results.

Do these skills work with Claude Code and other AI agents?▼

Yes. All skills follow the standard SKILL.md format and run in Claude Code, Cursor, and other compatible AI coding agents.