rust-candle-core

Build GPU-accelerated Rust ML models with the Candle framework.

1|Updated Dec 30, 2025
One-click install
npx skills add https://github.com/gar-ai/mallorn --skill rust-candle-core
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: rust-candle-core
Source: https://github.com/gar-ai/mallorn/tree/main/.claude/skills/rust-ml-candle-core
Command: npx skills add https://github.com/gar-ai/mallorn --skill rust-candle-core

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Build native Rust ML models efficiently using the Candle framework, enabling GPU-accelerated pipelines for vision transformers, large language models, and audio processing.

Core Features & Use Cases

  • GPU-accelerated Rust ML with Candle core crates including candle-core, candle-nn, and candle-transformers.
  • Patterns for vision and language models such as PatchEmbed, multi-head attention, rotary position embeddings, and RMS normalization.
  • Guidance on efficient loading with memory-mapped weights, CUDA feature flags, and practical examples for real-world ML workflows.

Quick Start

Initialize a Rust project configured with the Candle GPU workflow to begin building a simple Transformer-based model.

Frequently Asked Questions about rust-candle-core

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build GPU-accelerated ML models in Rust using Candle?

Build GPU-accelerated Rust ML models using the Candle framework by configuring your Cargo project with candle-core and candle-nn crates, enabling CUDA feature flags for high-performance neural network execution.

What is the best way to implement vision transformers in Rust?

Implementing vision transformers in Rust uses Candle patterns like PatchEmbed and multi-head attention, providing structured guidance for loading models and building high-performance GPU pipelines for neural networks.

Does Candle support rotary position embeddings and RMSNorm for large language models?

Candle supports rotary position embeddings (RoPE) and RMSNorm patterns, allowing developers to build and optimize large language models natively in Rust with GPU acceleration.

Do I need a Rust toolchain and Cargo to use the Candle framework for ML?

Using the Candle framework requires a Rust toolchain and Cargo to manage dependencies, while optional CUDA support can be enabled via the candle feature set for GPU acceleration.

How does memory-mapped weight loading work in Rust ML workflows?

Memory-mapped weight loading in Candle enables efficient memory usage by mapping weight files directly into memory, streamlining the deployment of large language models and audio models in Rust.

Can I run audio processing models natively in Rust with GPU acceleration?

You can run audio processing models natively in Rust with GPU acceleration using the Candle framework, which provides core abstractions for building high-performance audio neural networks.