rust-candle-core

Build GPU-accelerated Rust ML models with the Candle framework.

1|Updated Dec 30, 2025
One-click install
npx skills add https://github.com/gar-ai/mallorn --skill rust-candle-core
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: rust-candle-core
Source: https://github.com/gar-ai/mallorn/tree/main/.claude/skills/rust-ml-candle-core
Command: npx skills add https://github.com/gar-ai/mallorn --skill rust-candle-core

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Build native Rust ML models efficiently using the Candle framework, enabling GPU-accelerated pipelines for vision transformers, large language models, and audio processing.

Core Features & Use Cases

  • GPU-accelerated Rust ML with Candle core crates including candle-core, candle-nn, and candle-transformers.
  • Patterns for vision and language models such as PatchEmbed, multi-head attention, rotary position embeddings, and RMS normalization.
  • Guidance on efficient loading with memory-mapped weights, CUDA feature flags, and practical examples for real-world ML workflows.

Quick Start

Initialize a Rust project configured with the Candle GPU workflow to begin building a simple Transformer-based model.

Frequently Asked Questions about rust-candle-core

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build GPU-accelerated ML models in Rust using Candle?▼

Build GPU-accelerated Rust ML models using the Candle framework by configuring your Cargo project with candle-core and candle-nn crates, enabling CUDA feature flags for high-performance neural network execution.

What is the best way to implement vision transformers in Rust?▼

Implementing vision transformers in Rust uses Candle patterns like PatchEmbed and multi-head attention, providing structured guidance for loading models and building high-performance GPU pipelines for neural networks.

Does Candle support rotary position embeddings and RMSNorm for large language models?▼

Candle supports rotary position embeddings (RoPE) and RMSNorm patterns, allowing developers to build and optimize large language models natively in Rust with GPU acceleration.

Do I need a Rust toolchain and Cargo to use the Candle framework for ML?▼

Using the Candle framework requires a Rust toolchain and Cargo to manage dependencies, while optional CUDA support can be enabled via the candle feature set for GPU acceleration.

How does memory-mapped weight loading work in Rust ML workflows?▼

Memory-mapped weight loading in Candle enables efficient memory usage by mapping weight files directly into memory, streamlining the deployment of large language models and audio models in Rust.

Can I run audio processing models natively in Rust with GPU acceleration?▼

You can run audio processing models natively in Rust with GPU acceleration using the Candle framework, which provides core abstractions for building high-performance audio neural networks.