llamacpp-docs

Guide llama.cpp builds, installs, and runtime configuration from official docs.

7|2|Updated Feb 25, 2026
One-click install
npx skills add https://github.com/wenerme/ai --skill llamacpp-docs
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: llamacpp-docs
Source: https://github.com/wenerme/ai/tree/main/skills/llamacpp-docs
Command: npx skills add https://github.com/wenerme/ai --skill llamacpp-docs

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill helps you quickly find correct, authoritative guidance for building, installing, and using llama.cpp without hunting through scattered sources.

Core Features & Use Cases

  • Build & Install Guidance: Covers source builds (CMake), installation steps, and architecture-specific builds (e.g., RISC-V, s390x).
  • Runtime Feature References: Explains function calling/tool use, speculative decoding, multimodal support, presets, and supported operations.
  • Backend-Specific Setup: Documents GPU backend enablement and configuration across CUDA, Metal, Vulkan, OpenCL, SYCL, CANN, Android, Docker, and more.

Quick Start

Use the llamacpp-docs skill to look up how to build and run llama.cpp with the CUDA backend in Docker.

Frequently Asked Questions about llamacpp-docs

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build llama.cpp with the CUDA backend enabled?

Building llama.cpp with the CUDA backend requires specific CMake flags during source compilation. The Skill provides structured, topic-indexed guidance for enabling GPU backends like CUDA, ensuring you reference the correct official documentation steps.

What is the correct way to load GGUF models in llama.cpp?

Loading GGUF models in llama.cpp involves specific runtime configuration commands. This Skill surfaces official documentation to guide you through the process, ensuring correct model loading without manual navigation through scattered sources.

Does llama.cpp support function calling and speculative decoding?

Yes, llama.cpp supports advanced features like function calling, tool use, and speculative decoding. This Skill references official documentation to explain these runtime features, helping you implement them correctly in your applications.

Can I compile llama.cpp for non-standard architectures like RISC-V or Android?

Compiling llama.cpp for RISC-V, s390x, or Android is supported through architecture-specific builds. The Skill provides curated official documentation to guide you through the necessary CMake and installation steps for these environments.

What GPU backends can I configure when running llama.cpp?

You can configure multiple GPU backends for llama.cpp including CUDA, Metal, Vulkan, OpenCL, SYCL, and CANN. The Skill delivers official documentation references to help you set up and enable the correct backend for your hardware.

Why use curated official documentation for llama.cpp installation instead of general guides?

Using curated official documentation for llama.cpp installation ensures you get authoritative, reliable build and configuration steps. This Skill surfaces topic-indexed answers directly from official sources, preventing errors from outdated or scattered third-party tutorials.