axolotl

Configure and troubleshoot Axolotl YAML training workflows for LLM fine-tuning.

1|Updated Apr 10, 2026
One-click install
npx skills add https://github.com/zerwiz/wayofpi --skill axolotl-zerwiz
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: axolotl
Source: https://github.com/zerwiz/wayofpi/tree/main/.hermes/hermes-agent/skills/mlops/training/axolotl
Command: npx skills add https://github.com/zerwiz/wayofpi --skill axolotl-zerwiz

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Axolotl Skill removes the complexity of configuring, launching, and troubleshooting modern LLM training runs, so you can focus on model quality instead of wiring.

Core Features & Use Cases

  • Configure supervised fine-tuning, preference optimization, reward modeling, and multimodal training from YAML.
  • Handle dataset formats such as chat templates, instruction pairs, template-free prompts, and pre-tokenized data.
  • Use it to plan LoRA or QLoRA experiments, choose distributed training settings, and troubleshoot tokenization or masking issues.

Quick Start

Ask for an Axolotl configuration plan for your target model, dataset format, and training method, and include any constraints such as LoRA, DPO, or multimodal inputs.

Frequently Asked Questions about axolotl

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I configure LLM fine-tuning with YAML for supervised training?

YAML-driven LLM fine-tuning configures supervised training by defining dataset formats, chat templates, and tokenizer settings in a single file. You can set up LoRA or QLoRA experiments and distributed training options to launch runs without manual wiring.

Can I use DPO preference optimization with a custom chat template for my dataset?

DPO preference optimization supports custom chat templates by mapping instruction pairs and template-free prompts to the correct format. You can configure dataset compatibility and troubleshoot tokenization or masking issues directly from the YAML file.

What's the best way to set up multimodal training for an LLM?

Multimodal training for an LLM is best set up by defining multimodal inputs alongside reward modeling or quantization parameters in a YAML config. This approach handles dataset preprocessing and chat-template formatting to streamline the workflow.

How do I troubleshoot tokenization and masking issues during QLoRA experiments?

Troubleshooting tokenization and masking issues during QLoRA experiments involves validating your dataset format compatibility and verifying chat-template handling within your YAML config. Adjust tokenizer settings to ensure prompt masks align with training objectives.

Does LoRA fine-tuning support pre-tokenized data and distributed training?

LoRA fine-tuning supports pre-tokenized data and distributed training by specifying the appropriate dataset format and training settings in YAML. You can configure tokenizer handling and distribute workloads while maintaining quantization parameters.