Agent Skills by Peijia Qin
Showing 112 vetted skills indexed across 1 GitHub repositories.
gguf-quantization
Quantize models to GGUF format for CPU inference with llama.cpp.
awq-quantization
Automate 4-bit AWQ quantization of large language models for GPU deployment.
hqq-quantization
Quantize large language model weights without calibration data.
gptq
Quantize large language models to 4-bit precision for memory reduction and faster inference.
optimizing-attention-flash
Apply Flash Attention to transformer models for reduced memory usage and increased speed.
quantizing-models-bitsandbytes
Quantize LLMs to 8-bit or 4-bit with bitsandbytes for memory reduction.
mlflow
Track ML experiments and manage model lifecycles across training, registry, and deployment.
tensorboard
Visualize training metrics, graphs, and embeddings to analyze ML experiments.
weights-and-biases
Automate ML experiment tracking, visualization, and artifact management with Weights & Biases.
nemo-curator
Clean and curate multi-modal LLM training data with GPU-accelerated filtering and deduplication.
ray-data
Distribute data transformations across CPU/GPU clusters with Ray Data.
serving-llms-vllm
Deploy and manage high-throughput LLM serving with vLLM-powered OpenAI-compatible endpoints.
tensorrt-llm
Deploy high-throughput LLM inference with TensorRT-LLM on NVIDIA GPUs.
sglang
Automate prompt prefix caching for LLM serving with SGLang.
llama-cpp
Run LLM inference on CPU and non-NVIDIA hardware with GGUF models.
huggingface-tokenizers
Train and load HuggingFace tokenizers with Rust-based Python bindings.
sentencepiece
Creates SentencePiece subword tokenizers from raw corpora for multilingual NLP preprocessing.
llama-factory
Guides users to fine-tune LLMs via LLaMA-Factory WebUI with no-code configuration.
peft-fine-tuning
Fine-tune 7B–70B language models using LoRA and QLoRA adapters.
axolotl
Design and execute Axolotl-based fine-tuning workflows with YAML configurations.
unsloth
Guide memory-efficient LLM fine-tuning with Unsloth using LoRA and QLoRA workflows.
openrlhf-training
Orchestrate distributed RLHF training for large language models with Ray and vLLM.
simpo-training
Optimize LLM alignment with reference-free SimPO preference optimization.
slime-rl-training
Guide RL post-training of GLM-scale LLMs with Megatron-LM and SGLang workflows.