Pulls llama.cpp models with automatic ROCm/CPU image switching.
npx skills add https://github.com/av/skills --skill pull-llamacpp-model
Please help me install this Agent Skill. Skill: pull-llamacpp-model Source: https://github.com/av/skills/tree/main/pull-llamacpp-model Command: npx skills add https://github.com/av/skills --skill pull-llamacpp-model
This Skill simplifies the process of pulling llamacpp models, addressing compatibility issues with ROCm and ensuring successful model downloads on ROCm-based systems.
Pull a llamacpp model using the pull-llamacpp-model skill:
npx skills add av/skills --skill pull-llamacpp-model
High-intent search queries and answers about installing and using this skill.
To pull llamacpp models on a ROCm-based system, you need to automate the switching between ROCm and standard CPU images to ensure successful model download and compatibility.
Pulling a llamacpp model fails with ROCm compatibility issues when the system does not properly switch from standard CPU images to ROCm-compatible images during the model download process.
The best way to handle ROCm image switching for llamacpp model downloads is to automate the process, ensuring the system seamlessly transitions between ROCm and standard CPU images for compatibility.
Yes, a standard CPU image is used during the pulling process to ensure successful model downloads before automatically switching to the ROCm-compatible image on ROCm-based systems.
You need to adjust ROCm compatibility for llamacpp models when downloading new models onto ROCm-based systems, ensuring the downloaded model works seamlessly with the ROCm environment.
amdCollect OS, Python, GPU, and accelerator facts for Quark installation readiness.
trymiraiDownload test models by REPO_ID into ./models/{ENGINE_VERSION}/{MODEL_NAME}.
kngender5Optimize inference speed and VRAM efficiency for Colab models using FlashAttention-2/3.
GitnappConvert Hugging Face models into GGUF files with Q4_K_M quantization.