run-llms
CommunityLocal LLM setup and operation with Harbor
Authorav
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill provides a comprehensive guide for setting up and running local Large Language Models (LLMs) using the Harbor toolkit. It helps users troubleshoot common issues and integrate various local AI services.
Core Features & Use Cases
- LLM Setup: Detailed instructions for installing and configuring Harbor, Docker, and other necessary components.
- Model Management: Steps to pull and manage models from Ollama, HuggingFace, and llama.cpp registries.
- Service Integration: Integration with services like Open WebUI, SearXNG, and Open Terminal for a full AI toolkit experience.
- GPU Optimization: Tips for troubleshooting GPU-related issues and optimizing VRAM usage.
- Use Case: For a user looking to set up a local AI service to handle chat and code execution, this Skill provides a step-by-step guide to achieve that.
Quick Start
Run the 'run-llms' skill to start the setup process for local LLMs using Harbor.
Dependency Matrix
Required Modules
dockerdocker-compose
Components
scriptsreferencesassets
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: run-llms Download link: https://github.com/av/harbor/archive/main.zip#run-llms Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.