tech/ollama
OfficialLocal LLM runtime for open-weight models, on-premise inference, and OpenAI compatibility.
Software Engineering#edge deployment#on-prem deployment#open-weight models#local LLM#on-premise inference#OpenAI compatibility#custom model behavior
Author2nth-ai
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill provides a local LLM runtime for running open-weight models on-premise, eliminating cloud costs and enabling private AI applications.
Core Features & Use Cases
- Local LLM Runtime: Run open-weight models like Llama, Mistral, Gemma, Phi, Qwen, DeepSeek locally with zero cloud cost.
- Private AI Applications: Build private AI applications on-premise, suitable for air-gapped environments.
- OpenAI Compatibility: Serve models via an OpenAI-compatible API for seamless integration with existing tooling.
- Custom Model Behavior: Customize model behavior with Modelfile system prompts, parameter tuning, and adapter merging.
- Edge and On-Prem Deployment: Deploy models at the edge or on-prem with Docker, Linux service, Kubernetes, GPU/CPU inference.
- Integration with Agent Frameworks: Integrate with agent frameworks like LangChain, LlamaIndex, Open WebUI, and Continue.dev.
Quick Start
Install Ollama and run the Llama 3.2 model with the command: ollama pull llama3.2 && ollama run llama3.2 "Summarise this in one sentence: ..."
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferencesassets
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: tech/ollama Download link: https://github.com/2nth-ai/skills/archive/main.zip#tech-ollama Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.