Run and interact with local AI models via the Ollama API.
npx skills add https://github.com/rawveg/skillsforge-marketplace --skill ollama
Please help me install this Agent Skill. Skill: ollama Source: https://github.com/rawveg/skillsforge-marketplace/tree/main/ollama Command: npx skills add https://github.com/rawveg/skillsforge-marketplace --skill ollama
This Skill guides you to run, configure, and integrate Ollama for local AI model hosting, including chat, embeddings, and streaming outputs.
Start a local model with Ollama, then generate a chat response using the /api/chat endpoint.
High-intent search queries and answers about installing and using this skill.
Ollama enables running local AI models through an OpenAI-compatible API endpoint. Start Ollama with a model like llama3.2 or gemma3, then use standard OpenAI client libraries against Ollama's /api/chat and /api/embeddings endpoints for chat completions, embeddings, and streaming responses.
Yes, Ollama supports GPU acceleration for faster inference. Configure GPU support during Ollama setup; the Skill covers GPU-enabled deployments both locally and in Docker containers for improved performance on compatible hardware.
Ollama supports proxy configuration and cloud model authentication via environment variables. Set proxy credentials and cloud endpoints through environment setup, enabling secure access to models whether hosted locally or remotely behind corporate proxies.
Ollama provides embeddings generation and vision task capabilities through its API. Use the /api/embeddings endpoint for text embedding and compatible models for vision-based inference, enabling multimodal workflows alongside chat and streaming responses.
Yes, Ollama deployments in Docker support robust authentication and server configuration. Configure authentication credentials and server settings via environment variables when containerizing Ollama for production or shared environments.
Local Ollama hosting runs models directly on your hardware with full control; cloud proxy setups route requests through remote endpoints with centralized management. Choose based on latency, privacy, and resource availability needs—the Skill supports both architectures.
inho-teamConfigure local LLM servers and integrate them with Claude Code.
thesaifalitaiIntegrate large language models into production applications with streaming, structured outputs, and cost management.
EverClawSet up a self-hosted OpenClaw inference stack with Morpheus routing and local fallback models.
NVIDIA-AI-IOTDeploy OpenAI-compatible LLM or VLM serving endpoints on Jetson devices.
