triton-deploy

Automate NVIDIA Triton Inference Server container deployment and management.

12|1|Updated Nov 23, 2025
One-click install
npx skills add https://github.com/jiunbae/agent-skills --skill triton-deploy
Or copy as Structured Prompt for Agentβ–Ό
Please help me install this Agent Skill.
Skill: triton-deploy
Source: https://github.com/jiunbae/agent-skills/tree/main/ml/triton-deploy
Command: npx skills add https://github.com/jiunbae/agent-skills --skill triton-deploy

SYSTEM DOCUMENTATION & REQUIREMENTS

πŸ’‘ This Skill requires docker, lsof, jq, and includes scripts (resource) and references (resource) components.

What problem does it solve?

NVIDIA Triton μ„œλ²„μ˜ 배포, 운영, λͺ¨λ‹ˆν„°λ§μ„ μžλ™ν™”ν•˜μ—¬ λͺ¨λΈ μ„œλΉ™ νŒŒμ΄ν”„λΌμΈμ˜ μ•ˆμ •μ„±κ³Ό ν™•μž₯성을 λ†’μž…λ‹ˆλ‹€.

Core Features & Use Cases

  • μ„œλ²„ μ‹€ν–‰: GPU 섀정이 ν¬ν•¨λœ Docker μ»¨ν…Œμ΄λ„ˆ μ‹œμž‘
  • λͺ¨λΈ 관리: λͺ¨λΈ λ ˆν¬μ§€ν† λ¦¬ 마운트 및 λ‘œλ“œ
  • μƒνƒœ λͺ¨λ‹ˆν„°λ§: ν—¬μŠ€μ²΄ν¬ 및 λͺ¨λΈ μƒνƒœ 확인
  • 포트 관리: μ£Όμš” 포트 μžλ™ μ„€μ •
  • ν”„λ‘œνŒŒμΌ 지원: 개발/ν”„λ‘œλ•μ…˜ ν™˜κ²½μ— 맞좘 μ„€μ •

Quick Start

예: "langdetector λͺ¨λΈλ‘œ triton μ„œλ²„ μ‹œμž‘ν•΄μ€˜"

Frequently Asked Questions about triton-deploy

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate NVIDIA Triton Inference Server deployment with Docker?β–Ό

Automate Triton server deployment by using Docker containers with GPU configuration, model repository mounting, and health checks. This Skill handles container startup, port mapping, shared memory sizing, and status monitoring across development and production environments with profile-based settings.

Can I manage multiple GPU configurations for Triton model serving?β–Ό

Yes, this Skill supports single and multi-GPU configurations through GPU allocation and shared memory sizing. It automates port provisioning and health checks for scaling Triton deployments across different hardware setups.

How do I start a Triton server and monitor model status?β–Ό

Start a Triton container with automated scripts that handle server startup, model repository mounting, and health verification. The Skill provides script-driven operations for status checks, model listing, log retrieval, and server control.

What dependencies do I need to deploy Triton servers with this automation?β–Ό

You need Docker for containerization, lsof for port management, and jq for configuration processing. These tools enable repeatable deployments with automated port allocation and profile-based server configuration.

Does this approach work for both development and production Triton deployments?β–Ό

Yes, profile-based configuration lets you apply different settings for development and production environments. The Skill handles server startup, model management, and monitoring across both contexts with the same automation framework.

What operations can I automate for Triton server lifecycle management?β–Ό

Automate start, status, models, logs, and stop operations for complete Triton lifecycle control. The Skill enables repeatable server provisioning, health monitoring, and container management without manual intervention.