vllm-recipe-explorer

Community

Automate LLM recipe generation and optimization for target GPUs.

Authortbvjvsladla
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill automates the generation and optimization of LLM recipes for specific GPUs, streamlining the process of configuring and deploying LLM models.

Core Features & Use Cases

  • Recipe Generation: Automatically generate LLM recipes based on user-defined parameters such as model, GPU, VRAM budget, and quantization.
  • Recipe Optimization: Optimize recipes for target GPUs, considering VRAM utilization, batch size, and attention backend.
  • Use Case: Imagine you have a new LLM model and want to deploy it on an RTX4090 GPU with a 24GB VRAM budget. Use this Skill to generate and optimize a recipe for this specific configuration.

Quick Start

Use the vllm-recipe-explorer skill to generate a recipe for the model 'gpt-oss-20b' on an RTX4090 GPU with a 24GB VRAM budget.

Dependency Matrix

Required Modules

vllmtorchyamljsonrequests

Components

scriptsreferencesassets

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: vllm-recipe-explorer
Download link: https://github.com/tbvjvsladla/easy_vllm_simulator/archive/main.zip#vllm-recipe-explorer

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.