What problem does it solve?
The Skill addresses the challenge of creating and utilizing custom Boost modules to enhance Harbor's LLM proxy capabilities. This includes building custom plugins, adding features to the proxy pipeline, and transforming LLM chat completions.
Core Features & Use Cases
- Custom Module Development: Facilitate the creation of new Boost modules using Python, allowing for extensive customization and feature expansion.
- Pipeline Integration: Add new features or middleware to the Boost proxy layer for enhanced functionality and flexibility.
- Use Case: When a user needs to integrate reasoning chains, prompt engineering, or output transforms into the Harbor proxy layer, this Skill provides the necessary tools and templates to do so efficiently.
Quick Start
Write a Python module with ID_PREFIX = "my_module" and implement the apply(chat, llm) function to add a new Boost module for Harbor.