new-boost-module

Develop Python-based Boost modules for Harbor's LLM proxy pipeline.

3.2k|219|Updated Jul 27, 2024
One-click install
npx skills add https://github.com/av/harbor --skill new-boost-module
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: new-boost-module
Source: https://github.com/av/harbor/tree/main/.agents/skills/new-boost-module
Command: npx skills add https://github.com/av/harbor --skill new-boost-module

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

The Skill addresses the challenge of creating and utilizing custom Boost modules to enhance Harbor's LLM proxy capabilities. This includes building custom plugins, adding features to the proxy pipeline, and transforming LLM chat completions.

Core Features & Use Cases

  • Custom Module Development: Facilitate the creation of new Boost modules using Python, allowing for extensive customization and feature expansion.
  • Pipeline Integration: Add new features or middleware to the Boost proxy layer for enhanced functionality and flexibility.
  • Use Case: When a user needs to integrate reasoning chains, prompt engineering, or output transforms into the Harbor proxy layer, this Skill provides the necessary tools and templates to do so efficiently.

Quick Start

Write a Python module with ID_PREFIX = "my_module" and implement the apply(chat, llm) function to add a new Boost module for Harbor.

Frequently Asked Questions about new-boost-module

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a custom Python plugin for Harbor's LLM proxy?

The Harbor Boost architecture supports custom Python modules to extend the LLM proxy pipeline, enabling the integration of reasoning chains, prompt engineering, and output transforms directly into chat completion processing.

How do I add custom middleware to an LLM proxy pipeline?

You can add custom middleware to an LLM proxy pipeline by developing a Python-based Boost module that implements the `apply(chat, llm)` function, inserting custom logic directly into the Harbor proxy's chat completion processing flow.

Do I need Python experience to create custom Boost modules for Harbor?

Familiarity with Python and the Harbor Boost architecture is required to effectively develop, manage, and integrate custom proxy modules for transforming LLM chat completions.

Can I transform LLM chat completions using a custom proxy module?

Yes, you can transform LLM chat completions by building a custom Python Boost module that implements the `apply(chat, llm)` function, allowing you to intercept and modify chat data within the Harbor proxy pipeline.

What is the best way to integrate prompt engineering into a proxy layer?

The best way to integrate prompt engineering into a proxy layer is using custom Python Boost modules, which provide the necessary templates and framework to inject prompt transformations directly into the LLM chat completion pipeline.

When should I not use a custom module for LLM proxy processing?

You should avoid building a custom module for LLM proxy processing if your task does not require pipeline-level transformations, reasoning chain integration, or custom middleware, as the standard Harbor proxy setup handles basic chat completions without custom Python extensions.