boost-modules

Develop Python modules for custom processing of LLM chat completions in Harbor Boost.

3.2k|219|Updated Jul 27, 2024
One-click install
npx skills add https://github.com/av/harbor --skill boost-modules
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: boost-modules
Source: https://github.com/av/harbor/tree/main/skills/boost-modules
Command: npx skills add https://github.com/av/harbor --skill boost-modules

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill unit addresses the need for custom module creation within Harbor Boost, an optimizing LLM proxy. It simplifies the process of building Python modules that intercept or transform LLM chat completions, enabling advanced processing like reasoning chains, prompt injection, structured outputs, artifacts, and custom workflows.

Core Features & Use Cases

  • Custom Module Creation: Develop Python modules to intercept and transform LLM chat completions.
  • LLM Behavior Extension: Extend LLM behavior via proxy and implement chat completion middleware.
  • Use Case: For a developer looking to integrate custom logic into their LLM interactions, this Skill unit allows for the creation of modules that can modify the output of LLM responses based on specific criteria.

Quick Start

To create a custom module for Harbor Boost, write a Python file with the structure defined in the SKILL.md file and place it in the 'custom_modules' directory. Restart the container and test the module through the API.

Frequently Asked Questions about boost-modules

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create custom modules for LLM chat completion processing?

To create custom modules for LLM chat completion processing, write a Python file following the defined structure and place it in the 'custom_modules' directory. This allows you to intercept and transform LLM responses within the Harbor Boost proxy.

What are custom LLM proxy modules used for?

Custom LLM proxy modules are used to intercept and transform chat completions, enabling advanced processing like reasoning chains, prompt injection, structured outputs, artifacts, and custom workflows to extend LLM behavior.

Can I implement prompt injection and reasoning chains in an LLM proxy?

Yes, you can implement prompt injection and reasoning chains by developing Python modules for the Harbor Boost proxy. These modules act as middleware to modify and extend LLM chat completions based on your custom logic.

Do I need a Python environment to build Harbor Boost custom modules?

Yes, a Python environment is required to build Harbor Boost custom modules. You must write Python files, place them in the 'custom_modules' directory, restart the container, and test the module through the API.

How do I add chat completion middleware to an LLM proxy?

You add chat completion middleware to an LLM proxy by writing a Python module with the specified structure and deploying it to the 'custom_modules' directory. Restart the container to activate the middleware for API interactions.

What is the best way to transform LLM outputs through a proxy?

The best way to transform LLM outputs through a proxy is by creating Python modules for Harbor Boost. This approach lets you intercept chat completions and apply custom workflows, structured outputs, or prompt modifications directly.