foundation-models-utilities

What problem does it solve?

This Skill simplifies the integration and management of large language models (LLMs) within applications, enabling seamless context management and on-demand activation of custom skills.

Core Features & Use Cases

• Custom Skills: On-demand instructions or prompt fragments that the model can activate by issuing a tool call.
• Chat Completions Language Model: Communicate with any server that uses the chat completions REST API for natural language processing.
• History Management: Compress the transcript before each generation using strategies like dropping completed tool calls, rolling window, and summarization.
• Use Case: Integrate this Skill into a chatbot application to manage conversations efficiently, with the ability to add or remove context dynamically.

Quick Start

To use the chat completions endpoint with a local LLM server, activate the chat completions skill by typing: "connect to my local LLM server".