calling-llms

What problem does it solve?

The Skill unit addresses the complexity of sending chat completions to multiple language learning model providers and routing them appropriately.

Core Features & Use Cases

• Provider Routing: Direct chat completions to a specific LLM provider using a model string prefix.
• Chat Completion Requests: Generate ChatCompletionRequest objects to interact with different models.
• Model Hint: Optional model hint to avoid provider prefixes for requests.
• Use Case: Use the Skill to interact with different language models and leverage the capabilities of various LLM providers for various tasks.

Quick Start

Create a client for OpenAI GPT-4o with a model hint, then send a message request using client.chat(request).