ttadev-llm

What problem does it solve?

This Skill provides a comprehensive guide on how to integrate and manage LLMs using TTA.dev primitives, simplifying the process of interacting with LLM APIs and enabling efficient workflows.

Core Features & Use Cases

• LLM Integration: Offers a straightforward method to integrate and interact with various LLM providers using TTA.dev's LiteLLMPrimitive and UniversalLLMPrimitive.
• Model Selection: Assists in choosing the appropriate model string for different providers like Groq, Anthropic, OpenAI, Gemini, Ollama, and OpenRouter.
• Streaming & Tool Calls: Provides support for streaming tokens and using tool calls to enhance LLM interactions.
• Observability: Includes guidance on setting up Langfuse observability for LLM calls.
• Primary/Fallback Architecture: Offers a structured approach to building primary/fallback LLM architectures for robustness.

Quick Start

Integrate an LLM into your workflow with the following command: make_resilient_llm("groq", litellm_fallbacks=["anthropic/claude-3-haiku-20240307", "ollama/llama3.2"]).