orizu-cli

What problem does it solve?

This Skill addresses the challenge of improving Large Language Model (LLM) applications by providing a comprehensive platform for evaluation and optimization, streamlining the process of building evals and optimizing against them.

Core Features & Use Cases

• Human Evaluation: Collect and manage human feedback on LLM outputs.
• Auto Evaluation: Automate evaluation using machine learning models.
• Optimization: Use evals to hill climb and optimize LLM performance.
• Use Case: If you have a set of LLM outputs and you want to improve their accuracy, you can use this Skill to collect human feedback, create evals, and optimize the model against them.

Quick Start

Run the orizu setup command to initialize your local workspace and install the necessary skills.