evals-context

Explain the CoStrict evals system directory structure within the monorepo.

4.4k|196|Updated Apr 10, 2025
One-click install
npx skills add https://github.com/zgsm-ai/costrict --skill evals-context
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: evals-context
Source: https://github.com/zgsm-ai/costrict/tree/main/.roo/skills/evals-context
Command: npx skills add https://github.com/zgsm-ai/costrict --skill evals-context

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill clarifies the complex directory structure and purpose of the evals system within the CoStrict monorepo, preventing confusion between different evals-related components.

Core Features & Use Cases

  • Monorepo Structure Explanation: Clearly delineates the locations and functions of the evals execution system, management UI, and public website display.
  • Component Identification: Helps users understand where to modify the CLI, web interfaces, or database schemas related to evals.
  • Use Case: When a developer needs to add a new evaluation exercise, this Skill provides the exact paths and guidance for modifying the packages/evals directory and understanding its relationship with the external exercise repository.

Quick Start

Use the evals-context skill to understand where the evals execution system code is located.

Frequently Asked Questions about evals-context

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
What is the directory structure of the evals system in a monorepo?

The evals system in a monorepo separates the execution infrastructure, management UI, and public display pages into distinct directories. This structure clarifies component purposes and prevents confusion when navigating the distributed evaluation platform.

How do I add a new evaluation exercise to the evals execution system?

To add a new evaluation exercise, modify the packages/evals directory within the monorepo. This location contains the execution system code and provides guidance for understanding its relationship with the external exercise repository.

Where do I modify the CLI and database schemas for the evals infrastructure?

You modify the CLI, web interfaces, and database schemas related to evals within the designated packages/evals directory. Identifying these specific paths helps developers locate the correct components for updating the distributed evaluation platform.

Does the evals infrastructure separate execution code from public website display?

Yes, the evals infrastructure separates the execution system, management web interfaces, and public website display into distinct directories. This delineation ensures developers know exactly where to modify code for each specific evals-related component.

Why does the evals codebase structure split components across different directories?

The evals codebase structure splits components to clarify the locations and functions of the execution system, management UI, and public display. This architectural overview prevents confusion when navigating the distributed evaluation platform within the monorepo.