arize-experiment

Manage Arize experiments with CRUD operations and result comparison.

5|6|Updated Jun 28, 2026
One-click install
npx skills add https://github.com/seldo/aiewf-2026-demo --skill arize-experiment-seldo
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: arize-experiment
Source: https://github.com/seldo/aiewf-2026-demo/tree/main/.agents/skills/arize-experiment
Command: npx skills add https://github.com/seldo/aiewf-2026-demo --skill arize-experiment-seldo

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires ax-cli, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides a comprehensive set of tools for creating, running, and analyzing Arize experiments to evaluate and compare model performance.

Core Features & Use Cases

  • Experiment Management: Create, export, and delete experiments.
  • Model Comparison: Compare results from different models or datasets.
  • Data Collection: Collect and store outputs and evaluations from model runs.
  • Use Case: Use this Skill to compare the accuracy of two different versions of a machine learning model on the same dataset.

Quick Start

Use the arize-experiment skill to run an experiment comparing two models on the 'test' dataset in the 'my-workspace' space.

Frequently Asked Questions about arize-experiment

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I compare AI model performance across different datasets?

You need the ax CLI installed and a configured Arize profile. This skill depends on the ax CLI to manage experiments and execute model performance comparison workflows, requiring proper environment setup before running any analysis.

Can I export data from an Arize experiment for external analysis?

Yes, Arize experiments support data export. You can use this skill to collect and store outputs and evaluations from model runs, then export experiment data to analyze model performance results outside of the Arize platform.

What is the best way to manage model comparison experiments in Arize?

The best way to manage model comparison is using CRUD operations for Arize experiments. You can create, run, analyze, and delete experiments to systematically evaluate and compare AI model performance across multiple datasets.

Does this approach work for evaluating two versions of a machine learning model?

Yes, this approach is optimized for comparing the accuracy of different versions of a machine learning model. You can run experiments comparing two models on the same dataset within a configured Arize workspace to evaluate relative performance.