Skills
.Work. You
Rest

n8n:create-instance-ai-eval

Community

Automate AI workflow evaluation for robustness and performance.

Software Engineering#evaluation#ai workflow#n8n#ai debugging#langtracer
AuthorRub-git
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill automates the creation and evaluation of AI workflow eval cases, ensuring that AI workflows are robust and perform as expected.

Core Features & Use Cases

  • Automated Case Creation: Generates JSON files for AI workflow eval cases, including build, behavior/process, credential, and seeded cases.
  • Real Build Calibration: Calibrates expectations against real builds to ensure accuracy.
  • Multi-Turn Director Scripting: Supports multi-turn director scripts for complex conversation scenarios.
  • Integration with LangTracer and LangSmith: Utilizes LangTracer for discovery and LangSmith for verification of AI failures.
  • Use Case: When you need to add a new AI workflow eval or debug why an existing one is flaky, this Skill can automate the process and provide detailed insights.

Quick Start

Run the 'n8n:create-instance-ai-eval' skill to create a new AI workflow eval case for the 'packages/@n8n/instance-ai/evaluations/data/workflows/' directory.

Dependency Matrix

Required Modules

n8nlangtracerlangsmith

Components

scriptsreferences

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: n8n:create-instance-ai-eval
Download link: https://github.com/Rub-git/n8n-auto/archive/main.zip#n8n-create-instance-ai-eval

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.