Scaffold LLM evaluation suite packages with Playwright configuration files.
npx skills add https://github.com/elastic/kibana --skill evals-create-suite
Please help me install this Agent Skill. Skill: evals-create-suite Source: https://github.com/elastic/kibana/tree/main/.agents/skills/evals-create-suite Command: npx skills add https://github.com/elastic/kibana --skill evals-create-suite
This Skill automates the setup of new LLM evaluation suites, ensuring consistent project structure and boilerplate code.
playwright.config.ts, package.json, kibana.jsonc, tsconfig.json), and basic evaluate.ts re-exports.playwright.config.ts in the package root, avoiding Scout CI discovery issues.Use the evals-create-suite skill to scaffold a new eval suite named 'my-new-eval' in the 'x-pack/solutions/ai' directory.
High-intent search queries and answers about installing and using this skill.
Scaffolding a new LLM evaluation suite generates directories, configuration files like playwright.config.ts, package.json, and evaluation fixtures to provide consistent boilerplate for offline LLM evaluations.
The best way to set up boilerplate for offline LLM evaluations is using an automated scaffolding process that creates package files and evaluation fixtures, ensuring correct project structure and consistent configuration across new eval suites.
Yes, creating an eval package for plugins requires specific inputs including the suite name, parent directory, owner, group, visibility settings, and any custom fixture needs to correctly configure the generated package files.
Playwright configuration must be in the package root to avoid Scout CI discovery issues, ensuring the evaluation suite is correctly identified and executed during continuous integration testing workflows.
Yes, you can specify custom fixture needs when creating an LLM eval suite, allowing the scaffolding process to generate tailored evaluation fixtures alongside the standard package configuration files.
blueif16Create slash command files and initialize plugin structure in Claude plugins.
elasticGenerates Scout test scaffolds for Kibana plugins and packages.
LeszekDNVAutomate project setup and dependency installation from predefined tech stacks.
zhangzhang-111-iGenerate Jest, React Testing Library, and Playwright tests for React/Next.js applications.