Generate promptfoo YAML, bash test scripts, or VHS .tape files from conversations.
npx skills add https://github.com/troylar/anteroom --skill create-eval-troylar
Please help me install this Agent Skill. Skill: create-eval Source: https://github.com/troylar/anteroom/tree/main/src/anteroom/cli/default_skills/create-eval Command: npx skills add https://github.com/troylar/anteroom --skill create-eval-troylar
Turn informal descriptions or chat conversations into repeatable, deterministic tests and demo recordings so teams can verify AI behavior and reproduce interactions reliably.
Create a promptfoo eval that verifies the assistant used read_file when summarizing the project's README.
High-intent search queries and answers about installing and using this skill.
To convert chat transcripts into promptfoo evals, you can generate promptfoo YAML configurations from natural-language descriptions or existing conversation logs, using an exec provider that runs aroom exec --json for deterministic behavioral checks.
Yes, you can create deterministic shell test scripts from natural language by generating bash scripts that run aroom exec with deterministic flags and perform structural assertions on exit codes and tool usage.
The best way to record terminal demos from conversation prompts is by producing VHS .tape files that replay the interactions as terminal recordings for onboarding or demonstration purposes.
To verify if an AI assistant used read_file before editing, you can convert the problematic conversation into a promptfoo YAML that includes structural assertions validating tool usage, and run it in CI to catch regressions.
Yes, this approach works for catching AI regressions in CI pipelines by converting extracted conversation prompts into deterministic regression tests and reproducible terminal demos for local and CI verification.
rlesniakTranslate natural language budgeting descriptions into syntax for budgeting tools.
juspayRecord terminal sessions from .tape scripts and render them as GIFs.
gerald-icaAutomate creation and maintenance of promptfoo evaluation suites, prompts, tests, assertions, and provider configurations.
invowkExecute VHS tapes to verify invowk TUI components via screenshots.
