skills.rest
eugene-belkovich
eugene-belkovichCOMMUNITY
Explore all skills by this author →
GitHub

eval-wallet-validator

Validate eval YAML wallet_address and portfolio_id fields against test requirements.

Updated Aug 23, 2026
Search Tags:#validation#audit#llm#reporting#yaml#wallets#portfolios
One-click install
npx skills add https://github.com/eugene-belkovich/ai-setup --skill eval-wallet-validator
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: eval-wallet-validator
Source: https://github.com/eugene-belkovich/ai-setup/tree/main/claude/profiles/work/skills/evals/eval-wallet-validator
Command: npx skills add https://github.com/eugene-belkovich/ai-setup --skill eval-wallet-validator

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

Auditors and data teams struggle to ensure eval YAML configurations link to wallets that satisfy test requirements, risking mismatches and failed evaluations.

Core Features & Use Cases

  • Wallet-usage validation: verify that wallet_address and portfolio_id fields align with test requirements.
  • Inference and matching: leverage inference to determine required wallet characteristics and, if mismatches exist, search for suitable wallets.
  • Audit-ready outputs: generate markdown reports and update plans to fix detected issues for governance.

Quick Start

Run the validator against all eval YAML files to identify wallet mismatches and generate an audit report.

Frequently Asked Questions about eval-wallet-validator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate eval YAML wallet configurations for test alignment?▼

To validate eval YAML wallet configurations, identify the files and extract wallet_address and portfolio_id fields. The validator applies inference to determine required wallet characteristics, compares them with actual state, and searches the production database for alternatives if mismatches exist.

What is the best way to audit wallet usage in LLM eval configurations?▼

Auditing wallet usage in LLM eval configurations involves verifying that wallet_address and portfolio_id fields satisfy test requirements. The validator assesses actual wallet state against inferred requirements and generates an audit-ready markdown report with findings and recommended fixes.

How does inference work for matching eval wallets to test requirements?▼

Inference for matching eval wallets determines the required wallet characteristics from test configurations. It compares these inferred requirements against the actual wallet state to detect mismatches, then searches the production database for suitable replacement wallets.

Can I generate an audit report for eval YAML wallet mismatches?▼

Yes, you can generate an audit report for eval YAML wallet mismatches. The validator produces an audit-ready markdown report detailing findings, recommended fixes, and an actionable update plan to correct wallet_address and portfolio_id misalignments.

What happens when wallet_address and portfolio_id fields do not match test requirements?▼

When wallet_address and portfolio_id fields do not match test requirements, the validator detects the mismatches and searches the production database for alternative wallets. It then documents the issues and provides an actionable update plan in a markdown report.

Related Skills

Explore More Data & Analytics Skills→
xdgxdg
20

yq

Extract specific fields from large YAML files using yq syntax.

Community
Intermediate
runecalico-airunecalico-ai

writing-plans

Generate detailed implementation plans for multi-step software development tasks.

Community
Intermediate
GemachDAOGemachDAO
4

gdex-wallet-setup

Generate EVM control wallets offline and create session keypairs.

Official
Intermediate
trymiraitrymirai
1.7k

validate-inference

Validates inference outputs by comparing them with reference results via Rust cargo test harness.

Official
Intermediate