hugging-face-evaluation

Extract evaluation tables from READMEs and generate model-index YAML for Hugging Face.

55|7|Updated Mar 2, 2026
One-click install
npx skills add https://github.com/wp931120/tiny_agent --skill hugging-face-evaluation-wp931120
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: hugging-face-evaluation
Source: https://github.com/wp931120/tiny_agent/tree/main/workspace/skills/hugging-face-evaluation
Command: npx skills add https://github.com/wp931120/tiny_agent --skill hugging-face-evaluation-wp931120

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires huggingface-hub, markdown-it-py, python-dotenv, pyyaml, requests, and includes scripts (resource) components.

What problem does it solve?

Hugging Face model cards often lack up-to-date, structured evaluation data. This skill provides an end-to-end workflow to extract evaluation results from READMEs and import external benchmarks, then commit them to model-index metadata.

Core Features & Use Cases

  • Read evaluation tables from READMEs and detect table formats (rows, columns, or transposed).
  • Import benchmark scores from External sources (Artificial Analysis) and merge with existing results.
  • Generate and push a model-index YAML payload to HuggingFace, with PR or direct updates for models you own or others.

Quick Start

Ask the agent to extract evaluation data from the model README and push updates to the model card.

Frequently Asked Questions about hugging-face-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I update Hugging Face model cards with evaluation metrics from a README file?

To update Hugging Face model cards with evaluation metrics, this skill automates reading README tables, detecting table formats like rows or transposed layouts, extracting numeric scores, and generating model-index YAML to push structured metadata directly to the model card.

Can I import external benchmarks into Hugging Face model-index metadata?

Yes, you can import external benchmarks into Hugging Face model-index metadata. This skill integrates scores from external sources like Artificial Analysis, merging them with existing README evaluation results before generating and pushing the YAML payload.

Does this skill support submitting pull requests for Hugging Face model card updates?

Yes, this skill supports submitting pull requests for Hugging Face model card updates. You can push model-index YAML updates via PR for models you own or others, or apply direct updates to models you manage.

What is the best way to automate extraction of numeric scores from markdown tables?

The best way to automate extraction of numeric scores from markdown tables is using this skill, which detects row, column, and transposed table formats in READMEs, extracts scores, and safeguards against duplicates during model-index YAML generation.

Are there safeguards against duplicate evaluation metrics when generating model-index YAML?

Yes, there are safeguards against duplicate evaluation metrics when generating model-index YAML. This skill implements validation and duplicate detection during the extraction and integration of benchmark results into Hugging Face model cards.