upload-method

Processes, uploads, and registers benchmarked method results as hosted TabArena artifacts.

313|74|Updated May 15, 2023
One-click install
npx skills add https://github.com/autogluon/tabarena --skill upload-method-autogluon
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: upload-method
Source: https://github.com/autogluon/tabarena/tree/main/.claude/skills/upload-method
Command: npx skills add https://github.com/autogluon/tabarena --skill upload-method-autogluon

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Turning a finished TabArena benchmark run's raw results.pkl files into cached, hosted (R2), and leaderboard-registered artifacts is a multi-step maintainer workflow involving metadata edits, validation, uploads, and registration that is easy to get wrong. ## Core Features & Use Cases - Inspect and validate raw results: Infers method metadata fields from raw run data and diffs them against the method's info.py MethodMetadata before processing. - Process and upload to R2: Builds and caches metadata.yaml, processed/, and results/ artifacts locally, then pushes them to the R2 bucket after a dry-run verification. - Register and log the method: Edits info.py upload fields, registers the method in the arena's methods.py collection, and records the run in BENCHMARK_LOG.md. - Use Case: A maintainer finishes benchmarking a new model like ChimeraBoost and asks to upload it; the skill inspects the run data, fixes metadata mismatches, processes and uploads the artifacts to R2, and registers the method so it appears in the benchmark. ## Quick Start Process and upload the benchmark results in output/benchmark_chimeraboost_16062026/data for the chimeraboost model and register it in the tabarena arena.

Frequently Asked Questions about upload-method

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I upload benchmark results to TabArena?

Point the skill at the run's data directory containing raw results.pkl files. It inspects the data, fixes the method's info.py metadata, runs run_process_method.py to build cached artifacts, then uploads them to R2 with run_upload_results.py after a dry-run.

How do I register a new model in the TabArena leaderboard?

After uploading, the skill edits the arena's methods.py to import the model's MethodMetadata and add it to the method_metadata_lst collection. The method only becomes downloadable for others once the real R2 upload has completed.

What credentials are needed for the R2 upload?

The real upload requires R2_ACCOUNT_ID, R2_ACCESS_KEY_ID, and R2_SECRET_ACCESS_KEY set as environment variables. They must never be passed as CLI flags, since that would leak them into shell history and the process table.

Why does processing fail with a metadata mismatch error?

Processing verifies info.py against the raw data and fails on mismatches in config_default, ag_key, compute, can_hpo, is_bag, or method_type. A common cause is config_default missing the post-rename _default infix; update info.py to the inferred value shown in the inspect diff.

Can I upload a run containing multiple methods at once?

run_process_method.py cannot split multi-method data directories directly. Write a small driver script that discovers the results.pkl paths, splits them by config-dir prefix, and calls the processing functions per method.