robotics-experiment-evaluation

Design robotics and embodied-AI experiment evaluation protocols with metrics and reporting rules.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/yuewangg/agent-research-skills --skill robotics-experiment-evaluation
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: robotics-experiment-evaluation
Source: https://github.com/yuewangg/agent-research-skills/tree/main/skills/robotics-experiment-evaluation
Command: npx skills add https://github.com/yuewangg/agent-research-skills --skill robotics-experiment-evaluation

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill helps you design and present evaluation experiments so your robotics and embodied-AI paper’s claims are supported by measurable, fair, and reproducible results.

Core Features & Use Cases

  • Claim-to-experiment mapping: translate each claimed module or contribution into at least one direct experiment or diagnostic rather than relying on overall system performance.
  • Metric protocol coverage: choose appropriate metric families for VLN/navigation, SLAM/state estimation, and control/RL, including APE/RPE, SPL, success and collision rates, runtime, and ablations.
  • Fairness and statistical reporting: ensure consistent splits, modality parity, budget parity, correct handling of failures/crashes/timeouts, and clear guidance on seeds, confidence intervals, and significance wording.
  • Paper-ready reporting rules: produce LaTeX-ready tables/figures guidance with explicit measurement scope, episode counts, and simulation-vs-hardware labeling.

Quick Start

Use this skill to generate a complete experiment-and-metrics plan for a robotics paper by providing your paper’s claims, target tasks (e.g., VLN/SLAM/control), and available hardware/simulator setup, then ask it to output an evaluation design that includes baselines, metrics, ablations, run counts, and reporting rules.

Frequently Asked Questions about robotics-experiment-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I map robotics paper claims to concrete experiments and metrics?

Design robotics evaluation metrics by selecting appropriate metric families for your task, including APE/RPE for SLAM, SPL and success rates for VLN, and runtime measurements. Ensure protocols cover dataset splits, modality parity, and run counts.

What statistics do I need for reproducible embodied-AI evaluation?

Generate paper-ready reporting rules by producing LaTeX-ready tables and figures guidance with explicit measurement scope, episode counts, and simulation-vs-hardware labeling. This ensures your robotics experiments meet rigorous publication standards.

How do I design ablation studies for robot learning and control papers?

Design ablation studies by mapping each claimed contribution to specific diagnostic experiments under modality and budget parity. Include baseline comparisons, failure counting rules, and runtime resource reporting to validate individual module performance.

Does this evaluation approach work for both navigation and SLAM state estimation?

Evaluation protocol coverage includes dataset and split details, modality and budget parity, run and seed counts with statistics, failure counting rules, and runtime resource reporting. These elements ensure fair and reproducible robotics experiment design.