ad-experiment-design

Design, execute, and analyze autonomous driving safety experiments.

28|4|Updated Mar 25, 2026
One-click install
npx skills add https://github.com/RoboSafe-Lab/ad-safety-research-skills --skill ad-experiment-design
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ad-experiment-design
Source: https://github.com/RoboSafe-Lab/ad-safety-research-skills/tree/main/ad-experiment-design
Command: npx skills add https://github.com/RoboSafe-Lab/ad-safety-research-skills --skill ad-experiment-design

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires carla, sumo, commonroad, nuScenes, waymo, kitti, fars, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill streamlines the process of designing and analyzing experiments for autonomous driving safety research, providing tools for simulation studies, benchmark evaluations, and real-world testing.

Core Features & Use Cases

  • Simulation Platforms: Integration with CARLA, SUMO, CommonRoad, and other AD simulators for comprehensive simulation studies.
  • Real-World Datasets: Utilizes datasets like nuScenes, Waymo, KITTI, and FARS for robustness testing and safety evaluations.
  • Experiment Design Framework: Offers a structured approach to experiment design, including variable management, test matrix creation, and statistical analysis.

Quick Start

Run the design_experiment command with the required parameters: design_experiment --method variantA --environment wet_road --speed 60km/h.

Frequently Asked Questions about ad-experiment-design

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design autonomous driving safety experiments using simulation platforms?

You can design autonomous driving safety experiments by running the `design_experiment` command with parameters for method, environment, and speed. This framework manages simulation configurations, dataset selection, and statistical analysis.

What real-world datasets can I use for autonomous driving safety evaluations?

You can use real-world datasets like nuScenes, Waymo, KITTI, and FARS for robustness testing and safety evaluations. These datasets help validate autonomous driving models under diverse real-world conditions.

Does this experiment design framework work with CommonRoad and CARLA simulators?

Yes, the framework integrates with CommonRoad, CARLA, and SUMO for comprehensive simulation studies. It provides configuration tools to set up these AD simulators for autonomous driving safety research.

What statistical methods are available for analyzing autonomous driving safety experiments?

The framework provides structured statistical analysis methods for autonomous driving safety experiments, including variable management and test matrix creation. This ensures robust evaluation of simulation and real-world testing results.

How do I set up a test matrix for autonomous driving safety research?

You set up a test matrix by defining experiment variables like method, environment, and speed using the `design_experiment` command. This creates a structured approach for evaluating autonomous driving safety across different simulation and real-world scenarios.

Can I use FARS accident data for autonomous driving safety robustness testing?

Yes, you can utilize the FARS dataset alongside nuScenes, Waymo, and KITTI for robustness testing and safety evaluations. These real-world datasets help validate autonomous driving models against actual accident statistics.