extract-eval-properties

To assess AI eval porting feasibility for Inspect, generate a structured template that evaluates effort, infrastructure, and risk. This produces a concise summary highlighting top blockers and mitigation ideas to guide your migration.

YAML metadata for Inspect porting includes costs, infrastructure requirements, objective compliance, and citations. Generating this YAML involves compiling artifacts and references from papers and repositories to ensure accurate documentation.

You can provide optional links alongside a target eval name to research references for Inspect eval porting. The system gathers artifacts from these sources to fill the feasibility template and generate YAML with proper citations.

Providing papers and repos is optional but recommended to generate an accurate Inspect porting feasibility assessment. Supplying the eval name alone starts the process, while references and artifacts improve citation quality and template completion.