researcher-research

Research public datasets and benchmarks to produce ranked source briefs for eval authoring.

Updated Mar 25, 2026
One-click install
npx skills add https://github.com/Tyler-R-Kendrick/copilot-auto-training --skill researcher-research-tyler-r-kendrick
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: researcher-research
Source: https://github.com/Tyler-R-Kendrick/copilot-auto-training/tree/main/skills/researcher-research
Command: npx skills add https://github.com/Tyler-R-Kendrick/copilot-auto-training --skill researcher-research-tyler-r-kendrick

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve? Authoring evaluation cases for prompts and skills often lacks grounded, trustworthy source material, leading to guessed or low-quality eval rows. This Skill researches public datasets, benchmarks, and documentation with a primary-source-first approach and delivers a standalone research brief before any eval synthesis begins. ## Core Features & Use Cases - Primary-source-first research plan: Builds a query plan tied to the prompt's task, placeholders, and scoring rule before searching, and asks for missing constraints instead of guessing. - Ranked source shortlist with approval bar: Scores candidates on authority, provenance, annotation quality, licensing, version stability, and contamination risk, and records explicit rejection reasons for weak sources. - Eval-authoring mapping notes: Maps approved source fields into prompt rows, expected outputs, optional files, and objective assertions, with a stop recommendation when no source clears the bar. - Use Case: Given a support-ticket classification prompt, the Skill derives the target evals/evals.json layout, shortlists official intent-classification datasets with license notes, rejects derivative mirrors, and hands off mapping guidance for downstream eval authoring. ## Quick Start Research grounded public datasets and benchmarks for the prompt at skills/researcher-research/evals/files/support_intent_prompt.md and return a ranked primary-source shortlist with licensing notes and eval mapping guidance.

Frequently Asked Questions about researcher-research

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find public datasets for authoring prompt eval cases?

Provide the prompt file, a task description, and a scoring rule, and the Skill builds a primary-source-first query plan, then returns a ranked shortlist of official datasets and benchmarks with provenance, licensing, and fit notes.

What makes a dataset source acceptable for eval authoring?

A source must have an accountable maintainer or publisher, traceable data origin and label definitions, explicit licensing, a stable version or release date, and acceptable contamination, privacy, and bias risk. Sources failing this bar are recorded as rejected leads.

Does this Skill generate the eval rows itself?

No. It stops at research and mapping notes that show how approved source fields become prompt rows, expected outputs, files, and assertions. A separate synthesis workflow converts the brief into evals/evals.json entries.

What happens when no suitable public dataset exists?

The Skill explicitly reports that no candidate cleared the approval bar and explains what evidence is missing, rather than forcing a weak recommendation. This signals the workflow to stop instead of guessing eval data.

What inputs are required before research starts?

It needs the target prompt file, a short task description, and the expected answer format or scoring rule. Optional constraints like domain, language, licensing, recency, and label taxonomy are elicited when they materially affect source selection.