data-research

Convert research inputs into structured, deduplicated tracker entries with raw-source archiving.

Updated Apr 23, 2026
One-click install
npx skills add https://github.com/ngochuy13/intern-dev --skill data-research-ngochuy13
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-research
Source: https://github.com/ngochuy13/intern-dev/tree/main/skills/data-research
Command: npx skills add https://github.com/ngochuy13/intern-dev --skill data-research-ngochuy13

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill eliminates the manual effort of finding sources, extracting structured fields, and updating canonical tracker pages by turning messy inputs (email, web, APIs, and attachments) into consistent, deduplicated records with raw-source archiving.

Core Features & Use Cases

  • Structured research pipeline: searches sources, classifies items, extracts structured data, archives raw inputs, deduplicates results, and updates canonical tracker pages with backlinks.
  • Parameterized recipes: drives investor updates, donations, and company metrics (or any email-to-structured-data workflow) via YAML recipes for queries, classification rules, extraction schemas, and tracker formatting.
  • Extraction integrity guardrails: saves raw sources first, re-reads saved files during summarization to avoid hallucination/batch-processing errors, and ensures every tracker entry links back to its raw source.

Quick Start

Tell the system to run a research job for investor updates by using the built-in investor-updates recipe and updating the canonical tracker with deduplicated extracted metrics.

Frequently Asked Questions about data-research

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from emails and update a tracker automatically?

To extract structured data from emails and update a tracker, use parameterized YAML recipes to define search queries, classification rules, and extraction schemas. The pipeline searches sources, extracts fields, archives raw inputs, deduplicates results, and backlinks entries to a canonical tracker page.

How does deduplication work when consolidating company metrics from multiple sources?

Deduplication during company metric consolidation applies predefined rules within YAML recipes to identify and merge overlapping records from web, API, or attachment sources. This ensures only canonical, unique entries populate the final structured tracker without redundant data points.

What's the best way to prevent hallucination when extracting data from document attachments?

To prevent hallucination during data extraction from document attachments, the system saves raw source files first and re-reads those archived files during the summarization phase. This deterministic-first parsing approach with LLM fallback ensures strict extraction integrity.

Can I use YAML recipes to automate investor update tracking from scattered sources?

Yes, you can automate investor update tracking by configuring built-in YAML recipes. These recipes drive the structured research pipeline to search inputs, classify items, extract relevant metrics, and push deduplicated updates directly to your canonical tracker pages.

How to archive raw inputs and backlink them to a canonical tracker page?

To archive raw inputs and backlink them, the research pipeline saves source files locally before extraction. Once structured data is extracted and deduplicated, every resulting tracker entry is automatically backlinked to its original archived raw source file.

Does this data extraction approach work with API responses and web pages?

Yes, this data extraction approach works with API responses, web pages, emails, and document attachments. The pipeline applies deterministic-first parsing with an LLM fallback to classify items and extract structured fields across all these input types.