extraction

Extract structured funding opportunity fields from web pages and PDFs into a JSONB column.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/EnergySystemsGroup/Meridian-ESG --skill extraction-energysystemsgroup
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: extraction
Source: https://github.com/EnergySystemsGroup/Meridian-ESG/tree/main/.claude/skills/extraction
Command: npx skills add https://github.com/EnergySystemsGroup/Meridian-ESG --skill extraction-energysystemsgroup

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires fitz, playwright, curl, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the complex process of extracting and structuring crucial data from various funding opportunity sources, turning raw information into actionable intelligence.

Core Features & Use Cases

  • Automated Data Extraction: Fetches content from diverse URLs (web pages, PDFs) and extracts ~24 structured fields.
  • Change Detection: Computes a source hash to identify content modifications.
  • Source-Agnostic: Handles utilities, state agencies, municipalities, foundations, and federal sources uniformly.
  • Use Case: Automatically process a batch of new grant announcements from different government websites, extracting key details like funding type, award amounts, eligibility criteria, and deadlines into a structured database for easy searching and analysis.

Quick Start

Use the extraction skill to process pending records from the staging database and populate the extraction_data field.

Frequently Asked Questions about extraction

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from funding opportunity web pages and PDFs?

To extract structured data from funding opportunity web pages and PDFs, this skill automates fetching URL content and parsing approximately 24 fields into a JSONB column. It handles diverse governmental and non-governmental sources uniformly, storing raw content and computing a source hash for change detection.

Can I use web scraping and PDF parsing to automate grant data extraction from government sites?

Yes, you can automate grant data extraction from government sites using web scraping and PDF parsing. The skill processes pending records from a staging database, fetches content from diverse URLs, and extracts key details like funding type and deadlines into structured records for easy searching.

Does this data extraction skill detect content changes to previously processed funding announcements?

Yes, this data extraction skill detects content changes to previously processed funding announcements by computing a source hash for each record. This hash identifies content modifications, ensuring your structured database accurately reflects any updates to the raw information from the original source.

What is the best way to parse PDF documents for grant data without writing custom scrapers for each source?

The best way to parse PDF documents for grant data without custom scrapers is using a source-agnostic extraction skill. It uniformly handles utilities, state agencies, municipalities, foundations, and federal sources, extracting structured fields directly into a JSONB column for consistent analysis.

Do I need a staging database to process raw content into structured JSONB records?

Yes, you need a staging database to process raw content into structured JSONB records. The skill reads pending records from your staging database, extracts approximately 24 fields into the extraction_data field, stores the raw content, and updates the extraction status upon completion.

Why use Playwright and curl for web scraping instead of simple HTTP requests?

Using Playwright and curl for web scraping handles dynamic JavaScript rendering and static content retrieval across diverse funding sources. This approach accommodates various governmental and non-governmental entities, ensuring robust data extraction from complex web pages and PDF documents.