scraping-tools

Extract clean content and structured data from web pages and PDFs.

Updated Mar 17, 2026
One-click install
npx skills add https://github.com/nurturev/gtm-engine --skill scraping-tools
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: scraping-tools
Source: https://github.com/nurturev/gtm-engine/tree/main/.claude/skills/scraping-tools
Command: npx skills add https://github.com/nurturev/gtm-engine --skill scraping-tools

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates extraction of clean content from web pages and structured data from pages, including JavaScript-rendered content and PDFs, reducing manual scraping time and inaccuracies.

Core Features & Use Cases

  • Scrape page content from URLs (including JS-rendered pages) with optional objectives and full-content output.
  • Perform structured extraction to pull named fields, tables, and key data, and run batch extracts on multiple URLs.
  • Process bulk URL batches with automatic batching and concurrency, across multiple providers for resilience.

Quick Start

Ask Claude Code to scrape a set of URLs and extract structured data from each page.

Frequently Asked Questions about scraping-tools

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from web pages that require JavaScript rendering?

You can extract structured data from JavaScript-rendered pages by applying web scraping techniques that execute page scripts before capturing the fully rendered HTML. This handles dynamic content, named fields, and tables from pages requiring client-side execution.

Can I scrape content from anti-bot protected websites?

Anti-bot protected web scraping bypasses site defenses to extract clean content and structured data. It applies resilient extraction techniques across multiple providers to retrieve named fields, tables, and key data from protected sources.

What is the best way to process bulk URL batches for data extraction?

Bulk URL batch processing extracts structured data from multiple web pages concurrently. It applies automatic batching and concurrency management across multiple providers to ensure resilient scraping and structured extraction from large sets of URLs.

How do I extract structured fields and tables from PDF documents?

PDF data extraction pulls structured content and named fields from PDF documents alongside standard web pages. It applies structured extraction techniques to capture tables and key data, reducing manual processing time and inaccuracies.

Does web scraping work for pulling specific named fields instead of full page content?

Structured web scraping extracts specific named fields and tables rather than full page content. It applies targeted extraction objectives to pull only the key data you define, reducing manual filtering and returning clean structured output.