web-extractor

Extract full visible text from dynamic JavaScript-rendered web pages.

4|1|Updated Feb 20, 2026
One-click install
npx skills add https://github.com/Touricks/fanshi_personal_skills --skill web-extractor
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: web-extractor
Source: https://github.com/Touricks/fanshi_personal_skills/tree/main/original/skills/web-extractor
Command: npx skills add https://github.com/Touricks/fanshi_personal_skills --skill web-extractor

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

Web pages increasingly render content via JavaScript and load content lazily, making simple text extraction brittle or incomplete. This skill provides reliable extraction of the full visible text from dynamic pages, even when behind authentication, using strategies that render, scroll, intercept API calls, or transcribe canvas content.

Core Features & Use Cases

  • Extracts text from dynamic, JS-rendered pages, SPAs, lazy-loaded sections, and canvas-based UIs.
  • Supports multiple extraction strategies: Simple DOM read, Lazy Load, Virtual Scroll, API Interception, and Canvas Transcription.
  • Produces a deduplicated, output-ready text suitable for downstream processing and analysis.
  • Use cases include scraping articles, dashboards, Notion/Google Docs-like docs, Confluence, and Unity WebGL/Canvas apps.

Quick Start

Navigate to the target web page, allow time for rendering, and invoke the extraction workflow to capture and compile the full visible text.

Frequently Asked Questions about web-extractor

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract text from dynamic JavaScript-rendered web pages?

You can extract text from dynamic JavaScript-rendered web pages using strategies like Simple DOM read, Lazy Load, Virtual Scroll, API Interception, and Canvas Transcription. These capture client-side rendered content and produce deduplicated, output-ready text.

What is the best way to scrape content from lazy-loaded sections and SPAs?

Scraping content from lazy-loaded sections and SPAs is best handled by extraction strategies that render, scroll through pages, intercept API calls, or transcribe canvas content. This approach captures the full visible text from client-side rendered sites.

Can I extract text from authentication-protected sites and dashboards?

Yes, you can extract text from authentication-protected sites and dashboards. The extraction workflow operates on the fully rendered page within your authenticated browser session to capture complete visible content, including long articles and dashboard data.

Does web scraping work with canvas-based text and Unity WebGL apps?

Yes, web scraping works with canvas-based text and Unity WebGL apps through a specific Canvas Transcription strategy. This technique captures text rendered directly to the canvas element, which standard DOM reading cannot access.

Why does simple text extraction fail on dynamic pages?

Simple text extraction fails on dynamic pages because web content is increasingly rendered via JavaScript and loaded lazily, making basic DOM reading brittle or incomplete. Advanced strategies intercept API calls or simulate scrolling to capture this delayed content.

How do I get started capturing complete web content from dynamic pages?

To get started capturing complete web content from dynamic pages, navigate to the target web page, allow time for JavaScript rendering, and invoke the extraction workflow. The system compiles the full visible text using the appropriate extraction strategy.