skills.rest
kaiye
kaiyeCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

page-fetcher

Fetch static and SPA web pages with cookie synchronization via Puppeteer and Cloudflare KV.

18|4|Updated Jan 13, 2026
Search Tags:#web scraping#puppeteer#web automation#cloudflare kv#cookie management#http fetch
One-click install
npx skills add https://github.com/kaiye/skills --skill page-fetcher
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: page-fetcher
Source: https://github.com/kaiye/skills/tree/main/page-fetcher
Command: npx skills add https://github.com/kaiye/skills --skill page-fetcher

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires puppeteer-core, html2md4llm, zod, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill simplifies web scraping and page retrieval by automating browser interactions with cookie handling.

Core Features & Use Cases

  • Web Page Downloading: Fetches static and dynamically generated web pages using lightweight HTTP or Puppeteer.
  • Cookie Synchronization: Manages cookies via Sync Your Cookie extension, local files, and Cloudflare KV, ensuring accurate session data.
  • Use Case: Automate data collection from login-protected sites by maintaining session cookies and rendering client-side content.

Quick Start

Use the page-fetcher skill to download a webpage, saving the content as Markdown for further analysis.

Frequently Asked Questions about page-fetcher

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate web scraping with cookie management for login-protected sites?▼

Automate web scraping with cookie management by synchronizing session data via Cloudflare KV and local files, enabling authenticated page retrieval. This ensures accurate session rendering when fetching content from protected sites.

Can I use Puppeteer to fetch dynamically generated SPA content?▼

Puppeteer fetches dynamically generated SPA content by rendering client-side JavaScript during web automation. This approach captures fully loaded page structures that lightweight HTTP requests cannot execute.

What is the best way to convert fetched HTML web pages to Markdown for analysis?▼

The best way to convert fetched HTML web pages to Markdown is using integrated extraction libraries. This Skill automatically transforms downloaded static and SPA content into Markdown for immediate analysis.

Does web page downloading with Puppeteer require Cloudflare KV integration?▼

Full functionality for web page downloading requires Cloudflare KV integration to manage and synchronize cookies. This setup ensures persistent session data across multiple automated retrieval tasks.

Why does HTTP fetch fail to retrieve content from single page applications?▼

HTTP fetch fails to retrieve SPA content because lightweight requests cannot execute client-side JavaScript. Puppeteer is required to render the dynamic DOM elements before extracting the page content.

Do I need the Sync Your Cookie extension to maintain session cookies during web automation?▼

You need the Sync Your Cookie extension to maintain session cookies during web automation by exporting current browser state. This synchronizes local files with Cloudflare KV for accurate authenticated requests.

Related Skills

Explore More Software Engineering Skills→
mpazarynampazaryna
1

kv

Manage Cloudflare KV namespaces, key-value operations, and TTL settings.

Community
Intermediate
beyonaibeyonai
45

article-enrichment

Transform raw article text into structured brain pages with summaries and quotes.

Community
Advanced
zephyrwang6zephyrwang6
333

web-scraper

Fetch web page content and convert HTML to clean Markdown.

Community
Intermediate
zhayujiezhayujie
46.4k

web-fetch

Fetch web page HTML and extract title and readable text.

Community
Basic