py-fetch

Fetch web content and save it as Markdown, escalating to scrapling for dynamic or protected pages.

Updated Apr 6, 2026
One-click install
npx skills add https://github.com/fantay0312/fantayspec --skill py-fetch
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: py-fetch
Source: https://github.com/fantay0312/fantayspec/tree/main/shared/skills/skills-all/py-fetch
Command: npx skills add https://github.com/fantay0312/fantayspec --skill py-fetch

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Unified fetch and scraping workflow that saves content to Markdown by default, while automatically escalating to advanced scraping when pages are dynamic, login-protected, or protected by anti-bot measures.

Core Features & Use Cases

  • Fetch a URL, local HTML, or batch pages and save as Markdown for offline reading or archiving.
  • Escalate to scrapling for dynamic rendering, login-required sites, or Cloudflare/WAF-protected content.
  • Output defaults to ~/Downloads/{filename}.md with optional naming and reporting of the final path.

Quick Start

Provide a target URL or local HTML to fetch and save the content as Markdown.

Frequently Asked Questions about py-fetch

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I save web page content as Markdown for offline reading?

To save web content as Markdown, you provide a target URL or local HTML file to fetch and convert. The Skill outputs the extracted content to a local Markdown file by default, reporting the final output path and the strategy used.

Can I scrape dynamic web pages that require JavaScript rendering?

Yes, you can scrape dynamic web pages by escalating to scrapling for JS rendering. The Skill automatically applies this advanced scraping technique when pages are detected as dynamic or login-protected during the fetching process.

What is the best way to fetch content from Cloudflare or WAF-protected sites?

The best way to fetch from Cloudflare or WAF-protected sites is using scrapling escalation. The Skill automatically triggers this selector-based extraction method when standard fetching encounters anti-bot protection measures.

Do I need scrapling to extract static HTML pages to Markdown?

No, you do not need scrapling to extract static HTML pages to Markdown. The Skill handles standard static fetching natively, only requiring the scrapling dependency for dynamic rendering, login-required sites, and WAF-protected content.

How to extract multiple URLs into Markdown files in a batch?

To extract multiple URLs into Markdown files in a batch, you provide a list of targets to the Skill. It processes the batch pages and saves the output locally, handling static, dynamic, and protected extractions while reporting each output path.