skills.rest
0xMassi0xMassiCommunity·1 Agent Skills Included

webclaw

Turn any website into clean markdown, JSON, and AI-ready data

Extracts clean markdown, structured JSON, and LLM-ready text from any URL, PDF, or document. Removes ads, navigation, and boilerplate so agents get usable content instead of raw HTML. Crawls documentation sites, tracks page changes over time, and pulls brand assets like colors and logos. Connects to Claude, Cursor, and other AI tools through a built-in MCP server.
2,123|213
↗
npx skills add 0xMassi/webclaw --all -g -y
Available:

Explains the workspace architecture and hard rules so the AI agent knows which extraction, fetching, and MCP modules to use when handling web scraping requests.

All Skills in This Repository (1)

Pure Emerald Level Indicators
📦 In Repo
0xMassi0xMassi

webclaw

Extract text, metadata, and structured data from web pages into Markdown and JSON.

Community
Advanced

Frequently Asked Questions

FAQPage Schema
How to install webclaw?▼

Run `npx skills add 0xMassi/webclaw --all -g -y` in your terminal to install the full suite globally for your AI agent.

How to turn a webpage into clean markdown?▼

Point webclaw at any URL and it strips ads, navigation, and boilerplate, returning clean markdown, text, or JSON ready for AI tools and RAG pipelines.

Does webclaw work with Claude and Cursor?▼

Yes. It ships with an MCP server that gives Claude Code, Claude Desktop, Cursor, and other MCP clients native scrape, crawl, search, and summarize tools.

Can webclaw scrape JavaScript-heavy or protected sites?▼

Most sites extract locally with no API key, and the optional hosted API handles JavaScript rendering and bot-protected pages when needed.

Can I use webclaw without coding experience?▼

Yes. Once installed, you simply ask your AI agent in plain English to scrape, crawl, or summarize pages and it runs the right tool for you.

Related Repositories in Data & Analytics

View All in Data & Analytics→
PaddlePaddlePaddlePaddle
87.3k

PaddleOCR

Extract text, tables, and formulas from PDFs and images

Official📦 2 Skills
D4VinciD4Vinci
73.3k

Scrapling

Scrape any website and bypass anti-bot protection with AI

Community📦 1 Skills
mvanhornmvanhorn
60.8k

last30days-skill

Research any topic across Reddit, X, YouTube, and the web

Community📦 2 Skills