skills.rest
yfe404yfe404Community·1 Agent Skills Included

web-scraper

Adaptive website reconnaissance, data extraction, and Apify deployment

Scrapes any website by automatically choosing the fastest strategy: traffic interception, sitemaps, hidden APIs, or browser rendering. Detects site frameworks, bypasses bot protection, and validates every selector and endpoint before reporting. Converts working scrapers into production-ready TypeScript Apify Actors with guided deployment.
80|18
↗
npx skills add yfe404/web-scraper --all -g -y

All Skills in This Repository (1)

Pure Emerald Level Indicators
📦 In Repo
yfe404yfe404

web-scraping

Automate web-scraping strategy discovery and iterative implementation toward Apify Actors.

Community
Advanced

Frequently Asked Questions

FAQPage Schema
How to install web-scraper?▼

Run `npx skills add yfe404/web-scraper --all -g -y` in your terminal to install the skill globally.

How does it choose the best scraping strategy?▼

It starts with a cheap curl request, checks sitemaps and hidden APIs, and only launches a stealth browser when the data is missing from raw HTML.

Can it bypass Cloudflare and bot blocking?▼

Yes. It includes stealth browser mode, human-like interactions, TLS fingerprinting, and proxy escalation to handle 403 errors and anti-bot protections.

Can I turn my scraper into an Apify Actor?▼

Yes. It guides you through TypeScript-first Actor creation using the apify create command, template selection, input schemas, and deployment.

Do I need coding experience to use it?▼

No. Just describe the site and data you want in plain English, and the agent runs the reconnaissance, validation, and implementation steps for you.

Related Repositories in Data & Analytics

View All in Data & Analytics→
PaddlePaddlePaddlePaddle
87.3k

PaddleOCR

Extract text, tables, and formulas from PDFs and images

Official📦 2 Skills
D4VinciD4Vinci
73.3k

Scrapling

Scrape any website and bypass anti-bot protection with AI

Community📦 1 Skills
mvanhornmvanhorn
60.8k

last30days-skill

Research any topic across Reddit, X, YouTube, and the web

Community📦 2 Skills