Build Python web scrapers with requests, BeautifulSoup, and Selenium.
npx skills add https://github.com/booklib-ai/skills --skill web-scraping-python
Please help me install this Agent Skill. Skill: web-scraping-python Source: https://github.com/booklib-ai/skills/tree/main/skills/web-scraping-python Command: npx skills add https://github.com/booklib-ai/skills --skill web-scraping-python
Web scraping often requires robust patterns to reliably fetch, parse, and store data from diverse sites without breaking on layout changes.
Run the generated template scraper and edit the parse() function to adapt to your target site.
High-intent search queries and answers about installing and using this skill.
Build a Python web scraper with production-ready features like rate limiting, robots.txt respect, session handling, and retry logic to reliably fetch and parse data across multi-page crawls without getting blocked.
Scrape dynamic content and login-protected pages using Python by implementing session handling and defensive parsing with libraries like requests and Selenium to fetch and store structured data.
Parse HTML with BeautifulSoup using defensive CSS selectors to extract data robustly, preventing scrapers from breaking when target websites experience unexpected layout changes.
Crawl multi-page product catalogs using Python and store the extracted structured data directly to CSV files or databases by implementing a parse() function within a template scraper.
This Python web scraping approach works with API-backed endpoints, allowing you to fetch, parse, and store data from dynamic content and API responses using requests and urllib3.
If your Python web scraper fails during a multi-page crawl, implement retry logic and session reuse to handle errors gracefully and resume fetching data reliably across single-domain sites.
BenAIOSAudit a single web page's SEO elements, schema, and performance.
aws-samplesProcess and analyze CSV, JSON, and text data files with automated cleaning and transformation.
TouricksExtract full visible text from dynamic JavaScript-rendered web pages.
vm0-aiScrape websites and extract data using the Firecrawl API.
