Patch failing CSS/XPath selectors in Scrapy spiders from improvement logs.
npx skills add https://github.com/jadecli/researchers --skill improve-spider
Please help me install this Agent Skill. Skill: improve-spider Source: https://github.com/jadecli/researchers/tree/main/claude-code/.claude/skills/improve-spider Command: npx skills add https://github.com/jadecli/researchers --skill improve-spider
Read accumulated improvement logs and patch the specified spider's selectors to improve extraction quality.
Run the skill against a target spider by supplying its name as an argument and verify improvements with a short Scrapy crawl.
High-intent search queries and answers about installing and using this skill.
Patch failing Scrapy spider selectors by reading accumulated JSONL improvement logs to identify failure patterns, then updating the target spider code with robust CSS and XPath fallbacks for higher extraction quality.
Scrapy spider extraction fails on noisy pages when CSS or XPath selectors break due to content-type mismatches and layout changes, requiring selector patching with resilient fallbacks to handle the structural variations.
Analyze improvement logs from JSONL files to extract failure patterns in broken CSS and XPath selectors, then apply those patterns to generate resilient selector patches for the target Scrapy spider code.
Yes, you can fix content-type mismatches in Scrapy spiders with multiple variants by reading the latest JSONL improvement logs, identifying failure patterns, and adding content-type extraction logic to the target spider.
Update Scrapy spiders by reading the latest improvement logs to detect failing selectors caused by layout changes, patching the spider code at the specified path with robust fallbacks, and validating with a short crawl.
Yes, you need accumulated JSONL improvement logs to identify failing selector patterns, as the patching process reads these logs to generate resilient CSS and XPath replacements for the target Scrapy spider.
jadecliGenerate an interactive HTML dashboard from crawl metrics JSONL files.
fgarofalo56Build custom Scrapy spiders to crawl websites and extract data.
wsbaserConstruct XCSS selectors from HTML markup and CSS/XPath for UnionInit attributes.
gizixGenerate Scrapy spider templates for static, dynamic, and API content.
