Render JavaScript-heavy pages in a headless browser and extract text, HTML, links, or JSON.
npx skills add https://github.com/gbencke/dotfiles --skill obscura
Please help me install this Agent Skill. Skill: obscura Source: https://github.com/gbencke/dotfiles/tree/main/pi/skills/obscura Command: npx skills add https://github.com/gbencke/dotfiles --skill obscura
This Skill helps you reliably extract content from web pages and automate browser interactions when sites render dynamic JavaScript or use bot protections.
Run: obscura fetch https://example.com --quiet --dump text
High-intent search queries and answers about installing and using this skill.
To scrape JavaScript-rendered web pages, you need a headless browser to execute the dynamic scripts and extract the fully rendered DOM. This approach waits for network idle conditions or specific selectors before capturing the final page content.
The best way to extract structured data from multiple URLs is through parallel multi-URL scraping, which fetches pages concurrently and evaluates DOM expressions using selectors to produce structured JSON outputs for downstream analysis.
Stealth mode helps reduce detection by common anti-bot systems during headless browser automation. It masks automated browser fingerprints, allowing web scraping tasks to better handle sites with basic bot protections.
Yes, you can wait for a specific DOM selector before extracting web content. The headless browser supports dynamic waiting conditions, allowing scraping to pause until the required element renders on the page.
You can get plain text or HTML output from a headless browser fetch by specifying the desired output format. The extraction supports dumping the rendered page as text, raw HTML, extracted links, or structured JSON.
thomasmolAutomate browser navigation, form filling, screenshots, and data extraction.
profmikegreeneParses pilot plans and hypotheses into structured JSON or tabular data for downstream analysis.
AubreyHanGenerate and update Google Cloud Composer orchestration YAML for data pipelines.
Z43LExtract web content from static, dynamic, and Cloudflare-protected pages.
