web-do
CommunityCDP-based web data extraction to JSON
Software Engineering#cdp#data-extraction#web-scraping#browser-automation#json-output#openclaw#javascript-rendering
Authorhammercui
Version1.0.0
Installs0
System Documentation
What problem does it solve?
CDP网页数据提取需要稳定的浏览器会话和可重复的数据抓取流程,避免直接HTTP请求导致的反爬和数据不一致。
Core Features & Use Cases
- 通过 CDP 连接到已开启远程调试端口的浏览器,提取页面 DOM/HTML,输出纯 JSON,供 Agent 分析。
- 支持 JavaScript 渲染页面,确保动态内容可获取;可用于趋势、监控和数据收集场景。
- 使用场景包括在已登录会话中抓取商品、文章或新闻等页面的结构化数据,并将结果传递给后续流程。
Quick Start
Open a browser with CDP on port 9222 and run the web-do extraction script against a target page to obtain JSON.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: web-do Download link: https://github.com/hammercui/openclaw-install-cn/archive/main.zip#web-do Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.