web-do

Community

CDP-based web data extraction to JSON

Authorhammercui
Version1.0.0
Installs0

System Documentation

What problem does it solve?

CDP网页数据提取需要稳定的浏览器会话和可重复的数据抓取流程,避免直接HTTP请求导致的反爬和数据不一致。

Core Features & Use Cases

  • 通过 CDP 连接到已开启远程调试端口的浏览器,提取页面 DOM/HTML,输出纯 JSON,供 Agent 分析。
  • 支持 JavaScript 渲染页面,确保动态内容可获取;可用于趋势、监控和数据收集场景。
  • 使用场景包括在已登录会话中抓取商品、文章或新闻等页面的结构化数据,并将结果传递给后续流程。

Quick Start

Open a browser with CDP on port 9222 and run the web-do extraction script against a target page to obtain JSON.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: web-do
Download link: https://github.com/hammercui/openclaw-install-cn/archive/main.zip#web-do

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.