cdp-browser-automation

Automate browser navigation, input, and data extraction via Chrome DevTools Protocol.

4|Updated Mar 16, 2018

Search Tags:#python #cdp #web-scraping #web-automation #chrome-devtools #browser-automation

Ready to run

npx skills add https://github.com/InNoobWeTrust/dotfiles --skill cdp-browser-automation

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: cdp-browser-automation
Source: https://github.com/InNoobWeTrust/dotfiles/tree/main/.agents/skills/cdp-browser-automation
Command: npx skills add https://github.com/InNoobWeTrust/dotfiles --skill cdp-browser-automation

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill provides direct, scriptable control of a browser via the Chrome DevTools Protocol, enabling automation, scraping, and testing without external services or subscriptions.

Core Features & Use Cases

Direct browser control via CDP: navigate, click, type, capture screenshots, and inspect page state with a minimal Python CDP client.
Robust handling of modern web apps: support for iframes, Shadow DOM, dialogs, and dynamic content with explicit wait patterns and stable navigation loops.
No dependencies on external services: run locally with a running Chrome instance and a small websocket client, using Python + websockets + httpx.
Knowledge-system driven: maintain universal and domain knowledge in references to improve repeatability and reduce rediscovery.

Quick Start

Install the required Python packages websockets and httpx, start Chrome with a remote debugging port, and run the CDP client to connect and automate.

Frequently Asked Questions about cdp-browser-automation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate web scraping without external services or dependencies?▼

You can automate web scraping directly via the Chrome DevTools Protocol using a minimal Python client. This approach drives navigation and data extraction locally without relying on external services or subscriptions.

Does browser automation via CDP support Shadow DOM and iframes?▼

Yes, browser automation via CDP supports robust handling of modern web apps. It explicitly manages iframes, Shadow DOM, dialogs, and dynamic content using stable navigation loops and explicit wait patterns.

What do I need to set up Chrome DevTools Protocol automation in Python?▼

To set up CDP automation in Python, you need to install the websockets and httpx packages, start Chrome with a remote debugging port, and connect your Python CDP client to drive the browser.

How do I handle dynamic content and page load waits during browser automation?▼

You handle dynamic content using explicit wait patterns enforced by the CDP client. These patterns ensure stable navigation loops and robust error handling when automating interactions across changing page states.

What is the best way to scrape interactive web pages without heavy dependencies?▼

The best way to scrape interactive pages without heavy dependencies is using direct browser control via CDP. It provides scriptable navigation, input, and data extraction using only Python, websockets, and httpx.

Are there limitations when using a minimal Python CDP client for testing?▼

When using a minimal Python CDP client for testing, limitations may arise from site-specific quirks. The skill mitigates this by maintaining universal and domain knowledge references to improve repeatability and reduce rediscovery.