skills.rest
sitammeur
sitammeurCOMMUNITY
Explore all skills by this author →
Website𝕏@sitammeurGitHub

brightdata-web-mcp

Automate web search and scraping via Bright Data MCP endpoints.

1|Updated Jan 22, 2026
Search Tags:#mcp#data-extraction#web-scraping#browser-automation#structured-data#brightdata#rapid-mode
One-click install
npx skills add https://github.com/sitammeur/ml-agent-skills --skill brightdata-web-mcp
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: brightdata-web-mcp
Source: https://github.com/sitammeur/ml-agent-skills/tree/main/skills/brightdata-web-mcp
Command: npx skills add https://github.com/sitammeur/ml-agent-skills --skill brightdata-web-mcp

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill provides reliable, bot-bypass web access and structured data retrieval for AI agents, enabling real-time scraping of protected or dynamic sites and extraction of data.

Core Features & Use Cases

  • Web search and page scraping using Bright Data MCP for resilient data collection.
  • Supports rapid (free) and pro modes, plus tool groupings or individual tools to collect structured data across ecommerce, social, and business domains.
  • Real-world scenario: fetch product details from retailer sites or gather company information from business directories with low latency and high reliability.

Quick Start

Quick-start steps:

  • Tool: search_engine Input: { "query": "AI news", "engine": "google" }
  • Tool: scrape_as_markdown Input: { "url": "https://example.com/article" }
  • Tool: extract Input: { "url": "https://example.com/product", "prompt": "Extract: name, price, availability" }

Frequently Asked Questions about brightdata-web-mcp

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from a dynamically loaded web page using an AI agent?▼

Web scraping for AI agents is automated using Bright Data MCP to bypass bot protection and extract structured data. You can use the scrape_as_markdown or extract tools to retrieve clean content and specific fields from dynamic or protected sites.

What is the best way to scrape product details from retailer sites without getting blocked?▼

The best way to scrape retailer sites without blocks is using a Bright Data MCP endpoint, which provides bot-bypass web access. It supports rapid and pro modes to fetch product details with low latency and high reliability.

Do I need an API token to configure Bright Data MCP for web scraping?▼

Yes, you need an API token to configure Bright Data MCP for web scraping. You must also set up an MCP endpoint, either by using a remote URL or configuring a local npx setup to enable the scraping tools.

Can I use web scraping tools to collect structured data across social and business domains?▼

Yes, you can collect structured data across social and business domains. The Skill supports tool groupings or individual tools like web_data_* to extract specific information from these domains using Bright Data MCP.

How do I perform a web search and scrape the results using Bright Data MCP?▼

To perform web search and scraping, use the search_engine tool with a query and engine choice, then pass the resulting URLs to the scrape_as_markdown tool. This workflow automates data collection via the Bright Data MCP endpoint.

Related Skills

Explore More Data & Analytics Skills→
patchy631patchy631
36.9k

brightdata-web-mcp

Fetch live web content and extract structured data via Bright Data MCP.

Community
Intermediate
pelcherspelchers

ingesting-academic-content

Parse academic PDFs, DOCX, Markdown, HTML, and web pages into structured JSON metadata and outlines.

Community
Advanced
SternrasslerSternrassler
1

Chrome DevTools MCP Skill

Automate browser interactions and testing via the Chrome DevTools MCP Server.

Official
Advanced
jiyangnanjiyangnan
2

kb-fetch

Fetch and extract readable text from URLs for knowledge base ingestion.

Community
Intermediate