skills.rest
Decodo
DecodoOFFICIAL
Explore all skills by this author →
WebsiteGitHub

decodo-scraper

Retrieve structured web data from Google, Amazon, YouTube, and Reddit via the Decodo API.

151|4|Updated Feb 12, 2026
Search Tags:#data extraction#web scraping#google search#llm integration#youtube transcripts#amazon scraping#reddit scraping
One-click install
npx skills add https://github.com/Decodo/decodo-openclaw-skill --skill decodo-scraper
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: decodo-scraper
Source: https://github.com/Decodo/decodo-openclaw-skill/tree/main
Command: npx skills add https://github.com/Decodo/decodo-openclaw-skill --skill decodo-scraper

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, python-dotenv.

What problem does it solve?

AI agents and LLM pipelines often struggle to access real-time, structured web data due to bot detection, CAPTCHAs, and the need to manually parse raw HTML. This skill eliminates those barriers by providing pre-built, authenticated tools to retrieve clean, LLM-ready web content from multiple sources.

Core Features & Use Cases

  • Multi-source web data retrieval: Access Google search results, scrape any public webpage, parse Amazon product pages and search results, extract YouTube video transcripts, and fetch Reddit post or subreddit content.
  • LLM-optimized output: All data is returned in structured JSON or clean Markdown, eliminating manual parsing and reducing token usage for AI workflows.
  • Real-world use case: A market researcher can use this skill to pull Amazon product pricing and reviews for competing devices, summarize relevant Reddit community discussions, and gather the latest Google search trends for a product category, all in formats ready for immediate analysis.

Quick Start

Use the decodo-scraper skill to fetch the latest structured Google search results for 'best wireless earbuds 2025' and return them as easy-to-process JSON.

Frequently Asked Questions about decodo-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape web data for LLM pipelines without getting blocked by bot detection?▼

This skill bypasses bot detection and CAPTCHAs by using an authenticated web scraping API to retrieve real-time web data. It returns clean, LLM-ready JSON or Markdown, eliminating manual HTML parsing for AI agents and pipelines.

Can I extract YouTube transcripts and Reddit posts for market research?▼

Yes, you can extract YouTube video transcripts and fetch Reddit post or subreddit content. The skill returns this data as structured JSON or Markdown, making it immediately ready for market research and social listening workflows.

Do I need a specific API token to scrape Amazon product data and Google search results?▼

Yes, accessing Amazon product data and Google search results requires a valid Decodo Web Scraping API authentication token. This credential authorizes the retrieval of structured data while bypassing manual bot detection handling.

What is the best way to get structured Amazon product pricing and reviews for AI analysis?▼

The best way is to use a pre-built scraping skill that parses Amazon product pages and search results directly. It retrieves pricing and review data as LLM-optimized JSON, significantly reducing token usage for immediate AI analysis.

Does this web scraping skill work with Python requests for content aggregation?▼

Yes, the skill is built using Python and the requests library. It supports content aggregation by fetching clean Markdown or JSON from arbitrary public webpages, formatting the output for immediate downstream LLM processing.

Related Skills

Explore More Data & Analytics Skills→
EvezArtEvezArt
3

web-scraping

Extract data from static and dynamic web pages using Python scraping tools.

Community
Advanced
MuduiClawMuduiClaw
11

crawl4ai

Fetch web pages and convert HTML content into clean Markdown.

Community
Intermediate
GitnappGitnapp

youtube-content

Extract YouTube transcripts and transform them into summaries, chapters, and blog posts.

Community
Intermediate
SoborboSoborbo
4

competitor-analysis

Analyze up to five competitor websites to extract marketing data into YAML.

Community
Basic