data-scraper-agent

Automate public data collection, AI enrichment, and database storage.

1|Updated Apr 21, 2026
One-click install
npx skills add https://github.com/ROYCE-8425/ai-marketing-hub --skill data-scraper-agent-royce-8425
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-scraper-agent
Source: https://github.com/ROYCE-8425/ai-marketing-hub/tree/main/skills/data-scraper-agent
Command: npx skills add https://github.com/ROYCE-8425/ai-marketing-hub --skill data-scraper-agent-royce-8425

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, beautifulsoup4, playwright, gemini-flash, notion-client, google-api-python-client, supabase, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill automates the collection of public data from various sources, enriching it with AI and storing it in databases like Notion, Sheets, or Supabase.

Core Features & Use Cases

  • Automated Data Collection: Schedule data scraping from job boards, prices, news, GitHub, sports, and more.
  • AI Enrichment: Use Gemini Flash to summarize, classify, and score data.
  • Database Storage: Store and manage collected data in Notion, Google Sheets, or Supabase.
  • Use Case: Monitor the stock prices of competing companies and receive alerts when prices drop below a certain threshold.

Quick Start

Use the data-scraper-agent skill to monitor stock prices from 'https://example.com/stock-prices' and store the data in Google Sheets.

Frequently Asked Questions about data-scraper-agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate web data scraping and store it in Google Sheets?

Data scraping for storage in Google Sheets is automated by configuring the collection process to target public web sources and route structured results directly into your database for monitoring.

What is AI data enrichment and how does it process scraped information?

AI data enrichment processes scraped information by using Gemini Flash to summarize, classify, and score the collected raw data, enhancing its value before saving it to Notion or Supabase.

Can I use Playwright and BeautifulSoup together for public data collection?

Yes, public data collection supports using Playwright and BeautifulSoup together, allowing you to handle dynamic page rendering and parse static HTML structures for comprehensive scraping.

Do I need Python libraries to monitor stock prices and trigger alerts?

Yes, you need specific Python libraries for web scraping, AI processing, and database interaction to monitor stock prices and trigger alerts when values drop below defined thresholds.

What's the best way to scrape job boards and news sites for data-driven decision-making?

The best way to scrape job boards and news sites for data-driven decision-making is to schedule automated data collection tasks that fetch, enrich, and store public data systematically.

Does this automated scraping approach work with Notion and Supabase databases?

Yes, this automated scraping approach works with Notion and Supabase databases, supporting seamless storage and management of your collected and AI-enriched data within these platforms.