skills.rest
ssrxs
ssrxsCOMMUNITY
Explore all skills by this author →
GitHub

data-scraper-agent

Scrape public data sources, enrich with AI, and store results in Notion, Sheets, or Supabase.

Updated Aug 23, 2026
Search Tags:#automation#database#notion#github-actions#data-scraping#ai-enrichment
One-click install
npx skills add https://github.com/ssrxs/scx-studio-pro-fixed --skill data-scraper-agent-ssrxs
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-scraper-agent
Source: https://github.com/ssrxs/scx-studio-pro-fixed/tree/main/gemini-skills/ecc-data-scraper-agent
Command: npx skills add https://github.com/ssrxs/scx-studio-pro-fixed --skill data-scraper-agent-ssrxs

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

The data-scraper-agent automates gathering public data sources on a schedule, enabling users to monitor, collect, and track information without manual scraping.

Core Features & Use Cases

  • End-to-end data collection: scrape, enrich with an AI model, and store results in Notion, Sheets, or Supabase.
  • Schedule-driven automation: runs on GitHub Actions to keep data fresh without ongoing hosting costs.
  • Learn from feedback: iterates scoring and summaries based on user feedback to improve results.
  • Use case: monitor jobs, prices, news, repos, sports, and events automatically.

Quick Start

Configure your GitHub repository with the provided workflow and start the action to begin automated data collection from your chosen public sources.

Frequently Asked Questions about data-scraper-agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate web scraping and store results in Notion or Supabase?▼

Automated web scraping and database storage is handled by scraping public sources, enriching data with AI, and saving outcomes directly to Notion, Sheets, or Supabase. You configure the process via YAML and run it on GitHub Actions.

Can I run scheduled data scraping on GitHub Actions without hosting costs?▼

Scheduled data scraping on GitHub Actions runs entirely on free tiers for hosting, AI enrichment via Gemini Flash, and database storage. This setup keeps data fresh automatically without ongoing server or infrastructure expenses.

How does AI enrichment improve scraped data collection?▼

AI enrichment improves scraped data collection by processing raw results through an AI model to generate summaries and scores. It learns from user feedback to iteratively refine scoring accuracy and summary quality for future data collection runs.

What sources can I monitor with automated data scraping?▼

Automated data scraping supports monitoring various public sources including jobs, prices, news, repositories, sports, and events. The solution collects from multiple data sources simultaneously and stores the results in your chosen database.

Do I need a paid database to store scraped and enriched data?▼

A paid database is not required to store scraped and enriched data. The solution supports free database storage options including Notion, Google Sheets, and Supabase, operating entirely on free tier services.

How do I configure the data scraper agent for my data sources?▼

Configuring the data scraper agent for your sources is done via YAML files. You set up your GitHub repository with the provided workflow, specify your target public sources and desired database, then start the action to begin collection.

Related Skills

Explore More Data & Analytics Skills→
woxiangyangzhimaowoxiangyangzhimao
3

data-scraper-agent

Automates scheduled scraping of public sources with AI enrichment into databases like Notion.

Community
Advanced
neuron-oneneuron-one
25

data-analysis

Analyze Google Sheets, Notion and HubSpot data via Composio to generate charts and insights.

Community
Intermediate
derekhu0002derekhu0002

data-scraper-agent

Automate scheduled public data collection with Python and Gemini Flash enrichment.

Community
Advanced
1thirteeng31thirteeng3

modal-serverless-gpu

Deploy ML workloads to Modal's serverless GPU cloud with auto-scaling.

Community
Advanced