data-scraper-agent

Automate public data collection with scheduled scrapes and AI enrichment.

2|Updated Mar 3, 2026
One-click install
npx skills add https://github.com/MomoDaviluke/star-citizen-promotion --skill data-scraper-agent-momodaviluke
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-scraper-agent
Source: https://github.com/MomoDaviluke/star-citizen-promotion/tree/main/.agents/skills/ecc/data-scraper-agent
Command: npx skills add https://github.com/MomoDaviluke/star-citizen-promotion --skill data-scraper-agent-momodaviluke

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates AI-powered collection of public data.

Core Features & Use Cases

  • Automated data collection from public sources
  • AI enrichment of scraped items using Gemini Flash
  • Storage to Notion / Sheets / Supabase and run on GitHub Actions
  • Learn from user feedback to improve results

Quick Start

Configure your data sources, enable AI enrichment, and run the GitHub Actions workflow to start automatic data collection.

Frequently Asked Questions about data-scraper-agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate public data scraping and store results in Notion or Sheets?

Automate public data scraping by scheduling GitHub Actions to run a three-layer pipeline that collects, enriches with Gemini Flash AI, and stores results directly into Notion, Sheets, or Supabase.

Can I monitor job postings and news by scheduling automated web scrapes?

Yes, you can monitor job postings, news, prices, and events by scheduling automated scrapes through GitHub Actions, enriching the collected items with AI, and storing them for continuous tracking.

How does AI enrichment work for scraped data?

AI enrichment processes scraped data using Gemini Flash to analyze, clean, and enhance the collected items, while a feedback loop learns from your input to continuously improve accuracy.

Do I need GitHub Actions to run the data collection pipeline?

GitHub Actions is required to schedule and execute the automated data collection pipeline, handling the collection, AI enrichment, and storage phases without manual intervention.

What is the best way to track sports scores and prices from public sources automatically?

The best way to track sports scores and prices is using a scheduled Collect, Enrich, and Store pipeline that scrapes public sources, applies Gemini Flash AI for enrichment, and saves to Supabase.

Does this data scraping approach work with Supabase for storing enriched results?

Yes, the pipeline supports Supabase as a storage destination, allowing you to automatically store AI-enriched data collected from public sources directly into your Supabase database.