skills.rest
vinitgirdhar
vinitgirdharCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

data-scraper-agent

Collect public data, enrich with Gemini Flash, and store in databases.

1|Updated Mar 8, 2026
Search Tags:#automation#workflow#notion#github-actions#data-scraping#ai-enrichment#gemini-flash
One-click install
npx skills add https://github.com/vinitgirdhar/GRID_ --skill data-scraper-agent-vinitgirdhar
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-scraper-agent
Source: https://github.com/vinitgirdhar/GRID_/tree/main/.agent/skills/data-scraper-agent
Command: npx skills add https://github.com/vinitgirdhar/GRID_ --skill data-scraper-agent-vinitgirdhar

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automatically collect data from any public source and enrich results with Gemini Flash, then store results in a database.

Core Features & Use Cases

  • Automated data collection: schedule scrapes from jobs, prices, news, GitHub, sports, and other public sources.
  • AI enrichment: apply Gemini Flash to score and summarize items for quick decision-making.
  • Flexible storage: push results to Notion, Google Sheets, Supabase, or your own database.
  • Learn from feedback: use user decisions to improve scoring and relevance over time.
  • Free-on-GitHub-Actions: runs without paid hosting, ideal for public repos or hobby projects.

Quick Start

Set up a public data source, configure the storage target, and run the agent on GitHub Actions to begin automated collection.

Frequently Asked Questions about data-scraper-agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate public web data scraping and store it directly in Notion?▼

Automated data scraping can be scheduled to collect public data from various sources, use Gemini Flash for AI enrichment, and push the stored results directly into Notion. This pipeline runs on GitHub Actions without requiring paid hosting.

Can I use GitHub Actions to schedule automated web scraping for free?▼

Yes, GitHub Actions supports scheduling automated web scraping workflows for free. This agent implements a collect, enrich, and store pipeline that runs without paid hosting, making it ideal for public repositories and hobby projects.

What is AI data enrichment and how does it improve scraped public data?▼

AI data enrichment applies Gemini Flash to automatically score and summarize scraped public data items. This process uses batched AI calls to help you make quick decisions by analyzing the relevance and quality of the collected information.

Does this automated data collection pipeline support Google Sheets and Supabase storage?▼

Yes, the automated data collection pipeline supports flexible multi-backend storage. You can configure the agent to push enriched results directly to Google Sheets, Supabase, Notion, or your own custom database.

How do I prevent duplicate URL entries during automated web scraping?▼

The automated web scraping pipeline includes built-in URL deduplication to prevent duplicate entries. This mechanism ensures that only unique data points are collected, enriched, and stored across your scheduled scraping runs.

Can automated data scraping improve its relevance scoring based on my feedback?▼

Yes, the automated data scraping agent learns from user feedback to improve scoring and relevance over time. Your decisions on previously collected items are used to refine the AI enrichment process for future data collection.

Related Skills

Explore More Data & Analytics Skills→
starrank-softstarrank-soft

data-scraper-agent

Build scheduled Python scrapers that enrich data with Gemini and store results.

Official
Advanced
weirdgmeweirdgme
4

platform-engineering

Design and implement scalable platform engineering patterns for internal developer platforms.

Community
Advanced
woxiangyangzhimaowoxiangyangzhimao
3

data-scraper-agent

Automates scheduled scraping of public sources with AI enrichment into databases like Notion.

Community
Advanced
cpfcoachingcpfcoaching

gcp-cloud-run

Deploys serverless apps to Google Cloud Platform with configurable settings.

Community
Advanced