skills.rest
cipriantitire
cipriantitireCOMMUNITY
Explore all skills by this author →
Website𝕏@psyccotoxiccGitHub

data-scraper-agent

Automate scheduled scraping of public sources with AI enrichment and storage.

Updated Aug 23, 2026
Search Tags:#notion#github-actions#workflow-automation#web-scraping#data-scraping#ai-enrichment
One-click install
npx skills add https://github.com/cipriantitire/noctvm --skill data-scraper-agent
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-scraper-agent
Source: https://github.com/cipriantitire/noctvm/tree/main/Skills/data-scraper-agent
Command: npx skills add https://github.com/cipriantitire/noctvm --skill data-scraper-agent

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Data-scraper-agent automates the collection of public data from multiple sources, reducing manual monitoring and enabling timely insights.

Core Features & Use Cases

  • Schedule-based scraping for job boards, prices, news, GitHub repos, sports, and events.
  • AI enrichment via Gemini Flash and storage to Notion, Sheets, or Supabase.
  • Learning from user feedback to continuously improve results and adapt to new sources.

Quick Start

Configure the environment and run the action to start scraping, enrichment, and storage automatically.

Frequently Asked Questions about data-scraper-agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate web scraping and store the results in Notion?▼

You can automate web scraping by configuring a scheduled AI-powered scraper to collect public data and route it directly to Notion as a storage destination. The pipeline batches items for AI enrichment before storing them.

Can I use GitHub Actions for scheduled data scraping tasks?▼

Yes, GitHub Actions can serve as the workflow automation environment to run the scheduled scraping action. You configure the environment and run the action to trigger data collection, AI enrichment, and storage automatically.

What types of public data sources can I collect for AI enrichment?▼

The data scraper identifies and collects public data from sources like job boards, prices, news, GitHub repositories, and sports events. It batches these items for AI enrichment using a model-fallback chain.

Does the data scraper support exporting to Google Sheets or Supabase?▼

Yes, the pipeline supports storing scraped and AI-enriched data in Google Sheets or Supabase. Notion is also supported as a primary destination alongside these storage platforms.

How does an AI scraper improve its data collection over time?▼

The AI scraper improves its data collection by learning from user feedback. This allows the pipeline to continuously adapt its results and learn how to handle new public data sources effectively.

What is the best way to scrape job boards and news sites without manual monitoring?▼

The best way to scrape job boards and news sites is using a schedule-based AI scraper that automates data collection. This reduces manual monitoring by identifying suitable sources and storing results in your chosen database.

Related Skills

Explore More Data & Analytics Skills→
aayushsoamaayushsoam
1

data-scraper-agent

Automate scheduled collection and enrichment of public data sources.

Community
Advanced
Thiago-Cruz-engThiago-Cruz-eng

data-analysis

Analyze datasets to extract insights and produce structured reports.

Community
Intermediate
vinitgirdharvinitgirdhar

data-scraper-agent

Collect public data, enrich with Gemini Flash, and store in databases.

Community
Advanced
ROYCE-8425ROYCE-8425
1

data-scraper-agent

Automate public data collection, AI enrichment, and database storage.

Community
Advanced