data-scraper-agent

Name: data-scraper-agent
Availability: InStock
Author: Arbisoft

Automate scraping, enrichment, and storage of public data sources.

4|7|Updated Apr 9, 2026

Search Tags:#github-actions #workflow-automation #data-pipeline #web-scraping #ai-enrichment #notion-sync #data-scraper

Ready to run

npx skills add https://github.com/arbisoft/ai-skillforge --skill data-scraper-agent-arbisoft

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: data-scraper-agent
Source: https://github.com/arbisoft/ai-skillforge/tree/main/Claude/skills/data-scraper-agent
Command: npx skills add https://github.com/arbisoft/ai-skillforge --skill data-scraper-agent-arbisoft

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates the collection and enrichment of public-source data, reducing manual scraping, data gaps, and repetitive workflows.

Core Features & Use Cases

Scheduled scraping across sources (job boards, prices, news, repos, sports, etc.)
AI enrichment with summaries and scoring using Gemini Flash (free tier)
Storage to Notion / Sheets / Supabase with deduplication
Feedback-driven learning to improve future results
GitHub Actions-based automation, fully free for public repos

Quick Start

Create a new repository with this agent, configure the storage and API keys, then run the workflow to start automatic data scraping.

Frequently Asked Questions about data-scraper-agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate web scraping and store the results directly in Notion?▼

You can automate web scraping and store results in Notion by running a scheduled data pipeline that scrapes public sources, enriches the data with AI, and syncs the deduplicated output directly to your Notion workspace.

Can I schedule a data scraping pipeline using GitHub Actions for free?▼

Yes, you can schedule a data scraping pipeline using GitHub Actions completely free for public repositories, automating the collection, AI enrichment, and storage of web data without manual intervention.

What is AI data enrichment and how does it work with scraped web data?▼

AI data enrichment processes scraped web data by applying a configurable AI model to generate summaries and scoring, transforming raw public source data into structured, actionable insights before storage.

How do I monitor job boards or price changes automatically without manual scraping?▼

You can monitor job boards or price changes automatically by deploying an end-to-end data pipeline that schedules scraping tasks, applies AI enrichment, removes duplicates, and stores the updated results.

Does this web scraping agent support storing data in Google Sheets and Supabase?▼

Yes, the web scraping agent supports storing enriched data in Google Sheets and Supabase, applying deduplication to ensure your database or spreadsheet remains clean and free of repetitive entries.

How does feedback-driven learning improve automated data scraping results?▼

Feedback-driven learning improves automated data scraping by implementing a lightweight loop where the pipeline learns from user feedback, adjusting future AI enrichment and collection to better match your data needs.