skills.rest
its-Basudeba
its-BasudebaCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

data-scraper-agent

Automate web data collection, enrichment, and storage with Python and LLM analysis.

1|Updated Apr 11, 2026
Search Tags:#automation#notion#gemini#scraping#github-actions#data-collection
One-click install
npx skills add https://github.com/its-Basudeba/Care-HMS --skill data-scraper-agent-its-basudeba
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-scraper-agent
Source: https://github.com/its-Basudeba/Care-HMS/tree/main/.agent/skills/data-scraper-agent
Command: npx skills add https://github.com/its-Basudeba/Care-HMS --skill data-scraper-agent-its-basudeba

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, beautifulsoup4, lxml, python-dotenv, pyyaml, notion-client.

What problem does it solve?

This skill solves the challenge of manually monitoring and collecting data from public sources by automating the entire lifecycle of scraping, AI-driven enrichment, and database synchronization.

Core Features & Use Cases

  • Automated Collection: Scrapes websites, APIs, and RSS feeds on a recurring schedule using GitHub Actions.
  • AI Enrichment: Uses Gemini Flash to score, summarize, and classify collected data based on user-defined priorities.
  • Use Case: Automatically monitor job boards for specific roles, scrape product prices for alerts, or track news feeds and summarize relevant articles directly into Notion or Google Sheets.

Quick Start

Ask the agent to build a scraper for a specific website by providing the target URL and the data fields you want to extract.

Frequently Asked Questions about data-scraper-agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate web scraping and store results directly in Notion?▼

Automated web scraping can store results directly in Notion by using Python scripts with BeautifulSoup and the notion-client library to collect, enrich, and sync public web data into databases on a recurring schedule.

What is AI-driven data enrichment and how does it work with scraped data?▼

AI-driven data enrichment uses LLMs like Gemini Flash to score, summarize, and classify scraped web data based on user-defined priorities, transforming raw collected information into structured, actionable insights.

Can I schedule a Python web scraper to run automatically using GitHub Actions?▼

You can schedule Python web scrapers to run automatically using GitHub Actions, enabling recurring data collection from websites, APIs, and RSS feeds without manual triggering or server management.

Does this data collection approach support free-tier efficiency for large-scale scraping?▼

This data collection approach supports free-tier efficiency by implementing batch processing and model fallback strategies, maintaining reliability and minimizing costs when scraping public web sources at scale.

What's the best way to track product prices and job board listings automatically?▼

The best way to track product prices and job board listings automatically is building an AI-powered scraper that extracts target fields from URLs and uses LLM analysis to summarize relevant updates into Notion or Sheets.

Related Skills

Explore More Data & Analytics Skills→
pengfitpengfit

huhehaote-price

Extract and transform Huhehaote government website price data via ETL.

Community
Advanced
delta-and-betadelta-and-beta

analyst-data-export

Export Braze data from dashboard CSVs and Export API responses into analyzable datasets.

Community
Advanced
Michae2xlMichae2xl

data-scraper-agent

Automate public data collection and AI enrichment with Python and Gemini Flash.

Community
Advanced
Umbral-BotUmbral-Bot

playwright-python

Automate web browser interactions with Playwright for Python.

Official
Intermediate