skills.rest
ekatasingh1107
ekatasingh1107COMMUNITY
Explore all skills by this author →
GitHub

platform-scraper

Scrape 17 platforms for freelance gig leads and normalize them into a unified format.

2|Updated Apr 11, 2026
Search Tags:#automation#scrape#leads#lead-generation#platforms#freelance
One-click install
npx skills add https://github.com/ekatasingh1107/b2b-gtm-skills --skill platform-scraper-ekatasingh1107
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: platform-scraper
Source: https://github.com/ekatasingh1107/b2b-gtm-skills/tree/main/skills/capabilities/platform-scraper
Command: npx skills add https://github.com/ekatasingh1107/b2b-gtm-skills --skill platform-scraper-ekatasingh1107

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Streamlines the discovery of relevant freelance gigs and client leads by scraping multiple marketplaces and communities, removing manual searching and aggregation bottlenecks.

Core Features & Use Cases

  • Cross-platform lead discovery: Scrapes 17 platforms (Freelancer, PeoplePerHour, Guru, Fiverr, Upwork, Reddit, LinkedIn, Behance, Dribbble, Shopify Community, IndieHackers, Funding News, Twitter/X, Instagram Brands, Product Hunt, Google Maps, Shopify Store Discovery) for gigs matching agency services.
  • Normalized data model: Outputs leads into a single, consistent schema ready for scoring, nurturing, and CRM ingestion.
  • Intake-driven filtering: Uses agency.config.json keywords (services, ICP, scoring) to filter results and prioritize relevance.
  • Rate-limited, safe scraping: Applies controlled queries and etiquette to respect platform policies and reduce bot-like activity.
  • De-duplication across sources: Merges duplicates from different platforms to present the most complete, recent lead when applicable.

Quick Start

Configure agency.config.json at the repo root and run the platform-scraper to begin scraping all enabled platforms for matching gigs.

Frequently Asked Questions about platform-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate freelance lead generation across multiple platforms?▼

Automate freelance lead generation by scraping 17 platforms like Upwork, Freelancer, and Reddit for matching agency services, then normalizing the results into a unified format ready for downstream scoring and outreach.

What's the best way to scrape freelance gigs without getting blocked?▼

Scrape freelance gigs safely using rate-limited queries and scraping etiquette to respect platform policies, reducing bot-like activity while collecting matching leads across multiple marketplaces and communities.

How do I normalize leads from different platforms into a single CRM format?▼

Normalize leads from different platforms by extracting structured data from 17 sources and applying de-duplication to merge duplicates, outputting a single consistent schema suitable for CRM ingestion.

Can I filter scraped freelance leads using my own agency's service keywords?▼

Filter scraped freelance leads using the agency.config.json file at the repo root, which applies your specific service keywords and ideal customer profile to prioritize relevant gigs across all enabled platforms.

Does the platform-scraper support lead discovery on community sites like Reddit and IndieHackers?▼

The platform-scraper supports lead discovery on community sites like Reddit, IndieHackers, and Shopify Community, alongside traditional freelance marketplaces, to find matching agency service gigs.

What are the limitations of scraping social media platforms for lead generation?▼

Limitations of scraping social media platforms for lead generation include the need for rate-limited, controlled queries to respect platform policies and avoid bot-detection, which may restrict the volume of leads collected per run.

Related Skills

Explore More Marketing & Sales Skills→
ekatasingh1107ekatasingh1107
2

agency-setup

Generate a validated agency.config.json from B2B agency onboarding inputs.

Community
Advanced
claude-office-skillsclaude-office-skills
368

crm-automation

Automate CRM workflows for HubSpot, Salesforce, and Pipedrive.

Official
Advanced
aviskaaraviskaar
6

lead-routing

Automate lead capture, enrichment, scoring, routing, and calendar filling for sales.

Official
Advanced
matt-fell-aimatt-fell-ai
1

discovery

Scan environments, networks, and APIs to identify integration opportunities.

Community
Intermediate