Skills
.Work. You
Rest

Craigslist — Scraping via http_get

Community

Scrape Craigslist listings with static HTML fetch

Data & Analytics#data-extraction#web-scraping#json-ld#listings#html-parsing#craigslist#http_get
Authoryangchuansheng
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Craigslist scraping is complicated by dynamic content and misleading pagination. This Skill leverages Craigslist's static HTML renderer to fetch all matching results in a single response, enabling fast, deterministic scraping without a headless browser.

Core Features & Use Cases

  • Static HTML scraping: retrieves the full result set in one HTTP GET, avoiding JS-driven pagination.
  • Guided URL patterns: uses city subdomains and category codes to build searchable URLs for multiple regions.
  • Field extraction: parses title, URL, price, location, and post_id from the static results; can also extract detailed fields from individual listing pages.
  • JSON-LD fallback: optionally leverages JSON-LD blocks for structured data when available.

Quick Start

Use a single search query across a city and category to fetch all matching Craigslist results via the static HTML renderer.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: Craigslist — Scraping via http_get
Download link: https://github.com/yangchuansheng/browser-harness-rust/archive/main.zip#craigslist-scraping-via-http-get

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.