skills.rest
yangchuansheng
yangchuanshengCOMMUNITY
Explore all skills by this author →
Website𝕏@carsonyungosGitHub

Craigslist — Scraping via http_get

Extract Craigslist search results via static HTML HTTP GET.

9|Updated Apr 23, 2026
Search Tags:#data-extraction#web-scraping#json-ld#listings#html-parsing#craigslist#http_get
One-click install
npx skills add https://github.com/yangchuansheng/browser-harness-rust --skill craigslist-scraping-via-http-get
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: Craigslist — Scraping via http_get
Source: https://github.com/yangchuansheng/browser-harness-rust/tree/main/domains/craigslist
Command: npx skills add https://github.com/yangchuansheng/browser-harness-rust --skill craigslist-scraping-via-http-get

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Craigslist scraping is complicated by dynamic content and misleading pagination. This Skill leverages Craigslist's static HTML renderer to fetch all matching results in a single response, enabling fast, deterministic scraping without a headless browser.

Core Features & Use Cases

  • Static HTML scraping: retrieves the full result set in one HTTP GET, avoiding JS-driven pagination.
  • Guided URL patterns: uses city subdomains and category codes to build searchable URLs for multiple regions.
  • Field extraction: parses title, URL, price, location, and post_id from the static results; can also extract detailed fields from individual listing pages.
  • JSON-LD fallback: optionally leverages JSON-LD blocks for structured data when available.

Quick Start

Use a single search query across a city and category to fetch all matching Craigslist results via the static HTML renderer.

Frequently Asked Questions about Craigslist — Scraping via http_get

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape Craigslist listings without using a headless browser?▼

You can scrape Craigslist listings by performing a single HTTP GET against the static HTML renderer for a specific city and category, retrieving the full result set without needing a headless browser.

How do I extract price and location data from Craigslist search results?▼

Extract price and location data by parsing cl-static-search-result blocks from the static HTML response, which also yields the post title, URL, and post identifier for each listing.

Can I filter Craigslist web scraping results by price and category?▼

Yes, you can constrain web scraping results by applying provided filters such as query, min_price, max_price, and category codes to narrow down the static HTML search results.

Does this Craigslist scraping method handle JavaScript pagination?▼

No, this scraping method skips JS-driven pagination entirely by fetching a complete static HTML result set in a single response, ensuring fast and deterministic data extraction.

How does JSON-LD help with extracting structured data from Craigslist?▼

JSON-LD blocks provide a structured data fallback for extracting fields when available, complementing the standard HTML parsing of static search results and individual listing pages.

Related Skills

Explore More Data & Analytics Skills→
archibatearchibate
6

weather

Fetch Chinese weather forecasts via HTTP endpoints using city area codes.

Community
Basic
LeonChaoXLeonChaoX
783

clinicaltrials-database

Query ClinicalTrials.gov API v2 for studies and retrieve trial records by NCT ID.

Community
Intermediate
apexradiusapexradius

schema-gen

Generate JSON-LD structured data for web pages and validate schema markup.

Official
Intermediate
noahsilve123noahsilve123
1

firecrawl-build-interact

Automate browser interactions for dynamic page data extraction.

Community
Advanced