skills.rest
AgentComputerAI
AgentComputerAIOFFICIAL
Explore all skills by this author →
WebsiteGitHub

producthunt

Extracts structured metadata from Product Hunt homepage and leaderboard pages.

5|Updated Apr 9, 2026
Search Tags:#puppeteer#cloudflare#scraping#web-scraping#cheerio#producthunt
One-click install
npx skills add https://github.com/AgentComputerAI/torch --skill producthunt-agentcomputerai
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: producthunt
Source: https://github.com/AgentComputerAI/torch/tree/main/skills/sites/producthunt
Command: npx skills add https://github.com/AgentComputerAI/torch --skill producthunt-agentcomputerai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill eliminates brittle, manual scraping attempts against Product Hunt's Cloudflare‑protected homepage by providing a proven playbook that navigates the site in a real Chrome instance, clears challenges, and extracts structured post metadata reliably.

Core Features & Use Cases

  • Cloudflare bypass: Connects to a real Chrome via puppeteer.connect to clear managed challenges without stealth plugins or captcha solvers.
  • DOM-first extraction: Parses server-rendered section[data-test="homepage-section-*"] blocks with cheerio to return id, rank, name, tagline, topics, url, votes, and comments.
  • Resilience: Includes retry guidance for intermittent 502 responses and explicit teardown advice to avoid killing the user's real Chrome.
  • Use Case: Ideal for analytics, monitoring, or archival workflows that need the top Product Hunt posts (today/yesterday/last-week/last-month) as structured records.

Quick Start

Scrape the Product Hunt homepage at https://www.producthunt.com and return parsed post objects including id, rank, name, tagline, topics, url, votes, and comments.

Frequently Asked Questions about producthunt

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape Product Hunt data while bypassing Cloudflare protection?▼

Product Hunt scraping bypasses Cloudflare by connecting Puppeteer to a real Chrome instance at 127.0.0.1:9222, clearing managed challenges without stealth plugins. The Skill then uses Cheerio to parse server-rendered DOM blocks for structured post metadata.

What fields can I extract from Product Hunt homepage posts?▼

Extracted Product Hunt homepage post fields include id, rank, name, tagline, topics, url, votes, and comments. The Skill parses server-rendered section blocks with Cheerio to return these structured records for analytics or archival workflows.

Do I need a specific Chrome setup to scrape Product Hunt with Puppeteer?▼

Scraping Product Hunt with Puppeteer requires a real Chrome instance reachable via puppeteer.connect at 127.0.0.1:9222. This live browser setup is mandatory for bypassing Cloudflare managed challenges without captcha solvers.

Can I scrape Product Hunt leaderboard pages for weekly or monthly top posts?▼

You can scrape Product Hunt leaderboard pages for daily, weekly, and monthly top posts. The Skill applies to both homepage and leaderboard pages, capturing top posts as structured records for analytics or monitoring workflows.

Why does my Product Hunt scraper return intermittent 502 responses?▼

Intermittent 502 responses during Product Hunt scraping are addressed through built-in retry guidance. The Skill also provides explicit teardown advice to prevent accidentally killing your real Chrome instance during the extraction process.

What is the best way to archive top Product Hunt posts as structured records?▼

The best way to archive top Product Hunt posts as structured records is a DOM-first extraction approach. This Skill navigates a real Chrome instance to clear Cloudflare, then parses server-rendered sections with Cheerio to return reliable structured metadata.

Related Skills

Explore More Software Engineering Skills→
AgentComputerAIAgentComputerAI
5

walmart

Scrape Walmart product listings via Chrome and parse __NEXT_DATA__ JSON.

Official
Advanced
Sonder4Sonder4
27

bfd-fault-logger

Record and classify STM32 hardware faults into structured reports.

Community
Advanced
cyzuscyzus
62

browser-skill

Control a headless Chrome browser to navigate pages and interact with DOM elements.

Community
Intermediate
magnus919magnus919
40

flaresolverr-cli

Execute browser-backed HTTP requests to bypass Cloudflare and DDoS-GUARD anti-bot protections.

Community
Intermediate