Extract Costco product listings and metadata via the public catalog search API.
npx skills add https://github.com/AgentComputerAI/torch --skill costco
Please help me install this Agent Skill. Skill: costco Source: https://github.com/AgentComputerAI/torch/tree/main/skills/sites/costco Command: npx skills add https://github.com/AgentComputerAI/torch --skill costco
This Skill bypasses Akamai-protected category pages on costco.com by replaying the site's public catalog search API so you can retrieve full product grids and metadata without rendering or interacting with the blocked HTML.
Send a single POST request to https://gdx-api.costco.com/catalog/search/api/v1/search with a JSON body containing the category filter and pageSize, and include headers content-type, client_id: USBC, client-identifier (UUID), searchresultprovider, origin, referer, and a plausible user-agent to receive searchResult.results in the response.
High-intent search queries and answers about installing and using this skill.
To scrape Costco category listings blocked by Akamai, you can bypass the HTML shell and replay the site's public catalog search API at gdx-api.costco.com to fetch product data directly as JSON.
The best way to get product pricing and metadata from Costco without a browser is sending a POST request to the catalog search API and parsing the searchResult.results and variantRollupValues fields.
To handle Costco pagination, you include offset and pageSize parameters in your POST JSON body, iterating through large categories up to 96 items per page to avoid N+1 per-item calls.
You need headers including content-type, client_id set to USBC, a client-identifier UUID, searchresultprovider, origin, referer, and a plausible user-agent to successfully query the Costco catalog search API.
Yes, the Costco catalog API approach works for extracting availability and ratings, as the searchResult.results object contains product id, title, brand, pricing, promo text, and canonical URLs.
You are getting blocked because the category pages are Akamai-protected, but you can avoid this by querying the backend public gdx-api.costco.com endpoint that returns JSON without rendering HTML.
joshka0Plan and validate HTTP requests against OpenAPI specifications in dry-run mode.
thecolab-aiQueries Bargain Chemist NZ product search and availability via JSON APIs.
ngpestelosDiagnose and fix API pagination failures for complete data imports.
pynbj1001Scrapes JavaScript-rendered and anti-bot protected websites using adaptive parsing and stealth browser automation.