skills.rest
PaulCrossland1
PaulCrossland1COMMUNITY
Explore all skills by this author →
GitHub

oxylabs-web-scraper

Scrape websites via the Oxylabs Web Scraper API with Realtime, Push-Pull, and Proxy Endpoint integrations.

Updated Aug 23, 2026
Search Tags:#API#web scraping#parsing#proxy-endpoint#Oxylabs#Realtime
One-click install
npx skills add https://github.com/PaulCrossland1/claude-code-skills --skill oxylabs-web-scraper
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: oxylabs-web-scraper
Source: https://github.com/PaulCrossland1/claude-code-skills/tree/main/oxylabs-web-scraper
Command: npx skills add https://github.com/PaulCrossland1/claude-code-skills --skill oxylabs-web-scraper

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides a robust framework for collecting data from websites using Oxylabs, removing manual scraping setup and reducing maintenance overhead.

Core Features & Use Cases

  • Realtime, Push-Pull, and Proxy Endpoint integrations for flexible scraping at any scale.
  • Custom parsers and browser instructions to extract structured data from diverse sites, including e-commerce pages.
  • Geo-targeting and authentication support for enterprise-grade scraping across regions and protected content.

Quick Start

Fetch the Amazon product page for ASIN B07FZ8S74R with HTML rendering and parsed output.

Frequently Asked Questions about oxylabs-web-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I use the Oxylabs Web Scraper API for automated web scraping?▼

Automated web scraping with Oxylabs uses structured request payloads and HTTP Basic Auth to extract data from websites. The API supports Realtime, Push-Pull, and Proxy Endpoint integration methods for flexible, reliable data collection.

Can I scrape e-commerce product pages and parse specific data using Oxylabs?▼

You can scrape e-commerce product pages using Oxylabs by applying custom parsers and browser instructions. This allows you to extract structured data from diverse sites, including targeted product details from Amazon pages.

What is the difference between Realtime, Push-Pull, and Proxy Endpoint integrations?▼

Realtime integration returns data immediately, Push-Pull submits jobs and retrieves results later, and Proxy Endpoint routes requests through a proxy. These Oxylabs methods support flexible web scraping at any scale.

How do I handle geo-targeting when scraping websites with Oxylabs?▼

Geo-targeting in Oxylabs web scraping allows you to extract region-specific data from protected content. It is configured within the structured request payload to target specific geographic locations.

Do I need the requests library to connect to the Oxylabs Web Scraper API?▼

Yes, the requests library is required as a dependency to connect to the Oxylabs Web Scraper API. It facilitates the HTTP requests needed for authenticating and sending structured payloads to the scraping endpoints.

Related Skills

Explore More Software Engineering Skills→
api7api7
1

a6-plugin-basic-auth

Configure APISIX basic-auth on routes and consumers via a6 commands.

Official
Intermediate
AgentPMTAgentPMT

file-to-json-parsing

Parse CSV, HTML, JSON, ICS, spreadsheets, PDFs, and RTF into structured JSON.

Official
Intermediate
ClawLink-HQClawLink-HQ
117

zyte

Extract structured data from JavaScript-rendered web pages via the Zyte API.

Official
Advanced
obulaiobulai
1

obul-coresignal

Search and enrich company, employee, and job data via API endpoints.

Official
Intermediate