skills.rest
iAziz786
iAziz786COMMUNITY
Explore all skills by this author →
Website𝕏@iAziz786GitHub

reddit-scraper

Transforms Reddit URLs to old.reddit.com for safe scraping.

3|Updated Jul 5, 2021
Search Tags:#reddit#data-extraction#web-scraping#safety-guidelines#url-transformation#old-reddit
One-click install
npx skills add https://github.com/iAziz786/dotfiles --skill reddit-scraper-iaziz786
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: reddit-scraper
Source: https://github.com/iAziz786/dotfiles/tree/main/.agents/skills/reddit-scraper
Command: npx skills add https://github.com/iAziz786/dotfiles --skill reddit-scraper-iaziz786

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Reddit data scraping requires a consistent, scraper-friendly starting point and clear guidance to avoid blocks and redirects.

Core Features & Use Cases

  • URL normalization: always use old.reddit.com as the base for all scraping activities.
  • URL transformation rules: automatically convert common Reddit URLs (subreddits, posts, users) to their old.reddit.com equivalents.
  • Safe scraping guidance: best practices and cautions to minimize rate limiting and ensure reliable access.

Quick Start

Transform a Reddit URL to old.reddit.com and begin scraping data.

Frequently Asked Questions about reddit-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape Reddit data without getting blocked or redirected?▼

Transform standard Reddit URLs to old.reddit.com to scrape data safely. This normalization provides a consistent, scraper-friendly base for extracting posts, comments, and user pages while minimizing redirects.

Why use old.reddit.com instead of the standard site for web scraping?▼

Using old.reddit.com for web scraping avoids modern JavaScript rendering and complex redirects. It enforces base URL normalization to deliver a lightweight HTML structure ideal for reliable data extraction.

What types of Reddit URLs can be transformed for data extraction?▼

URL transformation rules apply to common Reddit data extraction targets, including subreddits, individual posts, comments, and user pages, ensuring all scraping activities start from a normalized base.

What are the safety considerations for scraping Reddit posts and comments?▼

Safe scraping guidance for Reddit posts and comments involves following best practices to minimize rate limiting. Applying explicit URL transformation rules ensures reliable access and reduces the risk of blocks.

Do I need any special dependencies to normalize Reddit URLs for scraping?▼

No dependencies are required to normalize Reddit URLs for scraping. The process applies explicit URL transformation rules directly to standard links, converting them to old.reddit.com equivalents for safe access.

Related Skills

Explore More Data & Analytics Skills→
olostepolostep

map

Discover and list all URLs on a website with keyword and pattern filtering.

Community
Intermediate
paul-hosking-cdw-compaul-hosking-cdw-com

identify-page-structure

Identify section boundaries and content sequences from scraped HTML, screenshots, and metadata.

Community
Intermediate
XPRNetworkXPRNetwork
3

web-scraping

Fetch web pages and extract clean text, titles, and links.

Official
Intermediate
AgentPMTAgentPMT

web-data-convertor

Convert data between JSON, CSV, XML, YAML, Markdown, and HTML formats.

Official
Intermediate