skills.rest
binggandata
binggandataCOMMUNITY
Explore all skills by this author →
GitHub

bggg-data-reddit

Collect Reddit search results and comment trees into auditable normalized JSONL.

588|92|Updated May 2, 2026
Search Tags:#data collection#JSONL#Reddit#voC#Web scraping#Market Research#comment tree
One-click install
npx skills add https://github.com/binggandata/bggg-skills --skill bggg-data-reddit
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: bggg-data-reddit
Source: https://github.com/binggandata/bggg-skills/tree/main/bggg-data-reddit
Command: npx skills add https://github.com/binggandata/bggg-skills --skill bggg-data-reddit

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Gathering Reddit posts and comments for VOC or market research often means ad-hoc scraping with no audit trail, lost raw responses, and inconsistent data formats. This Skill collects Reddit search listings and full comment trees through a logged-in Chrome session, preserves every raw JSON response, and normalizes everything into analysis-ready JSONL.

Core Features & Use Cases

  • Deterministic Request Planning: Build a search request plan from a TSV query file with sort, time window, and pagination controls.
  • Auditable Collection: Save every unmodified source JSON response with a manifest recording URL, query, HTTP status, and collection time.
  • Normalization & Deduplication: Parse posts and nested comment trees into a unified JSONL schema with SHA-256 source IDs, engagement metrics, keyword hits, and parent-thread concentration stats.
  • Use Case: A product researcher defines 20 ingredient-related queries, collects the top Reddit threads with full comment trees, and receives a deduplicated JSONL corpus plus a summary report showing comment counts, skipped deleted rows, and thread concentration for VOC analysis.

Quick Start

Use bggg-data-reddit to collect Reddit posts and full comment trees for the queries in config/reddit_queries.tsv and normalize them into JSONL.

Frequently Asked Questions about bggg-data-reddit

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I collect Reddit comments for market research?▼

Define queries in a TSV file, build a request plan with the bundled script, then fetch Reddit's public JSON listings and comment trees through a Chrome tab. The normalize script converts saved responses into analysis-ready JSONL with engagement and keyword data.

How to scrape Reddit search results with pagination?▼

Reddit search listings paginate through the data.after cursor in each JSON response. Continue fetching with the after parameter until it returns null, the requested cap is reached, or repeated cursors indicate no new results.

Can I collect Reddit data when shell requests are blocked?▼

Yes. When direct shell requests return 403 or TLS errors, open reddit.com in a logged-in Chrome tab and run same-origin fetch calls from that page. This uses the existing session without exporting cookies or credentials.

Does Reddit comment collection handle deleted or removed posts?▼

The normalization script skips bodies marked [deleted] or [removed], empty content, ads, and promoted posts. Every exclusion is counted in the summary so the audit trail shows exactly what was filtered out.

What are the limitations of Reddit search data for prevalence analysis?▼

Search listings are discovery samples, not complete census data. Thousands of replies under one viral thread should be capped or weighted per parent thread rather than counted as independent market prevalence, and the rule must be disclosed.

Related Skills

Explore More Data & Analytics Skills→
aurelio-amerioaurelio-amerio

literature_research

Conduct literature research and generate structured references.md files.

Community
Advanced
igeligeligeligel
44

customer-research

Analyze customer interviews, surveys, and support tickets to generate research synthesis reports.

Community
Advanced
nexscope-ainexscope-ai
38

ecommerce.amazon-niche-reviews-by-keyword

Analyze Amazon customer reviews for sentiment and pain points by keyword.

Official
Intermediate
efiadmefiadm

API Integration Specialist

Integrate third-party REST and GraphQL APIs with authentication, error handling, and retries.

Community
Advanced