medium-sub

To scrape Medium recommended articles for multiple tags, use a Playwright-based fetcher to retrieve candidate lists from medium.com/tag/<tag>/recommended and group metadata by tag. This approach extracts titles, cleaned URLs, published dates, and authors without downloading full articles.

The best way to get structured JSON from Medium tag pages is running a Playwright-based fetcher that emits a single clean JSON object to stdout. It groups article cards by tag, keeping logs separate on stderr for clean pipeline ingestion.

Yes, you need Node.js with Playwright installed in Chrome persistent-profile mode to fetch Medium article listings. This environment is required to automate browser interactions and extract candidate article metadata from dynamic Medium recommended pages.

Yes, you can limit the number of articles fetched per Medium tag by passing an optional max-per-tag argument. This allows you to control the volume of candidate articles retrieved for each tag before the structured JSON is emitted to stdout.

No, this Medium scraper does not handle cross-day deduplication or file persistence. It is designed as a pure fetcher that outputs JSON to stdout, leaving deduplication, daily limits, and file writing responsibilities to the downstream caller pipeline.

To integrate Medium scraped data into a content pipeline, capture the JSON object emitted to stdout by the fetcher. The caller pipeline can then process the grouped article metadata to apply deduplication, archiving, and downstream content analysis.