yc-jobs-scraper

Scrape YCombinator job listings into a local SQLite database.

581|60|Updated Apr 13, 2026
One-click install
npx skills add https://github.com/Varnan-Tech/opendirectory --skill yc-jobs-scraper
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: yc-jobs-scraper
Source: https://github.com/Varnan-Tech/opendirectory/tree/main/skills/yc-intent-radar-skill/yc-jobs-scraper
Command: npx skills add https://github.com/Varnan-Tech/opendirectory --skill yc-jobs-scraper

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, better-sqlite3, dotenv, sqlite3, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the process of scraping job listings from YCombinator and storing them in a local database to prevent duplicate entries.

Core Features & Use Cases

  • Job Listing Extraction: Automatically scrape job listings from YCombinator's Workatastartup platform.
  • Authentication Handling: Bypass login bottlenecks by saving session state.
  • Database Management: Maintain a local SQLite database to track historical jobs and prevent duplicates.
  • Use Case: Use this Skill to keep an updated list of job openings at YCombinator companies without manually checking the website.

Quick Start

Use the yc-jobs-scraper skill to scrape the latest job listings from YCombinator.

Frequently Asked Questions about yc-jobs-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape YCombinator job listings and save them to a local database?

This skill scrapes YCombinator job listings using Playwright for browser automation and stores them in a local SQLite database. This automated approach prevents duplicate job entries and maintains a historical record.

Can I use Playwright to bypass login bottlenecks when scraping Workatastartup?

Yes, you can use Playwright to bypass login bottlenecks on Workatastartup by saving your session state in a state.json file. This allows the scraper to authenticate automatically and access job listings without manual login.

What's the best way to track historical job openings from YCombinator companies?

The best way to track historical job openings is to scrape them directly and maintain a local SQLite database. This method stores job listings automatically and checks against historical records to prevent tracking duplicates.

Do I need SQLite to prevent duplicate entries when scraping YCombinator jobs?

Yes, utilizing SQLite is required to prevent duplicate entries when scraping YCombinator jobs. The skill relies on the better-sqlite3 dependency to manage the local database and track historical job postings effectively.

Why does my YCombinator jobs scraper fail to authenticate during browser automation?

Your YCombinator jobs scraper fails to authenticate because it requires a state.json file for session management. You must configure Playwright to load this saved session state to bypass login bottlenecks successfully.