Parser

Parse online content into deterministic JSON with extracted entities.

12|Updated Aug 16, 2019
One-click install
npx skills add https://github.com/phatblat/dotfiles --skill parser
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: Parser
Source: https://github.com/phatblat/dotfiles/tree/main/.claude/skills/Parser
Command: npx skills add https://github.com/phatblat/dotfiles --skill parser

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires uuid, ajv, ajv-formats, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill automates the extraction of structured data from various online content types, eliminating the need for manual copy-pasting and data entry.

Core Features & Use Cases

  • Universal Parsing: Handles articles, YouTube videos, PDFs, newsletters, and Twitter threads.
  • Entity Extraction: Identifies and extracts people, companies, links, and topics.
  • Structured Output: Generates deterministic JSON output conforming to a defined schema.
  • Use Case: Automatically parse a batch of news articles to extract key entities and topics for a content database, or extract transcripts and metadata from YouTube videos for analysis.

Quick Start

Use the parser skill to extract all text and entities from the URL 'https://example.com/article'.

Frequently Asked Questions about Parser

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured JSON data from web scraping and online articles?

To extract structured JSON data from web scraping, you can parse diverse online content types like articles into a deterministic JSON schema. This process automatically identifies and extracts entities like people, companies, links, and topics.

Can I extract entities and transcripts from YouTube videos and PDFs?

Yes, you can extract entities and transcripts from YouTube videos and PDFs. The parser handles these diverse content types, extracting metadata, summaries, and key entities into a structured JSON output.

What is the best way to parse multiple Twitter threads and newsletters in batch?

The best way to parse multiple Twitter threads and newsletters in batch is using a universal content parser with batch processing support. It generates classifications and analysis while using collision detection for deduplication.

Does this parser require a specific JSON schema for content analysis output?

Yes, content analysis output conforms to a deterministic JSON schema validated using ajv and ajv-formats. This ensures structured data extraction from articles, videos, and PDFs remains consistent across batch processing.

How do I avoid duplicate entries when extracting people and companies from content?

To avoid duplicate entries when extracting people and companies, the parser uses collision detection for deduplication. This ensures batch processing of diverse content types yields a clean structured JSON dataset.