Parser

Extract structured JSON with entities from URLs, videos, PDFs, and newsletters.

Updated Jul 10, 2026
One-click install
npx skills add https://github.com/Kaleb-Rupe/aurora --skill parser-kaleb-rupe
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: Parser
Source: https://github.com/Kaleb-Rupe/aurora/tree/main/claude/skills/Utilities/Parser
Command: npx skills add https://github.com/Kaleb-Rupe/aurora --skill parser-kaleb-rupe

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires uuid, ajv, ajv-formats, and includes references (resource) components.

What problem does it solve? Manually reading articles, videos, PDFs, and newsletters to catalog people, companies, links, and topics is slow and inconsistent. This Skill converts any content source into a single deterministic JSON schema with deduplicated entities, so parsed content can flow directly into a newsletter database or knowledge graph. ## Core Features & Use Cases - Universal Content Parsing: Auto-detects content type (YouTube, article, PDF, newsletter, Twitter thread) and routes to a specialized extraction workflow. - Entity Extraction with Collision Detection: Assigns UUID v4 GUIDs to people, companies, links, and sources, reusing existing GUIDs from a global entity index to prevent duplicates across content. - Batch Processing with Gemini: Processes 10-50 URLs in a single Gemini 3 Pro request for faster, cheaper, cross-article entity resolution. - Browser Extension Security Analysis: Analyzes browser extensions for clone detection, malicious permissions, C2 domains, and evasion techniques. - Use Case: Paste five article URLs and receive five schema-validated JSON files with summaries, entities, topics, and confidence scores, with all entities deduplicated against your existing index. ## Quick Start Ask the assistant to parse a URL such as "parse this YouTube video for the newsletter" and it will detect the content type, extract entities, and return validated JSON.

Frequently Asked Questions about Parser

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I parse a URL into structured JSON?

Provide the URL and the skill auto-detects the content type, routes to the matching extraction workflow, and outputs JSON validated against the content schema. Run lib/parser.ts with one or more URLs for command-line batch parsing.

What content types can this parser extract?

It supports YouTube videos, web articles, PDF documents, newsletters from Substack and Beehiiv, Twitter/X threads, and generic web pages. Detection uses domain, file extension, Content-Type headers, and OpenGraph metadata.

How does entity deduplication work across parsed content?

Each person, company, link, and source gets a canonical identifier such as a normalized name or URL. If the identifier exists in entity-index.json, the existing GUID is reused; otherwise a new UUID v4 is generated and added to the index.

Can I batch process multiple URLs at once?

Yes, the BatchEntityExtractionGemini3 workflow sends 10-50 URLs in a single Gemini 3 Pro request using its large context window. This is roughly 10x faster and far cheaper than parsing URLs individually.

What happens when parsing fails or content is paywalled?

The parser never fails completely; it extracts whatever data is available, lowers the confidence score, and records the issue in extraction_metadata.warnings. For 403 errors it attempts an archive.org fallback.