crawl-fetch-ingest

Crawls VC firm websites and PDFs to extract structured metadata for teams, portfolios, and CEOs.

4|Updated May 4, 2026
One-click install
npx skills add https://github.com/lossless-group/lossless-agent-skills --skill crawl-fetch-ingest
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: crawl-fetch-ingest
Source: https://github.com/lossless-group/lossless-agent-skills/tree/main/crawl-fetch-ingest
Command: npx skills add https://github.com/lossless-group/lossless-agent-skills --skill crawl-fetch-ingest

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pillow, imagemagick, rembg, and includes scripts (resource) components.

What problem does it solve?

VC firms scatter team bios, portfolio companies, and brand assets across multiple sub-pages and PDFs. Manually collecting headshots, LinkedIn URLs, logos, and titles for investment decks and memos is tedious and error-prone. This Skill automates the entire extraction and normalization pipeline.

Core Features & Use Cases

  • Four-Checkpoint Cascade: Systematically extracts VC team members, external advisors, portfolio companies, and portfolio CEOs with human-confirmation gates at each stage.
  • Dual Anchor Types: Supports both firm-anchored walks (one VC → team → portfolio → CEOs) and company-anchored credibility-card walks (operating company → backers → backer teams + portfolios).
  • SVG-First Brand Asset Pipeline: Retrieves logos via a seven-tier cascade (inline SVG → site paths → press kits → Brandfetch → vector repos → Google CSE → raster fallback) with automatic background stripping and validation.
  • Cross-Tool Fallbacks: Chains Jina Reader, Firecrawl, Tavily, OpenGraph.io, and Brandfetch with intelligent escalation and global caching to minimize cost and handle JS-gated sites.

Quick Start

Use the crawl-fetch-ingest skill to fill in the team and portfolio metadata for Sequoia Capital from their website and the attached deck PDF.

Frequently Asked Questions about crawl-fetch-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract VC team headshots and LinkedIn URLs from websites and PDFs?

To extract VC team headshots and LinkedIn URLs, you can crawl firm websites and PDFs using a four-checkpoint cascade that retrieves metadata and normalizes executive bios. It collects headshots and LinkedIn URLs directly from sub-pages and attached documents.

What is the best way to scrape portfolio company logos and strip backgrounds automatically?

The best way to scrape portfolio company logos and strip backgrounds is using an SVG-first brand asset pipeline. It retrieves logos via a seven-tier cascade and applies automatic background stripping using rembg to normalize the final output.

How do I automate data ingestion for investment memos when VC sites are JS-gated?

To automate data ingestion for investment memos on JS-gated VC sites, you can use cross-tool fallbacks that chain Jina Reader, Firecrawl, Tavily, and OpenGraph.io. This intelligent escalation handles JavaScript rendering and caches responses globally.

Does this web scraping pipeline support company-anchored walks to find external backers?

Yes, this web scraping pipeline supports company-anchored walks. It can start from an operating company to find its backers, then crawl the backer teams and portfolios to generate structured credibility-card metadata.

When do I need human confirmation gates during portfolio metadata extraction?

You need human confirmation gates during portfolio metadata extraction at each of the four checkpoints in the cascade. The pipeline outputs confidence-flagged schemas for team members, portfolio companies, and CEOs to ensure human review.