extract-knowledge-graph

Extract concepts, APIs, tools, and relations from markdown corpora into JSON and Mermaid graphs.

8|1|Updated Apr 20, 2018
One-click install
npx skills add https://github.com/Executioner1939/awesome-engineering-research --skill extract-knowledge-graph
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: extract-knowledge-graph
Source: https://github.com/Executioner1939/awesome-engineering-research/tree/main/.claude/skills/extract-knowledge-graph
Command: npx skills add https://github.com/Executioner1939/awesome-engineering-research --skill extract-knowledge-graph

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill converts a captured markdown documentation corpus into structured, queryable knowledge by extracting concepts, APIs, tools, entities, and the relationships between them.

Core Features & Use Cases

  • Candidate extraction and semantic structuring: Detects likely concepts, API references, tool mentions, and entities from each captured page.
  • Canonicalization with stable IDs: Collapses aliases into unified nodes and reuses existing indexed IDs when available, otherwise allocates new ULIDs.
  • Relation extraction and graph emission: Produces relationship edges (e.g., extracted-from, defines, exposes, uses/part-of) and emits both JSON and Mermaid graph outputs.
  • Optional repo-backed enrichment: Enriches API extraction from cloned source repositories (notably Rust via rustdoc JSON) when available.

Quick Start

Use the extract-knowledge-graph pipeline after scrape-firecrawl when you need structured semantic extraction beyond link graphs, such as turning a topic’s scraped markdown corpus into a Mermaid and JSON knowledge graph for that topic and tool.

Frequently Asked Questions about extract-knowledge-graph

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract a knowledge graph from markdown documentation?

Knowledge graph extraction from markdown documentation detects concepts, APIs, and entities, then emits navigable relationship edges in both JSON and Mermaid formats. It canonicalizes aliases into unified nodes with stable ULIDs to avoid dangling edges.

What is the best way to convert scraped docs into a Mermaid graph?

The best way to convert scraped docs into a Mermaid graph is by extracting semantic entities and relationship edges from the captured markdown corpus. The pipeline outputs a structured .mmd file alongside a knowledge.json file to build navigable graph facets.

How does entity resolution and alias collapsing work for a documentation corpus?

Entity resolution and alias collapsing for a documentation corpus work by detecting equivalent entity mentions across pages and mapping them to canonical nodes. The pipeline reuses existing indexed IDs when available or allocates new ULIDs for stable identity.

Does knowledge graph extraction work with Rust source repositories?

Knowledge graph extraction works with Rust source repositories by using optional repo-backed enrichment. It leverages rustdoc JSON to enrich API extraction when a cloned source repository is available alongside the markdown documentation corpus.

What relationships are extracted when generating an API knowledge graph?

When generating an API knowledge graph, the pipeline extracts relationships such as extracted-from, defines, exposes, and uses or part-of. These relation edges are validated against canonical nodes to prevent dangling connections in the graph output.

When should I use a knowledge graph pipeline instead of a simple link graph?

You should use a knowledge graph pipeline instead of a simple link graph when you need structured semantic extraction beyond page links. It transforms a topic's scraped markdown corpus into canonical nodes and navigable graph facets suitable for large corpora.