wiki-dedup

Detect and merge duplicate pages in an Obsidian wiki vault.

Updated Nov 9, 2023
One-click install
npx skills add https://github.com/oresttokovenko/dot-files --skill wiki-dedup-oresttokovenko
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: wiki-dedup
Source: https://github.com/oresttokovenko/dot-files/tree/main/chezmoi/dot_agents/skills/wiki-dedup
Command: npx skills add https://github.com/oresttokovenko/dot-files --skill wiki-dedup-oresttokovenko

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Obsidian wikis accumulate duplicate pages covering the same concept under different names (e.g. "RSC" vs "React Server Components"), fragmenting knowledge and breaking link graphs. This Skill finds those identity collisions and merges them safely. ## Core Features & Use Cases - Candidate Detection: Scores page pairs using title token overlap, edit distance, substring containment, alias cross-matching, and tag/category signals, with confidence tiers (HIGH ≥ 0.90, MEDIUM 0.75–0.89). - Three Operating Modes: Audit (report only), interactive merge with per-pair confirmation, and auto-merge for high-confidence pairs. - Safe Merging: Picks a canonical page via tiebreakers, merges frontmatter and body content, writes a redirect stub at the old path, rewrites wikilinks vault-wide, and takes a Git snapshot before any writes. - Use Case: After months of ad-hoc note-taking, run an audit to discover that "fine-tuning" and "finetuning" are separate pages, then merge them into one canonical page with all links updated. ## Quick Start Ask the assistant to dedup your wiki by saying "dedup my wiki" or "find duplicate pages in my Obsidian vault".

Frequently Asked Questions about wiki-dedup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find duplicate pages in my Obsidian vault?

Run the skill in audit mode, which scans all markdown files, scores page pairs using title similarity, alias cross-matching, and tag overlap, then reports candidates with confidence tiers. No files are modified during an audit.

How to merge two notes covering the same topic in Obsidian?

Use merge mode to review each confirmed pair interactively. The skill picks a canonical page, merges aliases, tags, sources, and body content, writes a redirect stub at the old path, and rewrites all wikilinks pointing to the merged page.

Can wiki page merges be undone if something goes wrong?

Yes, if the vault is a standalone Git repository. The skill commits a pre-write snapshot before any edits, and you can restore with git reset --hard to the snapshot SHA. Non-Git vaults skip the snapshot silently.

What is the difference between wiki-dedup and wiki-lint?

wiki-dedup performs destructive page-level merges of duplicate concepts, while wiki-lint only checks vault structure and validates that redirect stubs resolve correctly. Dedup changes content; lint only reports structural issues.

When should I not auto-merge duplicate wiki pages?

Avoid auto-merge for related-but-distinct concepts like "GPT-3" vs "GPT-4" or "agents" vs "autonomous agents". Auto-merge only processes pairs scoring 0.90 or higher; review medium-confidence and needs-review pairs manually.