wiki-dedup

Detect duplicate pages in an Obsidian wiki by comparing frontmatter and content.

Updated Apr 27, 2014
One-click install
npx skills add https://github.com/Nirajkashyap/nirajkashyap.github.io --skill wiki-dedup-nirajkashyap
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: wiki-dedup
Source: https://github.com/Nirajkashyap/nirajkashyap.github.io/tree/main/.agents/skills/wiki-dedup
Command: npx skills add https://github.com/Nirajkashyap/nirajkashyap.github.io --skill wiki-dedup-nirajkashyap

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Scan the Obsidian wiki for page-level identity collisions — different pages covering the same concept under different names (e.g. "RSC" vs "React Server Components") — and merge them. Use this skill when the user says "dedup my wiki", "find duplicate pages", "merge duplicates", "identity resolution", "consolidate my wiki", "I have duplicate pages", or "my wiki has two pages for the same thing". Distinct from wiki-lint (which checks structure) and cross-linker (which adds links) — this skill makes destructive page-level merges and requires careful confirmation.

Core Features & Use Cases

  • Detects candidate page pairs by comparing frontmatter (title, aliases, tags) and category.
  • Supports three modes: Audit (default), Merge (--merge), and Auto-merge (--auto) with confidence scoring.
  • Provides an auditable, human-in-the-loop workflow for safe identity resolution and page deduplication.

Quick Start

Audit mode to surface candidate duplicates, then run with --merge to apply confirmed merges or --auto to process high-confidence merges automatically.

Frequently Asked Questions about wiki-dedup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find and merge duplicate pages in my Obsidian wiki?

To merge duplicate pages in an Obsidian wiki, use the Audit mode to surface candidate pairs by comparing frontmatter and content, then apply confirmed merges in Merge or Auto-merge mode for safe identity resolution.

What is the safest way to consolidate duplicate wiki pages without losing data?

The safest way to consolidate duplicate wiki pages is using a triage workflow with Audit mode to review candidates first, ensuring human-in-the-loop confirmation before any destructive page-level merges are applied.

How does identity resolution work for Obsidian wiki pages with different names?

Identity resolution detects page-level collisions by comparing frontmatter fields like title, aliases, tags, and category to surface candidates representing the same concept under different names, then computes a base confidence score to guide merge recommendations.

Can I automatically merge high-confidence duplicate pages in my knowledge management wiki?

You can automatically merge high-confidence duplicate pages using Auto-merge mode, which processes candidates based on computed confidence scores while still respecting safe-guard rules to prevent destructive changes.

What is the difference between wiki dedup and wiki lint for Obsidian?

Wiki dedup focuses on identifying and merging page-level identity collisions, whereas wiki lint checks structural integrity. Dedup performs destructive page-level merges requiring careful confirmation, while lint verifies organizational structure.

When should I use manual merge instead of auto-merge for duplicate wiki pages?

Use manual Merge mode when duplicate candidates have lower confidence scores or require human review of frontmatter and content differences, reserving Auto-merge only for high-confidence pairs to prevent destructive changes.