find-duplicates

Detect duplicate and near-duplicate paragraphs across documentation directories.

78|252|Updated Feb 7, 2024
One-click install
npx skills add https://github.com/hashicorp/web-unified-docs --skill find-duplicates
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: find-duplicates
Source: https://github.com/hashicorp/web-unified-docs/tree/main/content/well-architected-framework/docs/.claude/skills/find-duplicates
Command: npx skills add https://github.com/hashicorp/web-unified-docs --skill find-duplicates

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill helps documentation teams identify exact and near-duplicate content across multiple documents, enabling consolidation and the DRY (Don't Repeat Yourself) principle.

Core Features & Use Cases

  • Detect exact and near-duplicate paragraphs across documents.
  • Identify duplicated sections to consolidate into canonical topics.
  • Propose cross-links and canonical sources to reduce actual duplication.

Quick Start

Use the find-duplicates skill to scan your docs directory:

  • Example: /find-duplicates docs/
  • Optional: /find-duplicates docs/ --threshold 80

Frequently Asked Questions about find-duplicates

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I detect duplicate content across multiple documentation files?

To detect duplicate content across documentation, you can scan a specified directory path to surface exact paragraph matches, repeated sections, and duplicated code blocks for consolidation. This process identifies exact and near-duplicate text to reduce redundancy.

What is the best way to find near-duplicate paragraphs in docs for consolidation?

Finding near-duplicate paragraphs requires scanning your documentation directory with an optional similarity threshold. This surfaces grouped duplicates with recommendations, enabling you to apply the DRY principle and consolidate repeated sections into canonical topics.

How do I scan a docs directory to identify repeated code blocks and sections?

Scanning a docs directory to identify repeated code blocks requires providing a scan path like /find-duplicates docs/. You can optionally include a similarity threshold flag to control the matching sensitivity and produce grouped duplicate results.

Can I set a custom similarity threshold for text-similarity detection in documentation?

Yes, you can set a custom similarity threshold for text-similarity detection by passing an optional flag like --threshold 80. This adjusts the sensitivity of the scan to group exact and near-duplicate content across your documents.

Does duplicate documentation detection provide recommendations for cross-linking?

Yes, duplicate documentation detection provides recommendations for cross-linking and canonical sources. After surfacing grouped duplicates, it proposes consolidation actions to reduce actual duplication and establish canonical topics across the content directory.