deduplicate

Name: deduplicate
Availability: InStock
Author: Semantica

Detect and merge duplicate entities, groups, and relationships in Semantica knowledge graphs.

3.0k|350|Updated Jun 25, 2025

Search Tags:#graph #knowledge-graph #deduplicate #duplicate-detection #fuzzy-matching #entity-resolution #semantica

Ready to run

npx skills add https://github.com/semantica-agi/semantica --skill deduplicate-semantica-agi

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: deduplicate
Source: https://github.com/semantica-agi/semantica/tree/main/plugins/skills/deduplicate
Command: npx skills add https://github.com/semantica-agi/semantica --skill deduplicate-semantica-agi

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Detects and removes duplicate entities, entity groups, and duplicate relationships within the Semantica knowledge graph to improve data quality and decision traceability.

Core Features & Use Cases

Entity deduplication: identify near-duplicate entities and merge them or link them to a canonical representative.
Group deduplication: collapse similar entity groups to prevent fragmentation.
Relationship deduplication: normalize duplicate edges and ensure consistent relationship representations.
Use Case: After data ingestion or schema evolution, run deduplication to reduce noise and improve query results.

Quick Start

Run /semantica:deduplicate entities --threshold 0.8 to detect and group duplicate entities, and apply merge recommendations to consolidate them.

Frequently Asked Questions about deduplicate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I deduplicate entities in a knowledge graph after data ingestion?▼

Entity deduplication identifies near-duplicate entities and merges them or links them to a canonical representative, reducing noise and preventing fragmentation across your datasets.

What is the best way to detect duplicate relationships in a knowledge graph?▼

Detecting duplicate relationships involves normalizing duplicate edges and ensuring consistent relationship representations to improve data quality and decision traceability across the graph.

Can I configure fuzzy matching thresholds for entity resolution?▼

Yes, entity resolution uses a DuplicateDetector API with configurable thresholds, allowing you to specify similarity scores to control how duplicate candidates are grouped.

When should I run duplicate detection on my knowledge graph?▼

You should run duplicate detection after data ingestion, schema changes, or entity evolution to remove noise, improve data quality, and ensure consistent query results.

Does group deduplication collapse similar entity groups to prevent fragmentation?▼

Yes, group deduplication collapses similar entity groups to prevent data fragmentation, ensuring that related entities are properly consolidated within the knowledge graph.