skills.rest
semantica-agi
semantica-agiOFFICIAL
Explore all skills by this author →
Website𝕏@BuildSemanticaGitHub

deduplicate

Detect and merge duplicate entities, groups, and relationships in Semantica knowledge graphs.

3.0k|350|Updated Jun 25, 2025
Search Tags:#graph#knowledge-graph#deduplicate#duplicate-detection#fuzzy-matching#entity-resolution#semantica
One-click install
npx skills add https://github.com/semantica-agi/semantica --skill deduplicate-semantica-agi
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: deduplicate
Source: https://github.com/semantica-agi/semantica/tree/main/plugins/skills/deduplicate
Command: npx skills add https://github.com/semantica-agi/semantica --skill deduplicate-semantica-agi

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Detects and removes duplicate entities, entity groups, and duplicate relationships within the Semantica knowledge graph to improve data quality and decision traceability.

Core Features & Use Cases

  • Entity deduplication: identify near-duplicate entities and merge them or link them to a canonical representative.
  • Group deduplication: collapse similar entity groups to prevent fragmentation.
  • Relationship deduplication: normalize duplicate edges and ensure consistent relationship representations.
  • Use Case: After data ingestion or schema evolution, run deduplication to reduce noise and improve query results.

Quick Start

Run /semantica:deduplicate entities --threshold 0.8 to detect and group duplicate entities, and apply merge recommendations to consolidate them.

Frequently Asked Questions about deduplicate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I deduplicate entities in a knowledge graph after data ingestion?▼

Entity deduplication identifies near-duplicate entities and merges them or links them to a canonical representative, reducing noise and preventing fragmentation across your datasets.

What is the best way to detect duplicate relationships in a knowledge graph?▼

Detecting duplicate relationships involves normalizing duplicate edges and ensuring consistent relationship representations to improve data quality and decision traceability across the graph.

Can I configure fuzzy matching thresholds for entity resolution?▼

Yes, entity resolution uses a DuplicateDetector API with configurable thresholds, allowing you to specify similarity scores to control how duplicate candidates are grouped.

When should I run duplicate detection on my knowledge graph?▼

You should run duplicate detection after data ingestion, schema changes, or entity evolution to remove noise, improve data quality, and ensure consistent query results.

Does group deduplication collapse similar entity groups to prevent fragmentation?▼

Yes, group deduplication collapses similar entity groups to prevent data fragmentation, ensuring that related entities are properly consolidated within the knowledge graph.

Related Skills

Explore More Data & Analytics Skills→
Hawksight-AIHawksight-AI
2.9k

deduplicate

Detect and merge duplicate entities and relationships in knowledge graphs using fuzzy matching.

Official
Intermediate
jsagirjsagir
2

query

Translate natural language questions into knowledge graph queries and return graph paths.

Community
Basic
semantica-agisemantica-agi
3.0k

provenance

Trace provenance metadata and audit trails within Semantica graphs.

Official
Intermediate
zilliztechzilliztech
3

duplicate-detection

Detect exact and near-duplicate records using hash checks and semantic similarity.

Official
Advanced