duplicate_detector_exact
OfficialEfficiently remove duplicate records with precision.
Authorcas-bigdatalab
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill addresses the challenge of identifying and removing exact duplicates from datasets, streamlining data cleaning processes.
Core Features & Use Cases
- Exact Duplicate Detection: Identify and handle fully identical records across all or specified fields.
- Retention Strategy: Choose to keep the first occurrence, last occurrence, none, or mark duplicates.
- Use Case: Ideal for data preprocessing in scenarios where unique records are crucial, such as customer database management or financial reporting.
Quick Start
Run the duplicate_detector_exact skill to remove duplicates from 'data.csv' and save the results to 'deduped.csv'.
Dependency Matrix
Required Modules
pandasopenpyxl
Components
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: duplicate_detector_exact Download link: https://github.com/cas-bigdatalab/piflow/archive/main.zip#duplicate-detector-exact Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.