ray_image_deduplicator
OfficialEfficiently remove duplicate images at scale with Ray's distributed computing power.
Authorcas-bigdatalab
Version1.0.0
Installs0
System Documentation
What problem does it solve?
The Skill addresses the need for efficient and scalable image deduplication, particularly for large datasets.
Core Features & Use Cases
- Distributed Image Deduplication: Leverages Ray's distributed computing to perform deduplication across multiple nodes.
- Hash-based Matching: Uses image hashing techniques to identify and remove duplicates accurately.
- Use Case: Ideal for situations where you have a large collection of images and need to find and remove duplicates quickly and efficiently.
Quick Start
Use the ray_image_deduplicator skill to deduplicate images from the provided JSON file 'input.json' and output the results to 'output.json'.
Dependency Matrix
Required Modules
rayredispy-data-juicerimagededup
Components
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: ray_image_deduplicator Download link: https://github.com/cas-bigdatalab/piflow/archive/main.zip#ray-image-deduplicator Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.