Detect Duplicate Files

You can find duplicate files by recursively scanning your workspace and comparing content using SHA256 hashing. This identifies groups of identical files across directories and generates a markdown report summarizing their locations for cleanup.

SHA256 hashing identifies content-identical copies by generating a unique cryptographic hash for every file based on its contents. Files with matching hashes are grouped together as exact duplicates, regardless of their file names or directory paths.

Yes, you can scan large repos to clean up copy-pasted assets. The tool applies to codebases and projects of any size, recursively scanning directories while honoring exclusions to identify redundant files and help reclaim disk space.

The best way to report duplicate files for repo hygiene is to generate a human-readable markdown summary. This approach outputs a deduplication report showing groups of identical files, their sizes, and locations for easy maintenance.

Yes, duplicate file detection respects exclusion rules during the scan. It recursively traverses your workspace while honoring configured exclusions, ensuring specified directories or file types are skipped during the SHA256 hashing process.

The deduplication report is written to the configured output directory as a DUPLICATE_REPORT.md file. By default, this report is placed in a .forensics folder within the current workspace directory for easy access.