Quick Linux Tip #41:
Try: find /home/linuxteck -type f -exec md5sum {} + | sort | uniq -w32 -D
Info: md5sum hashes file contents, sort groups identical hashes, and uniq -w32 -D compares the 32-character hash to output all duplicate files.
Examples:
- $ find . -type f -exec md5sum {} + | sort | uniq -w32 -d # Show 1 sample per duplicate set
- $ fdupes -r /home/linuxteck # Dedicated tool (apt install fdupes)
- $ rdfind -deleteduplicates true /home/linuxteck # Auto-delete duplicates safely
Note: For large directories, fdupes or rdfind are purpose-built and significantly faster. Use sha256sum instead of md5sum if collision risk is a concern.
Leave a Reply