Eliminating duplicate photos

Patrick O'Callaghan pocallaghan at gmail.com
Mon Sep 29 18:39:05 UTC 2008


On Mon, 2008-09-29 at 14:00 -0400, Trapper wrote:
> Itamar - IspBrasil wrote:
> > create a list of md5 of all files,
> >
> > with md5 you will find duplicated files.
> >
> > On 9/29/2008 9:04 AM, Timothy Murphy wrote:
> >> What is the best way of eliminating duplicate photos
> >> on a number of machines, all running Fedora or CentOS?
> >>
> >> I suppose one could ask the same question about files generally;
> >> how to tag or delete duplicates.
> >>
> >> Any suggestions gratefully received.
> >>
> >>    
> I have a problem similar to Timothy's. If I run "md5sum *" on a folder, 
> in a terminal,  it lists all the sums. My problem is that I have several 
> thousand files. Is there some way I can output the results to a text 
> file? Can't copy and paste unless there's some way for me to adjust the 
> terminal to allow the last several thousand lines to display. Then I'm 
> also going to have to sort all those lines into some alphabetical order 
> to reasonably detect duplicate sums. Any ideas?

You're using Linux here. Anything that outputs text to a terminal can
send it to a file or to another program. You need to read up on Shell
redirection and filters, e.g.:

md5sum * > sums

or

md5sum * | sort > sorted_sums

etc. etc.

poc




More information about the fedora-list mailing list