[Beowulf] dedupe filesystem

[Michael Di Domenico]

On Tue, Jun 2, 2009 at 1:39 PM, Ashley Pittman <ashley at pittman.co.uk> wrote:
> I'm not sure I understand the question, if it's a case of looking for
> duplicate files on a filesystem I use fdupes
>
> http://premium.caribe.net/~adrian2/fdupes.html

Fdupes is indeed the type of app i was looking for.  I did run into
one catch with it though, on first run it trounced down into a NetApp
snapshot directory.  Dupes galore...

It would be nice if it kept a log too, so that if the files are the
same on a second go around it didn't have to md5 every file all over
again.