Archives


- Beowulf
- Beowulf Announce
- Scyld-users
- Beowulf on Debian

[Beowulf] dedupe filesystem

Many of your questions may have already been answered in earlier discussions or in the FAQ. The search results page will indicate current discussions as well as past list serves, articles, and papers.

Search

Michael Di Domenico mdidomenico4 at gmail.com
Tue Jun 2 09:34:26 PDT 2009


does anyone have an opinion on dedup'ing files on a filesystem, but
not in the context of backups?  I did a google search for a program,
but only seemed to find the big players in the context of backups and
block levels.  i just need a file level check and report.

Is scanning the filesystem and md5'ing the files really the best (or
only) way to do this?



More information about the Beowulf mailing list