Archives


- Beowulf
- Beowulf Announce
- Scyld-users
- Beowulf on Debian

[Beowulf] Accelerator for data compressing

Many of your questions may have already been answered in earlier discussions or in the FAQ. The search results page will indicate current discussions as well as past list serves, articles, and papers.

Search

Carsten Aulbert carsten.aulbert at aei.mpg.de
Fri Oct 3 02:27:36 PDT 2008


Hi all

Bill Broadley wrote:
> 
> Another example:
> http://bbs.archlinux.org/viewtopic.php?t=11670
> 
> 7zip compress: 19:41
> Bzip2 compress:  8:56
> Gzip compress:  3:00
> 
> Again 7zip is a factor of 6 and change slower than gzip.

Have you looked into threaded/parallel bzip2?

freshmeat has a few of those, e.g.

http://freshmeat.net/projects/bzip2smp/
http://freshmeat.net/projects/lbzip2/

(with the usual disclaimer that I haven't tested them myself).

HTH

carsten



More information about the Beowulf mailing list