[Beowulf] Accelerator for data compressing

[Vincent Diepeveen]

Well that's obvious what happens there, that's not really new,  
already the old good pkzip was storing files it couldn't compress
uncompressed.

Note the type of files you mention you can compress quite well still  
with PPM, which really is nothing new anymore.

All the old zippers are LZ77/Huffman/RLE based, so they miss the big  
picture always.
JPG is a lot tougher to compress well, but well as i said, there is  
always the cheap option of a filesystem storing that uncompressesd :)

What gets shipped however most over the networks is XML data from all  
those media networks.
Now that compresses *real well*.
Just compress it single time and keep it compressed :)

Vincent

On Oct 3, 2008, at 5:59 PM, Joe Landman wrote:

> Vincent Diepeveen wrote:
>> The question is Joe,
>> Why are you storing it uncompressed?
>
> Lets see now...
>
> Riddle me this Vincent:  What happens when you compress  
> uncompressable binary data?  Like RPMs, or .debs?  Or pdf's with  
> images, or images which have already been compressed?
>
> Any idea?
>
>
> -- 
> Joseph Landman, Ph.D
> Founder and CEO
> Scalable Informatics LLC,
> email: landman at scalableinformatics.com
> web  : http://www.scalableinformatics.com
>        http://jackrabbit.scalableinformatics.com
> phone: +1 734 786 8423 x121
> fax  : +1 866 888 3112
> cell : +1 734 612 4615