Archives


- Beowulf
- Beowulf Announce
- Scyld-users
- Beowulf on Debian

[Beowulf] Big storage

Many of your questions may have already been answered in earlier discussions or in the FAQ. The search results page will indicate current discussions as well as past list serves, articles, and papers.

Search

Greg Lindahl lindahl at pbm.com
Tue Apr 15 16:31:34 PDT 2008


On Tue, Apr 15, 2008 at 06:02:51PM -0500, Bruce Allen wrote:

> So far we have not seen any signs of data corruption on Linux+Areca 
> systems (and our data files carry both internal and external checksums, so 
> we would be sensitive to this).

Check out these papers from Fast08, they're based on NetApp data for
more than a million disks:

http://www.usenix.org/event/fast08/tech/full_papers/krioukov/krioukov.pdf 
http://www.usenix.org/event/fast08/tech/full_papers/bairavasundaram/bairavasundaram.pdf
http://www.usenix.org/event/fast08/tech/full_papers/jiang/jiang.pdf 

And, finally, this one makes you wonder how Linux storage works at all:

http://www.usenix.org/event/fast08/tech/full_papers/gunawi/gunawi.pdf

Internal checksums for small files can be defeated for lost writes. I
take it that your external checksums are stored in a totally different
place? In which case you ought to be pretty well covered.

-- greg







More information about the Beowulf mailing list