[Beowulf] PetaBytes on a budget, take 2

Greg Lindahl lindahl at pbm.com
Thu Jul 21 15:07:42 PDT 2011


On Thu, Jul 21, 2011 at 02:55:30PM -0400, Ellis H. Wilson III wrote:

> My personal experience with getting large amounts of data from local
> storage to HDFS has been suboptimal compared to something more raw,

If you're writing 3 copies of everything on 3 different nodes, then
sure, it's a lot slower than writing 1 copy. The benefit you get from
this extra up-front expense is resilience.

-- greg





More information about the Beowulf mailing list