[Beowulf] copying big files (Henning Fehrmann)
jclinton at advancedclustering.com
Sun Aug 10 12:13:36 PDT 2008
On Fri, Aug 8, 2008 at 11:11 AM, David Mathog <mathog at caltech.edu> wrote:
> Henning Fehrmann <henning.fehrmann at aei.mpg.de> wrote:
>> Coping a big file onto all nodes in a cluster is a rather
>> common problem. I would have thought that there might be a
>> standard tool for distributing the files in an efficient way.
>> So far, I haven't found one.
We have used udpcast successfully hundreds of times:
Only complaint would be that it doesn't handle a machine dropping out
on the receive side very well. With a little patch, it could be made
to be forgiving in that regard.
Jason D. Clinton
Advanced Clustering Technologies, Inc.
More information about the Beowulf