[Beowulf] copying big files (Henning Fehrmann)
Perry E. Metzger
perry at piermont.com
Fri Aug 8 09:58:07 PDT 2008
"David Mathog" <mathog at caltech.edu> writes:
> The biggest problem with chain methods is that it is difficult to
> recover if something breaks in the middle during the transfer. My
> cluster is only 20 nodes and it has not been an issue, but on a 2000
> node cluster it probably would be. It is of course also important that
> all of the nodes in the distribution chain have sufficient free network
> and CPU resources. If there are any slow nodes the whole chain will be
> slow since the slow nodes will be rate limiting.
Is there a reason bittorrent isn't suited to this application?
Perry E. Metzger perry at piermont.com
More information about the Beowulf