[Beowulf] copying data between clusters

[Scott Beardsley]

> I'd like to paralyze that across multiple nodes to drive the aggregate up
> 
> I was hoping someone would pop up say, hey use this magical piece of
> software. (of which im unable to locate)..

Sounds like what we are doing with hadoop and gridftp-hdfs for our LHC
cluster. Basically you would run N gridftp servers where N is the number
of nodes (and preferably uncontended uplinks as well) on the destination
cluster. Then run something like bestman[1] (it'll act as a director).
It is a non-trivial stack of software but it should get the job done.

Scott
-----------
[1] https://sdm.lbl.gov/bestman/