[Beowulf] copying big files (Henning Fehrmann)

Perry E. Metzger perry at piermont.com
Fri Aug 8 12:58:07 EDT 2008


"David Mathog" <mathog at caltech.edu> writes:
> The biggest problem with chain methods is that it is difficult to
> recover if something breaks in the middle during the transfer.  My
> cluster is only 20 nodes and it has not been an issue, but on a 2000
> node cluster it probably would be.  It is of course also important that
> all of the nodes in the distribution chain have sufficient free network
> and CPU resources.  If there are any slow nodes the whole chain will be
> slow since the slow nodes will be rate limiting.

Is there a reason bittorrent isn't suited to this application?

-- 
Perry E. Metzger		perry at piermont.com
_______________________________________________
Beowulf mailing list, Beowulf at beowulf.org
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf



More information about the Beowulf mailing list