[Beowulf] copying big files (Henning Fehrmann)
jclinton at advancedclustering.com
Sun Aug 10 15:13:36 EDT 2008
On Fri, Aug 8, 2008 at 11:11 AM, David Mathog <mathog at caltech.edu> wrote:
> Henning Fehrmann <henning.fehrmann at aei.mpg.de> wrote:
>> Coping a big file onto all nodes in a cluster is a rather
>> common problem. I would have thought that there might be a
>> standard tool for distributing the files in an efficient way.
>> So far, I haven't found one.
We have used udpcast successfully hundreds of times:
Only complaint would be that it doesn't handle a machine dropping out
on the receive side very well. With a little patch, it could be made
to be forgiving in that regard.
Jason D. Clinton
Advanced Clustering Technologies, Inc.
Beowulf mailing list, Beowulf at beowulf.org
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf
More information about the Beowulf