[Beowulf] copying big files

Perry E. Metzger perry at piermont.com
Fri Aug 8 12:57:16 EDT 2008


Henning Fehrmann <henning.fehrmann at aei.mpg.de> writes:
> Coping a big file onto all nodes in a cluster is a rather common problem.
> I would have thought that there might be a standard tool for 
> distributing the files in an efficient way. So far, I haven't found one.

bittorrent works quite well, and is trivial to use. It will use all
your IO bandwidth between all nodes (which is what you want I
presume.)

Perry
-- 
Perry E. Metzger		perry at piermont.com
_______________________________________________
Beowulf mailing list, Beowulf at beowulf.org
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf



More information about the Beowulf mailing list