[Beowulf] copying data between clusters

Andrew Fitz Gibbon fitz at cs.earlham.edu
Fri Mar 5 13:00:49 EST 2010


On Mar 5, 2010, at 11:32 AM, Michael Di Domenico wrote:

> I was hoping someone would pop up say, hey use this magical piece of
> software. (of which im unable to locate)..

You might want to take a look at GridFTP from Globus (http:// 
globus.org). Among other things, it has support for parallel data  
streams and is specifically designed for transferring lots of data  
between clusters. It's distributed as part of the Toolkit, and it's  
not too hard to build /just/ GridFTP.

As with any recommended software, YMMV.

----------------
Andrew Fitz Gibbon
fitz at cs.earlham.edu



_______________________________________________
Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf



More information about the Beowulf mailing list