Administration

Parallel Shells

• C3 (Cluster Command and Control) A set of command line tools for typical cluster tasks.
• PDSH Parallel Distributed Shell

User Environments

• Modules Software Environment Management

File Broadcast Utilities

• pcp is a system for replicating files on multiple nodes of a PC cluster. Replication is done by building an n-ary tree of TCP sockets and using parallelized, pipelined data transfers which use RSA authentication. For large file transfers or replication on many nodes, pcp provides highly efficient data transfers when compared to existing alternatives (e.g., NFS).
• zsync is a file transfer program. It allows you to download a file from a remote server, where you have a copy of an older version of the file on your computer already. zsync downloads only the new parts of the file. It uses the same algorithm as rsync. However, where rsync is designed for synchronising data from one computer to another within an organisation, zsync is designed for file distribution, with one file on a server to be distributed to thousands of downloaders.
• nettee is a network "tee" program. It can typically transfer data between N nodes at (nearly) the full bandwidth provided by the switch which connects them. It is handy for cloning nodes or moving large database files.