MPI - The Complete Reference: Volume 1, The MPI Core (2nd ed)

By Marc Snir, Steve Otto, Steven Huss-Lederman, David Walker, and Jack Dongarra. This volume, the definitive reference manual for the latest version of MPI-1 includes examples. ISBN 0-262-69215-5

Introduction to High Performance Scientific Computing

A book by Victor Eijkhout. This is a textbook that teaches the bridging topics between numerical analysis, parallel computing, code performance, large scale applications. PDF version if free!

HPC For Dummies (an ebook) by Douglas Eadline

A short introduction to HPC, but not for dummies either! The ebook is available for free after registration. Get the essentials.

Engineering a Beowulf-Style Compute Cluster by Robert G. Brown

A freely available book on building/designing Beowulf style clusters.

Building Clustered Linux Systems by Robert W. Lucke

A very good overview of cluster computing methods and hardware. The book provides a rather wide coverage of options, but does not dive too deep into any one approach. It is somewhat HP focused as author works for HP. (648 Pages) ISBN: 0-13-144853-6

The Linux Enterprise Cluster by Karl Kopper

Focuses on the enterprise cluster (not HPC) and covers failover, heartbeat, load balancing, reliable printing/web server, and how to build a job scheduling system. Good coverage and examples. (464 pages) ISBN: 0-13-144853-6

How to Build a Beowulf by Thomas Sterling, John Salmon, Donald J. Becker and Daniel F. Savarese

The first book on Beowulf cluster computing. Published in 1999, it is now quite dated. Both hardware and software have moved past the text. It does provide good coverage of the issues facing the cluster builder. (261 pages) ISBN 0-262-69218-X

MPI: The Complete Reference: Volume 2 - The MPI-2 Extensions

by William Gropp, Steven Huss-Lederman, Andrew Lumsdaine, Ewing Lusk, Bill Nitzberg, William Saphir and Marc Snir, This volume presents a complete specification of the MPI-2 Standard with examples. MIT Press, ISBN 0-262-57123-4

Beowulf Cluster Computing with Linux, Second Edition by William Gropp, Ewing Lusk and Thomas Sterling

Updated edition, now edited by William Gropp, Ewing Lusk (in addition to Sterling). Provides a good, but high level view of Linux clustering. This edition includes ROCKS and OSCAR coverage plus other important issues. (504 pages) ISBN 0-262-69292-9

Beowulf Cluster Computing with Linux by Thomas Sterling

The next book after "How to Build a Beowulf" by Tom Sterling. Coverage is much expanded, but now very high level as chapters are written by key players in the cluster community. (536 pages) ISBN 0-262-69274-0