Editing Cluster Design

Jump to: navigation, search

Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
Latest revision Your text
Line 1: Line 1:
 
Clusters are all about design. Indeed, clusters are about designing machines
 
Clusters are all about design. Indeed, clusters are about designing machines
around problems. When designing a cluster the following '''basic''' questions  
+
around problems. When designing a cluster the following questions need to be
may be helpful. If you need help with answers, try asking on the [http://www.beowulf.org/mailman/listinfo/beowulf Beowulf Mailing List] or submit a question to the [[Cluster Questions]] section.
+
may be helpful
  
'''Consider your budget'''
+
Consider your budget?
* Do you need help with software and support? If so, reserve some funds for this part of the project. While clusters can be easy to set up initially, continued operation can be time consuming.  
+
* Do you need help with software and support? If so, reserve soem funds for this part of the project.
* Do you plan on assembling the cluster yourself? If yes, at what level? Starting from motherboards, cases, memory, processors, etc. can be very time consuming. Buy quality parts.
+
* Do you plan on assembling the cluster yourself? If yes, at what level? Starting from motherboards, cases, memory, processros, etc. can be very tiem consumeing. Buy quality parts
* If you plan on using a vendor, provide them with a detailed specification and don't forget to run benchmarks.
 
  
'''How many and what type of processors do I need?'''
+
How many processors?
* This depends on your application. How well does you application scale. Have you tested it on a real cluster? If it is a common application, have other run it on a cluster?
 
*It also depends on how you want to arrange your processors. The introduction dual-core CPUs make this a more interesting question.
 
  
'''What Type of Interconnect?'''
+
* This depends on your application. How well does you applicaiton scale. Have you tested it on a real cluster? If it is a common application, have other run it on a cluster?
*Again, this depends on your application. If you can use Gigabit Ethernet, then  you can probably buy more nodes. If you need a faster interconnect, then you may have to sacrifice nodes for interconnects to stay in your budget. Benchmarking your code(s) is important.
+
*  
* Remember Gigabit Ethernet performance will vary by chip-set, some are better than others.
 
  
'''What type of software?'''
+
What Type of Interconnect?
* This depends on your needs. There are several preconfigured distributions, but which one is best depends upon your needs.
 
  
'''Do I need disk drives on my nodes?'''
+
* Again, this depends on your applicaiton. If you can use Gigabit Ethernet, then you can probabaly by more nodes. If you need a faster interconnect, then you may have to sacrifie nodes for interconnects to stay in your budget.
* This decision also depends on on your needsIn some cases nodes can be run without hard drives, in others local swap or scratch space is needed.
 
  
'''What type of storage?'''
 
* do you need a parallel file system?
 
* Will a basic NFS setup be enough? Will it scale to the nodes you need?
 
* How do I construct a diskless cluster?
 
** Can I circumvent the local swap dilemma? 
 
  
There are many other questions that need to be answered, but these should give you a start. The book below (freely available) is also a good place to start.
 
  
 +
Books
  
 
+
* [http://www.phy.duke.edu/resources/computing/brahma/Resources/beowulf_book.php   Engineering a Beowulf-Style Compute Cluster by Robert G. Brown ] - A freely available book on building/designing Beowulf style clusters.
'''Books'''
 
 
 
* [http://www.phy.duke.edu/~rgb/Beowulf/beowulf_book.php Engineering a Beowulf-Style Compute Cluster by Robert G. Brown ] - A freely available book on building/designing Beowulf style clusters.
 
 
 
* See the Cluster Monkey [http://www.clustermonkey.net/Books/ Cluster Books Page ]
 
 
 
 
 
'''Tools'''
 
 
 
* [http://aggregate.org/CDR/ The Cluster Design Rules ] - A tool to help design a cluster tuned for an application
 

Please note that all contributions to Cluster Documentation Project are considered to be released under the Attribution-NonCommercial-ShareAlike 2.5 (see Cluster Documentation Project:Copyrights for details). If you do not want your writing to be edited mercilessly and redistributed at will, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource. Do not submit copyrighted work without permission!

To protect the wiki against automated edit spam, we kindly ask you to solve the following CAPTCHA:

Cancel | Editing help (opens in new window)