From Dean.Carpenter at pharma.com Thu Mar 29 10:46:43 2001 From: Dean.Carpenter at pharma.com (Carpenter, Dean) Date: Thu, 29 Mar 2001 10:46:43 -0500 Subject: SMP support with the scyld package Message-ID: <759FC8B57540D311B14E00902727A0C002EC47F5@a1mbx01.pharma.com> Hummm. List is being very quiet these days. Has anyone had luck/experience with the stuff I posted earlier ? --- Given a raw Scyld install, can anyone show a cookbook sequence to converting the master node as well as the slave nodes to a custom kernel ? Not just the SMP kernel from the rpm - we'll want to play with MOSIX, as well as the 2.2.19 kernel. 1. Install x and y packages to solve problem #2 above so we can actually build kernels. 2. Pull down virgin kernel sources and untar into /usr/src/linux 3. Integrate the bproc patches ..... (how - what else ?) 4. Integrate MOSIX (and any other cool) patches 5. Build the kernel and modules (any special considerations ?) 6. Build the custom phase 2 boot image 7. Rock and roll :) -- Dean Carpenter Principal Architect Purdue Pharma dean.carpenter at pharma.com deano at areyes.com 94TT :) _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From jearle at nortelnetworks.com Thu Mar 29 10:52:07 2001 From: jearle at nortelnetworks.com (Jonathan Earle) Date: Thu, 29 Mar 2001 10:52:07 -0500 Subject: Channel Bonding Message-ID: <28560036253BD41191A10000F8BCBD116BDDD1@zcard00g.ca.nortel.com> > -----Original Message----- > From: Timothy I Mattox [mailto:tmattox at engr.uky.edu] > > So, for all the posts from people saying "I tried channel boding, > and it was much SLOWER than when I used just one NIC"... this is what > is likely going on... your switch at any one time will be sending > all the packets for a particular MAC address down ONE port, and thus > blocking, and overflowing, and just making a real mess. If all the data went down only one port, then at worst, shouldn't the speed have been the same as when only one NIC was used? In my case, two PCs, each with a Znyx 4port card (tulip bsed), kernel 2.4.0-test9, I didn't use a switch, but instead wired each port to the other PC using a crossover cable (PC1/port1 to PC2/port1, PC1/port2 to PC2/port2, etc). Even in this config, the speed was dramatically slower than using one NIC. Jon _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From r.grenyer at ic.ac.uk Thu Mar 29 12:04:25 2001 From: r.grenyer at ic.ac.uk (Grenyer, Richard) Date: Thu, 29 Mar 2001 18:04:25 +0100 Subject: Odd request Message-ID: Someone wrote: >And your N networks had to be isolated from each other, >so that their tree-spanning algorithm, etc. would not get confused What is this tree-spanning algorithm. Is it detailed anywhere? What would I need to search around under - keywords, acronyms, similar? Many thanks, Rich Grenyer _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From tmattox at engr.uky.edu Thu Mar 29 13:39:15 2001 From: tmattox at engr.uky.edu (Timothy I Mattox) Date: Thu, 29 Mar 2001 13:39:15 -0500 (EST) Subject: Odd request In-Reply-To: Message-ID: Q: "Spanning tree algorithm?" A: I have found a good reference for ethernet is the O'Reilly book: "Ethernet: The Definitive Guide" by Charles E. Spurgeon, 2000. There is a standard method that ethernet switches use to detect loops, and will shut down one of the links in the loop. Essentially they form a tree by sending out special packets amongst themselves. I just did a google search on "spanning tree algorithm ethernet switch" and found this from Cisco: http://www.cisco.com/univercd/cc/td/doc/product/rtrmgmt/sw_ntman/cwsimain/cwsi2/cwsiug2/vlan2/stpapp.htm "Understanding Spanning-Tree Protocol" And this article from Network World Fusion: http://www.nwfusion.com/netresources/0524spanning.html "Spanning tree is still with us" On Thu, 29 Mar 2001, Grenyer, Richard wrote: > Someone wrote: > > >And your N networks had to be isolated from each other, > >so that their tree-spanning algorithm, etc. would not get confused > > What is this tree-spanning algorithm. Is it detailed anywhere? What would I > need to search around under - keywords, acronyms, similar? > > Many thanks, > > Rich Grenyer -- Tim Mattox - tmattox at ieee.org - http://home.earthlink.net/~timattox http://aggregate.org/KAOS/ - http://advogato.org/person/tmattox/ _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From bob at drzyzgula.org Thu Mar 29 13:45:59 2001 From: bob at drzyzgula.org (Bob Drzyzgula) Date: Thu, 29 Mar 2001 13:45:59 -0500 Subject: Odd request In-Reply-To: References: Message-ID: <20010329134559.A18701@drzyzgula.org> The "Spanning Tree Algorithm" has its roots (sorry) in the branch (geez, I really didn't set out to do this) of mathematics known as Graph Theory. It describes a mechanism whereby a cycle-free subtree of a connected graph, reaching every node of the graph, can be identified. As with most of these things, there's more than one way to do it -- any given graph will potentially have several different spanning subtrees, although some will be "better" or "more optimal" than others according to some criteria or another. In particular, depending on the problem one is attempting to solve, one might be looking for a spanning subtree which maximizes or minimizes the number or aggregate length (or perhaps "cost") of the arcs which connect the various nodes. In LANs, one usually is interested in a shortest-path spanning tree. Any decent book on graph theory should discuss this -- I just refreshed my memory on this out of my copy of "Flows in Networks", by Ford & Fulkerson, Princeton 1962 (out of print, sadly). When translated to a network, however, a spanning tree algorithm is used as the basis of what is then called a "Spanning Tree Protocol". The whole point here is to find a set of point-to-point links in a network over which you can reach any network attachment point, but within which one cannot get caught in a circle without immediately backtracking over the last link followed. Since MAC-layer bridges (and hence switches, which are fancy bridges) know only about "here" and "there" and not "over yonder" -- their view does not extend beyond the immediately-connected segements -- the failure to limit the usable paths in this way can result in packets spinning around in a cycle and never being forwarded to their intended destination. As with just about any protocol, this too has been subject to revision, reuse and refinement over the years. The protocol used by modern switches is specified by the IEEE 802.1d document which, alas, is not available for free download anywhere -- IEEE charges real money for their standards documents. I believe that the protocol used in 802.1d is based on an earlier DEC protocol, but incompatibly so. Just about any reasonably detailed book on network technology should contain an explaination of spanning tree. As I was searching for some other references (no, I didn't just write up all this detail from memory), one book that kept coming up was "Interconnections", by Radia Pearlman. At Amazon, sixteen reviewers give it all five stars, one only gives it four stars because he found himself underprepared :-) Thus, I assume that it's a decent reference: http://www.amazon.com/exec/obidos/ASIN/0201634481/ Hope this helps, --Bob On Thu, Mar 29, 2001 at 06:04:25PM +0100, Grenyer, Richard wrote: > Someone wrote: > > >And your N networks had to be isolated from each other, > >so that their tree-spanning algorithm, etc. would not get confused > > What is this tree-spanning algorithm. Is it detailed anywhere? What would I > need to search around under - keywords, acronyms, similar? > > Many thanks, > > Rich Grenyer > > > _______________________________________________ > Beowulf mailing list, Beowulf at beowulf.org > To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From lusk at mcs.anl.gov Thu Mar 29 14:15:21 2001 From: lusk at mcs.anl.gov (Rusty Lusk) Date: Thu, 29 Mar 2001 13:15:21 -0600 Subject: MPI/Beowulf vs. SM Programming/OpenMP In-Reply-To: Message from "Mattson, Timothy G" of "Fri, 23 Mar 2001 14:02:57 PST." Message-ID: <200103291915.NAA08188@mcs.anl.gov> | A general MPMD algorithm with lots of assynchronous events would be hard to | do with OpenMP. (actually, it can be hard with MPIch as well, but then you | can go with MPI-LAM or PVM). Hi Tim, I am curious as to what you are referring to with regard to MPICH. Rusty _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From chrisa at ASPATECH.COM.BR Thu Mar 29 15:41:15 2001 From: chrisa at ASPATECH.COM.BR (Chris Richard Adams) Date: Thu, 29 Mar 2001 17:41:15 -0300 Subject: Installing module 3c90x.o returns: init_module: Device busy Message-ID: Hi all; I need to create the module for the 3c905C-TX card. I got the source code from the Scyld site and followed the directions explicitly. I compiled with only a few warnings. When I try to install the module with 'insmod 3c90x.o' I get the error: 3c90x.o init_module: Device or Resource busy. I am running the Beowulf 2 prerelease Scyld version 2.2-16. I did not see this driver installed to begin with, hence this is why I am building it. Suggestions?? THanks, Chris _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From bill at billnorthrup.com Thu Mar 29 16:19:51 2001 From: bill at billnorthrup.com (Bill Northrup) Date: Thu, 29 Mar 2001 13:19:51 -0800 Subject: VP6 -would you like to test it? Message-ID: <006001c0b895$fdd9c840$1901a8c0@bob> Hello, I have just brought a Abit VP6 online with 2x 1000mhz and 256mb of ram.. The SCYLD#2 distro was slammed on and a few Compaq desktops were recruited as workers (1 450 int and the other a 380 AMD). A Cisco 3524 rounds out the connections as it hangs on my DSL here at home. I am letting it burn in for awhile and during that time, I would like to open it up to few folks to maybe test you app or favorite benchmarks. Drop me an email off the list and I will be more than happy to try and accomodate you. Bill -------------- next part -------------- An HTML attachment was scrubbed... URL: From Dean.Carpenter at pharma.com Thu Mar 29 18:10:05 2001 From: Dean.Carpenter at pharma.com (Carpenter, Dean) Date: Thu, 29 Mar 2001 18:10:05 -0500 Subject: SMP kernel for Scyld Message-ID: <759FC8B57540D311B14E00902727A0C002EC47FD@a1mbx01.pharma.com> Hey All - Anyone have any luck with the kernel-smp-2.2.17-33.beo.i686.rpm package ? Any special tricks to getting it run cleanly on the master or slave nodes ? As I said before, it appears to have some trouble with the modules. Just out of interest, why isn't the smp version the default instead of the up one ? -- Dean Carpenter Principal Architect Purdue Pharma dean.carpenter at pharma.com deano at areyes.com 94TT :) _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From bill at math.ucdavis.edu Thu Mar 29 19:10:24 2001 From: bill at math.ucdavis.edu (Bill Broadley) Date: Thu, 29 Mar 2001 16:10:24 -0800 Subject: How to use a beowulf class materials? Message-ID: <20010329161024.A1623@sphere.math.ucdavis.edu> I've been tasked to teach a class in using a beowulf. I've parallelized a few serial fortan codes to use MPI, so I have the technical side covered, at least for the 1st quarter. Anyone have suggestions for textbooks? Know of existing class outlines available on the web? Any other pointers? I'm considering: Parallel Programming With MPI by Peter Pacheco to cover the MPI part, but probably need an additional book on parallel algorithms and programming. I suspect it's of interest to the list, so please follow up to the list. -- Bill Broadley Programmer/Admin Mathematics/Institute of Theoretical Dynamics University of California, Davis _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From agrajag at linuxpower.org Thu Mar 29 20:38:13 2001 From: agrajag at linuxpower.org (Jag) Date: Thu, 29 Mar 2001 17:38:13 -0800 Subject: SMP kernel for Scyld In-Reply-To: <759FC8B57540D311B14E00902727A0C002EC47FD@a1mbx01.pharma.com>; from Dean.Carpenter@pharma.com on Thu, Mar 29, 2001 at 06:10:05PM -0500 References: <759FC8B57540D311B14E00902727A0C002EC47FD@a1mbx01.pharma.com> Message-ID: <20010329173813.V13901@kotako.analogself.com> On Thu, 29 Mar 2001, Carpenter, Dean wrote: > Hey All - > > Anyone have any luck with the kernel-smp-2.2.17-33.beo.i686.rpm package ? Yes > Any special tricks to getting it run cleanly on the master or slave nodes ? First I installe dthe kernel-smp package on the master node. I then edited the lilo.conf to boot the smp kernel. I ran '/sbin/lilo', then rebooted it. I then made the /boot/vmlinuz symlink point to the smp kernel. After that, I ran beosetup and told it to create the BeoBoot file. Then I rebooted all the slave nodes and everything worked fine. > As I said before, it appears to have some trouble with the modules. I had this problem. Booting into the smp kernel before remaking the beoboot file seemed to fix it. > > Just out of interest, why isn't the smp version the default instead of the > up one ? I'm not sure. The default kernel should be decided by anaconda (Red Hat's installer). Jag -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 232 bytes Desc: not available URL: From yoon at bh.kyungpook.ac.kr Fri Mar 30 00:51:56 2001 From: yoon at bh.kyungpook.ac.kr (Yoon Jae Ho) Date: Fri, 30 Mar 2001 14:51:56 +0900 Subject: How to use a beowulf class materials? References: <20010329161024.A1623@sphere.math.ucdavis.edu> Message-ID: <002301c0b8dd$8e79bd00$5f72f2cb@TEST> > I've been tasked to teach a class in using a beowulf. I've parallelized a > few serial fortan codes to use MPI, so I have the technical side covered, > at least for the 1st quarter. If I have a chance to be a teacher like you, I want to be a coordinator not teach item like MPI code or ... ... I mean in the internet there are many discussion group(mailing list) or there archive. It is the first step to learn. and the e-mail for the very important contact point when your student don't know or ask something to the authors. > Anyone have suggestions for textbooks? Know of existing class > outlines available on the web? Any other pointers? first of all, Will you show your student the www.beowulf.org 's discussion archive & the linking site from various University or Org? and www.beowulf-underground.org ? and other mailing list, FAQ, howto or Usenet site related in mpi .. > > I'm considering: Parallel Programming With MPI by Peter Pacheco to > cover the MPI part, but probably need an additional book on parallel > algorithms and programming. > > I suspect it's of interest to the list, so please follow up to the list. I read "Parallel Programming" by Wilkinson & Allen Prentice Hall ISDN 0-13-671710-1 and the Program Source like mpich or LAM itself is starting point to teach, I think. and the Presentation & FAQ or manual by author is another point to start. Thank you very much --------------------------------------------------------------------- Yoon Jae Ho Economist POSCO Research Institute yoon at bh.kyungpook.ac.kr jhyoon at mail.posri.re.kr http://ie.korea.ac.kr/~supercom/ Korea Beowulf Supercomputer Imagination is more important than knowledge. A. Einstein _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From Eugene.Leitl at lrz.uni-muenchen.de Fri Mar 30 04:00:12 2001 From: Eugene.Leitl at lrz.uni-muenchen.de (Eugene Leitl) Date: Fri, 30 Mar 2001 11:00:12 +0200 (MET DST) Subject: Director of Sientific Computing (fwd) Message-ID: ---------- Forwarded message ---------- Date: Fri, 30 Mar 2001 09:42:06 +0100 From: Stuart Mackenzie To: MOLECULAR-DYNAMICS-NEWS at JISCMAIL.AC.UK Subject: Director of Sientific Computing Apologies for possible multiple postings I would be grateful if you would bring the following advertisement to the attention of any suitably qualified colleagues. _______________________________________________ Dr Stuart Mackenzie, Lecturer in Physical Chemistry, Department of Chemistry, University of Warwick, Coventry CV4 7AL tel. 02476 523241 fax. 02476 524112 xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx UNIVERSITY OF WARWICK Director of The Centre for Scientific Computing The University is establishing a new Centre for Scientific Computing which will be inter-disciplinary in nature. In its initial phases, the University will provide up to six academic and technical staff positions to launch this development. The first step is to seek a Director at Professorial level. The Director will be closely involved in appointing other colleagues and will be expected to develop the Centre, shape its intellectual profile and nurture its growth into a major research enterprise. It is also intended that the Centre will become involved in graduate education. The successful candidate should have an international reputation for research, a significant proportion of which is computationally intensive, and a broad vision for the development of computationally-based research in the sciences, engineering and other academic areas. The individual will be attached to a particular Department although their role will be primarily within the Centre. Currently the seven Departments engaged in the Centre's development are Biological Sciences, Chemistry, Computer Science, Engineering, Mathematics, Physics and Statistics. However, applicants from any area are encouraged to apply. Salary will be within the Professorial range. For further information see http://www.warwick.ac.uk/fac/sci/ScientificComputing/index.htm Informal enquiries about the post may be made to Professor Stuart Palmer, Chair of the Search Committee (tel: 02476 523399; e-mail: S.B.Palmer at warwick.ac.uk) Further particulars can be obtained from the Personnel Office, University of Warwick, Coventry, CV4 7AL. Telephone: 024 7652 3627 and from jobs.ac.uk/jobfiles/AC1076.html. Applications (3 copies) should name three referees. Please quote Ref No. 35/3A/00. The closing date for applications is: 11 May 2001. _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From kodym at mit.jyu.fi Fri Mar 30 05:12:18 2001 From: kodym at mit.jyu.fi (Petr Ladislav Kodym) Date: Fri, 30 Mar 2001 13:12:18 +0300 (EEST) Subject: How to use a beowulf class materials? Message-ID: Hi, >Anyone have suggestions for textbooks? Know of existing class >outlines available on the web? Any other pointers? > >I'm considering: Parallel Programming With MPI by Peter Pacheco to >cover the MPI part, Have a look at MPI course material from EPCC: http://www.epcc.ed.ac.uk/epcc-tec/documents/psform-sn-mpi.html > but probably need an additional book on parallel algorithms and programming. What about this one: Introduction to Parallel Computing : Design and Analysis of Parallel Algorithms by Vipin Kumar, Ananth Grama, Anshul Gupta, George Karypis http://www.amazon.com/exec/obidos/ASIN/0805331700/qid%3D985946846/107-7176547-6865350 Petr _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From bogdan.costescu at iwr.uni-heidelberg.de Fri Mar 30 05:29:43 2001 From: bogdan.costescu at iwr.uni-heidelberg.de (Bogdan Costescu) Date: Fri, 30 Mar 2001 12:29:43 +0200 (CEST) Subject: Installing module 3c90x.o returns: init_module: Device busy In-Reply-To: Message-ID: On Thu, 29 Mar 2001, Chris Richard Adams wrote: > I need to create the module for the 3c905C-TX card. I got the source > code from the Scyld site and followed the directions explicitly. I > compiled with only a few warnings. When I try to install the module > with 'insmod 3c90x.o' I get the error: 3c90x.o init_module: Device or > Resource busy. I think that you are making some kind of confusion here. AFAIK, the Scyld site does not distribute any driver called 3c90x - this is the one distributed by 3Com. Don's driver is called 3c59x and you should have it already compiled. RedHat is distributing both drivers and announcing 3c90x as the right one for 905B and 905C cards, although 3c59x supports them too. But I do have the impression that their detection is not very good: anaconda would use (and add to /etc/conf.modules) 3c59x, while later, kudzu would install 3c90x. Maybe this situation will change with the 2.4 kernel, as 3c90x in its current form is not 2.4 ready. Sincerely, Bogdan Costescu IWR - Interdisziplinaeres Zentrum fuer Wissenschaftliches Rechnen Universitaet Heidelberg, INF 368, D-69120 Heidelberg, GERMANY Telephone: +49 6221 54 8869, Telefax: +49 6221 54 8868 E-mail: Bogdan.Costescu at IWR.Uni-Heidelberg.De _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From agrajag at linuxpower.org Fri Mar 30 08:48:56 2001 From: agrajag at linuxpower.org (Jag) Date: Fri, 30 Mar 2001 05:48:56 -0800 Subject: Installing module 3c90x.o returns: init_module: Device busy In-Reply-To: ; from chrisa@ASPATECH.COM.BR on Thu, Mar 29, 2001 at 05:41:15PM -0300 References: Message-ID: <20010330054855.X13901@kotako.analogself.com> On Thu, 29 Mar 2001, Chris Richard Adams wrote: > Hi all; > > I need to create the module for the 3c905C-TX card. I got the source > code from the Scyld site and followed the directions explicitly. I > compiled with only a few warnings. When I try to install the module > with 'insmod 3c90x.o' I get the error: 3c90x.o init_module: Device or > Resource busy. > > I am running the Beowulf 2 prerelease Scyld version 2.2-16. I did not > see this driver installed to begin with, hence this is why I am building > it. I had similar problem when I tried the prerelease. However, when I tried the actual release (27bz-7), this problem went away. With the 27bz-7 release it used the 3c59x driver for my 3c905C-TX ethernet card and it works just fine. Jag -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 232 bytes Desc: not available URL: From rgb at phy.duke.edu Fri Mar 30 09:47:26 2001 From: rgb at phy.duke.edu (Robert G. Brown) Date: Fri, 30 Mar 2001 09:47:26 -0500 (EST) Subject: How to use a beowulf class materials? In-Reply-To: <20010329161024.A1623@sphere.math.ucdavis.edu> Message-ID: On Thu, 29 Mar 2001, Bill Broadley wrote: > > I've been tasked to teach a class in using a beowulf. I've parallelized a > few serial fortan codes to use MPI, so I have the technical side covered, > at least for the 1st quarter. > > Anyone have suggestions for textbooks? Know of existing class > outlines available on the web? Any other pointers? It isn't written as a textbook and isn't finished, but http://www.phy.duke.edu/brahma/beowulf_online_book/ ("Engineering a Beowulf-Style Compute Cluster") might have some useful stuff. Contributions are always welcome as well. Other links on the Brahma site are also likely to be useful. Of course you know about "How to Build a Beowulf Cluster" book by Sterling, Becker, .... not exactly a textbook either but still "the" beowulf resource. > I'm considering: Parallel Programming With MPI by Peter Pacheco to > cover the MPI part, but probably need an additional book on parallel > algorithms and programming. http://www-unix.mcs.anl.gov/dbpp/ (can also be purchased, I believe). Excellent resource. > > I suspect it's of interest to the list, so please follow up to the list. > > -- > Bill Broadley > Programmer/Admin > Mathematics/Institute of Theoretical Dynamics > University of California, Davis > > _______________________________________________ > Beowulf mailing list, Beowulf at beowulf.org > To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf > -- Robert G. Brown http://www.phy.duke.edu/~rgb/ Duke University Dept. of Physics, Box 90305 Durham, N.C. 27708-0305 Phone: 1-919-660-2567 Fax: 919-660-2525 email:rgb at phy.duke.edu _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From jared_hodge at iat.utexas.edu Fri Mar 30 10:14:48 2001 From: jared_hodge at iat.utexas.edu (Jared Hodge) Date: Fri, 30 Mar 2001 09:14:48 -0600 Subject: How to use a beowulf class materials? References: <20010329161024.A1623@sphere.math.ucdavis.edu> Message-ID: <3AC4A2E8.6BBC77FD@iat.utexas.edu> If I were going to teach a class on Beowulf computing, I would start with the systems perspective and go over various different setups (NOWs, COWs, Beowulfs, and Big Iron computers). Discuss networking possibilities (Gigabit connections, channel bonding and the switch placement algorithms, latency and Bandwidth considerations). I would also focus on diskless clusters some since this (I think) is the way cluster computing is going. In the second section I would get more into parallel programming algorithms and techniques, etc. You've obviously got the background for this. Remember that although Beowulf clusters are getting more and more popular, probably very few of your students will actually work with a "purebred" beowulf cluster and even if they do, many of the tools will be somewhat different by the time they graduate. Teach them to understand why certain practices have become highly used and they will be ahead of the game in any parallel computing environment. Be sure to include links to sources of information, too. Bill Broadley wrote: > > I've been tasked to teach a class in using a beowulf. I've parallelized a > few serial fortan codes to use MPI, so I have the technical side covered, > at least for the 1st quarter. > > Anyone have suggestions for textbooks? Know of existing class > outlines available on the web? Any other pointers? > > I'm considering: Parallel Programming With MPI by Peter Pacheco to > cover the MPI part, but probably need an additional book on parallel > algorithms and programming. > > I suspect it's of interest to the list, so please follow up to the list. > > -- > Bill Broadley > Programmer/Admin > Mathematics/Institute of Theoretical Dynamics > University of California, Davis > > _______________________________________________ > Beowulf mailing list, Beowulf at beowulf.org > To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf -- Jared Hodge Institute for Advanced Technology The University of Texas at Austin 3925 W. Braker Lane, Suite 400 Austin, Texas 78759 Phone: 512-232-4460 FAX: 512-471-9096 Email: Jared_Hodge at iat.utexas.edu _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From JParker at coinstar.com Fri Mar 30 14:32:30 2001 From: JParker at coinstar.com (JParker at coinstar.com) Date: Fri, 30 Mar 2001 11:32:30 -0800 Subject: VA Linux's system imager Message-ID: G'Day ! Has anyone used this ? Any comments ? Seems like a good way to keep a cluster updated. http://systemimager.sourceforge.net/ cheers, Jim Parker Sailboat racing is not a matter of life and death .... It is far more important than that !!! -------------- next part -------------- An HTML attachment was scrubbed... URL: From JParker at coinstar.com Fri Mar 30 14:32:30 2001 From: JParker at coinstar.com (JParker at coinstar.com) Date: Fri, 30 Mar 2001 11:32:30 -0800 Subject: VA Linux's system imager Message-ID: G'Day ! Has anyone used this ? Any comments ? Seems like a good way to keep a cluster updated. http://systemimager.sourceforge.net/ cheers, Jim Parker Sailboat racing is not a matter of life and death .... It is far more important than that !!! -------------- next part -------------- An HTML attachment was scrubbed... URL: From timothy.g.mattson at intel.com Fri Mar 30 14:44:57 2001 From: timothy.g.mattson at intel.com (Mattson, Timothy G) Date: Fri, 30 Mar 2001 11:44:57 -0800 Subject: MPI/Beowulf vs. SM Programming/OpenMP Message-ID: Rusty, I guess my post wasn't clear enough. I am working with a software vendor. They need to launch several different programs that interact through MPI. You can do this in PVM, you can do this with LAM/MPI, but you can't do this with MPIch. Or I should say, I don't think it can be done with MPIch. The folks at this company looked into the matter and independently reached the same conclustion. As I see it, with MPIch, I must have everything in a single program. Yes, the programs can execite readically different pathways so in most cases, this doesn't restrict the algorithms I can work with. There are other engineering issues, however, that sometimes force me to run completely different programs that cooperate through MPI. This is the situation the un-named software vendor is faced with. So that is is what I meant by my general Multiple Program Multiple Data (or MPMD) comment. Does this make sense? Did I get something wrong and it is indeed the case that MPIch can handle this situation? I'd love to be wrong as it would make my life simpler if I could do everything with only one version of MPI. --Tim -----Original Message----- From: Rusty Lusk [mailto:lusk at mcs.anl.gov] Sent: Thursday, March 29, 2001 11:15 AM To: Mattson, Timothy G Cc: 'Chris Richard Adams'; Beowulf (E-mail) Subject: Re: MPI/Beowulf vs. SM Programming/OpenMP | A general MPMD algorithm with lots of assynchronous events would be hard to | do with OpenMP. (actually, it can be hard with MPIch as well, but then you | can go with MPI-LAM or PVM). Hi Tim, I am curious as to what you are referring to with regard to MPICH. Rusty _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From ctierney at hpti.com Fri Mar 30 15:47:55 2001 From: ctierney at hpti.com (Craig Tierney) Date: Fri, 30 Mar 2001 13:47:55 -0700 Subject: MPI/Beowulf vs. SM Programming/OpenMP In-Reply-To: ; from timothy.g.mattson@intel.com on Fri, Mar 30, 2001 at 11:44:57AM -0800 References: Message-ID: <20010330134755.I17830@hpti.com> I guess I am confused now. Are you saying you want to be able to startup a.out on 3 processors and b.out on 2 processors and have them talk to each other over MPI (mpich)? Mpich can do this (I think it is with the -p4pg option). I use gm over mpich and I do this as well. I have to modify the mpirun script (Myricom's verison doesn't support it) but I have users that do this now on the system. Craig On Fri, Mar 30, 2001 at 11:44:57AM -0800, Mattson, Timothy G wrote: > Rusty, > > I guess my post wasn't clear enough. > > I am working with a software vendor. They need to launch several different > programs that interact through MPI. You can do this in PVM, you can do this > with LAM/MPI, but you can't do this with MPIch. Or I should say, I don't > think it can be done with MPIch. The folks at this company looked into the > matter and independently reached the same conclustion. > > As I see it, with MPIch, I must have everything in a single program. Yes, > the programs can execite readically different pathways so in most cases, > this doesn't restrict the algorithms I can work with. There are other > engineering issues, however, that sometimes force me to run completely > different programs that cooperate through MPI. This is the situation the > un-named software vendor is faced with. > > So that is is what I meant by my general Multiple Program Multiple Data (or > MPMD) comment. > > Does this make sense? Did I get something wrong and it is indeed the case > that MPIch can handle this situation? I'd love to be wrong as it would make > my life simpler if I could do everything with only one version of MPI. > > --Tim > > -----Original Message----- > From: Rusty Lusk [mailto:lusk at mcs.anl.gov] > Sent: Thursday, March 29, 2001 11:15 AM > To: Mattson, Timothy G > Cc: 'Chris Richard Adams'; Beowulf (E-mail) > Subject: Re: MPI/Beowulf vs. SM Programming/OpenMP > > > | A general MPMD algorithm with lots of assynchronous events would be hard > to > | do with OpenMP. (actually, it can be hard with MPIch as well, but then > you > | can go with MPI-LAM or PVM). > > Hi Tim, > > I am curious as to what you are referring to with regard to MPICH. > > Rusty > > > _______________________________________________ > Beowulf mailing list, Beowulf at beowulf.org > To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf -- Craig Tierney (ctierney at hpti.com) phone: 303-497-3112 _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From chrisa at ASPATECH.COM.BR Fri Mar 30 16:06:47 2001 From: chrisa at ASPATECH.COM.BR (Chris Richard Adams) Date: Fri, 30 Mar 2001 18:06:47 -0300 Subject: Installing module 3c90x.o returns: init_module: Device busy Message-ID: OK...I guess I should upgrade anyway. I downloaded the RPMS from the site for the 27bz-7 version. I assume I just install all those packages and I am officially upgraded? At that point I could use the 3c59x drivers for my 3c905C-TX card? advice appreciated! Chris > -----Original Message----- > From: Jag [mailto:agrajag at linuxpower.org] > Sent: Friday, March 30, 2001 10:49 AM > To: Chris Richard Adams > Cc: Beowulf (E-mail) > Subject: Re: Installing module 3c90x.o returns: init_module: > Device busy > > > On Thu, 29 Mar 2001, Chris Richard Adams wrote: > > > Hi all; > > > > I need to create the module for the 3c905C-TX card. I got > the source > > code from the Scyld site and followed the directions explicitly. I > > compiled with only a few warnings. When I try to install the module > > with 'insmod 3c90x.o' I get the error: 3c90x.o init_module: > Device or > > Resource busy. > > > > I am running the Beowulf 2 prerelease Scyld version 2.2-16. > I did not > > see this driver installed to begin with, hence this is why > I am building > > it. > > I had similar problem when I tried the prerelease. However, when I > tried the actual release (27bz-7), this problem went away. With the > 27bz-7 release it used the 3c59x driver for my 3c905C-TX ethernet card > and it works just fine. > > > Jag > _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From rbbrigh at valeria.mp.sandia.gov Fri Mar 30 16:40:28 2001 From: rbbrigh at valeria.mp.sandia.gov (Ron Brightwell) Date: Fri, 30 Mar 2001 14:40:28 -0700 (MST) Subject: MPI/Beowulf vs. SM Programming/OpenMP In-Reply-To: from "Mattson, Timothy G" at Mar 30, 2001 11:44:57 AM Message-ID: <200103302141.OAA19907@dogbert.mp.sandia.gov> > > I guess my post wasn't clear enough. > > I am working with a software vendor. They need to launch several different > programs that interact through MPI. You can do this in PVM, you can do this > with LAM/MPI, but you can't do this with MPIch. Or I should say, I don't > think it can be done with MPIch. The folks at this company looked into the > matter and independently reached the same conclustion. > > As I see it, with MPIch, I must have everything in a single program. Yes, > the programs can execite readically different pathways so in most cases, > this doesn't restrict the algorithms I can work with. There are other > engineering issues, however, that sometimes force me to run completely > different programs that cooperate through MPI. This is the situation the > un-named software vendor is faced with. > > So that is is what I meant by my general Multiple Program Multiple Data (or > MPMD) comment. > > Does this make sense? Did I get something wrong and it is indeed the case > that MPIch can handle this situation? I'd love to be wrong as it would make > my life simpler if I could do everything with only one version of MPI. > I think there's a mixture of misunderstanding in what MPICH can do and in what MPMD means. MPICH supports the launching of several different binaries as a single MPI job, i.e. all the processes are in the same MPI_COMM_WORLD. For lack of a better term, I've called this mode static MPMD, since the number of binaries and the number of processes are fixed throughout the life of the parallel job. MPICH doesn't yet support the MPI-2 style client/server operations that allow independent parallel jobs to join, which is what LAM and PVM support. I've called this dynamic MPMD since both the number of processes and number of binaries can change throughout the life of the parallel job. If there are better terms to describe the combination of these two things (multiple binaries and joining independent parallel jobs), let me know. I've had similar confusing discussions with users about which functionality they wanted. -Ron _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From gscluster at hotmail.com Sat Mar 31 18:46:52 2001 From: gscluster at hotmail.com (Georgia Southern Beowulf Cluster Project) Date: Sat, 31 Mar 2001 18:46:52 -0500 Subject: Beowulf Trivia Question. Message-ID: Hello all, I'm part of a team completing the first Beowulf-style cluster available in our area and I've a question that everyone asks? "Where does the name Beowulf originate?" Essentially why did the NASA and Scyld guys call their clustering technique/philosophy "Beowulf"? Is it just a fancy, cool-sounding name, or is there a deeper meaning, possibly metaphor? Hope someone knows because I get asked this about every 5 minutes on some occassions and I don't have much of an answer. Thanks, Wes Wells Georgia Southern Beowulf cluster _________________________________________________________________ Get your FREE download of MSN Explorer at http://explorer.msn.com _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From kodym at math.jyu.fi Fri Mar 30 05:08:12 2001 From: kodym at math.jyu.fi (Petr Ladislav Kodym) Date: Fri, 30 Mar 2001 13:08:12 +0300 (EEST) Subject: How to use a beowulf class materials? In-Reply-To: <20010329161024.A1623@sphere.math.ucdavis.edu> Message-ID: Hi, >Anyone have suggestions for textbooks? Know of existing class >outlines available on the web? Any other pointers? > >I'm considering: Parallel Programming With MPI by Peter Pacheco to >cover the MPI part, Have a look at MPI course material from EPCC: http://www.epcc.ed.ac.uk/epcc-tec/documents/psform-sn-mpi.html > but probably need an additional book on parallel algorithms and programming. What about this one: Introduction to Parallel Computing : Design and Analysis of Parallel Algorithms by Vipin Kumar, Ananth Grama, Anshul Gupta, George Karypis http://www.amazon.com/exec/obidos/ASIN/0805331700/qid%3D985946846/107-7176547-6865350 Petr _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From bal at morelinux.com Thu Mar 29 00:12:05 2001 From: bal at morelinux.com (bal) Date: Thu, 29 Mar 2001 10:42:05 +0530 Subject: mpptest report errors on linux Message-ID: <3AC2C425.53F5D87F@morelinux.com> hi everybody I am trying to build a four node linux cluster. All machines are PIII 500 Mhz with 10/100 rtl 8139 ethrnet card connected using a 100Mbps switch. mpich-1.2.1 is installed from source. mpptest reports following problem ./runmpptest -long -blocking -bisect -fname long-blocking-bisect -gnuplot -np Bisection tests-blocking Exceeded 900.000000 seconds, aborting [0] MPI Abort by user Aborting program ! [0] Aborting program! p0_1458: p4_error: : 1 bm_list_1459: p4_error: interrupt SIGINT: 2 rm_l_2_21356: p4_error: interrupt SIGINT: 2 rm_l_3_12637: p4_error: interrupt SIGINT: 2 rm_l_1_14220: p4_error: interrupt SIGINT: 2 p3_12636: p4_error: interrupt SIGINT: 2 p2_21355: p4_error: interrupt SIGINT: 2 p1_14219: p4_error: interrupt SIGINT: 2 /usr/local/beowulf/mpich-1.2.1/bin/mpirun: line 1: 1458 Broken pipe I have tested it on kernel 2.2.18 with mosix and without mosix, also on kernel 2.2.17 Do I have to apply some patches to kernel? It seems the problem is releted with increased message length. Problem even appears when using option short in place of long for some tests. Thanks bal at morelinux.com _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From quarshie at mail.eecis.udel.edu Fri Mar 23 11:25:05 2001 From: quarshie at mail.eecis.udel.edu (Rene Quarshie) Date: Fri, 23 Mar 2001 11:25:05 -0500 (EST) Subject: Beowulf digest, Vol 1 #332 - 20 msgs In-Reply-To: <200103231608.LAA02131@blueraja.scyld.com> Message-ID: hi; installation frol scyld cd: i iust installed a beowulf cluster and i; learning how torun mpi on the cluster...my problem is , anytime i compile using "cc -lmpi cpi.3 -o cpi" it works fine, but i tried using "f77 -lmpif -o pi3.f pi3" i get this error: pi3.f: In program `main': pi3.f:22: include 'mpif.h' ^ Unable to open INCLUDE file `mpif.h' at (^) i know that mpif.h is in the include dir...i just dont know whats going on... last question: how do you run an exec file on a beowulf if scyld cd was used to build the cluster... any help grtly appr rene _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From javier.iglesias at freesurf.ch Sat Mar 24 23:01:13 2001 From: javier.iglesias at freesurf.ch (Javier Iglesias) Date: Sun, 25 Mar 2001 05:01:13 +0100 Subject: NFS Message-ID: <985489273.webexpressdV3.1.f@smtp.freesurf.ch> Hi, I'm planning a cluster for the computer science institut I'm working for, then collecting as much information on beowulf as available, and first-time poster to this list. It looks like using NFS is a great administrator time saver, but comes with a high network finger print. Did someone tried to use 2 NICs per node configured so that : 1/ first is dedicated to interprocessor communication, while 2/ second is used for NFS, DB calls, ... Is this idea already known as bad/good one ? --javier -- Enjoy more time at less cost with sunrise freetime http://go.sunrise.ch/de/sel/default.asp _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From rockwlrs at cs.byu.edu Thu Mar 29 13:22:21 2001 From: rockwlrs at cs.byu.edu (Nathan C Summers) Date: Thu, 29 Mar 2001 11:22:21 -0700 (MST) Subject: SMP support with the scyld package In-Reply-To: <759FC8B57540D311B14E00902727A0C002EC47F5@a1mbx01.pharma.com> Message-ID: On Thu, 29 Mar 2001, Carpenter, Dean wrote: > Hummm. List is being very quiet these days. Has anyone had luck/experience > with the stuff I posted earlier ? > > --- > > Given a raw Scyld install, can anyone show a cookbook sequence to converting > the master node as well as the slave nodes to a custom kernel ? Not just > the SMP kernel from the rpm - we'll want to play with MOSIX, as well as the > 2.2.19 kernel. > > 1. Install x and y packages to solve problem #2 above so we can actually > build kernels. > 2. Pull down virgin kernel sources and untar into /usr/src/linux > 3. Integrate the bproc patches ..... (how - what else ?) Get the bproc patches from the source RPM. > 4. Integrate MOSIX (and any other cool) patches The MOSIX and bproc patches conflict like crazy. After spending days trying to get them to play nice together, I realized that I had better things to do with my time. It seems that MOSIX and bproc want to do almost the exact same thing in slightly different ways in the same parts of the code. A unified interface should be possible (I'd use the bproc approach when resolving the conflicts, since it seems to be cleaner.) Unfortunately, suggesting this union would revive the Eternal Flamewar of Process Migration, since both camps think that the slight differences in thier code form the One True Way to Migrate Processes. Sigh, I hate politics... > 5. Build the kernel and modules (any special considerations ?) Pretty much any kernel should work on the master image (with the bproc stuff, of course.) I'd recommend the same image on the slaves that you use on the master, so your selection should be based on the hardware requirements. It's pretty easy if your cluster is completely homogeneous, more complicated if not. > 6. Build the custom phase 2 boot image > 7. Rock and roll :) Rockwalrus _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From sita_krish at hotmail.com Wed Mar 28 10:54:09 2001 From: sita_krish at hotmail.com (Krishna Prasad) Date: Wed, 28 Mar 2001 21:24:09 +0530 Subject: help please Message-ID: anyone out there, Can you give me some examples of parallel processing applications that can be done ? (like ray tracing that has been done using pvm). I want the applications to be done by me. So please give some real time programs that can be speeded up using the distributed processing technique. If possible please give me some web sites that have the information or source code about the parallel processing applications. Reply to my email address: sita_krish at hotmail.com THANKS, yours sincerely, krishna prasad. _________________________________________________________________________ Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com. _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From Hans_Skagerlind at dell.com Tue Mar 27 07:39:05 2001 From: Hans_Skagerlind at dell.com (Hans_Skagerlind at dell.com) Date: Tue, 27 Mar 2001 06:39:05 -0600 Subject: Linux on Xeon Message-ID: Does anyone know where to find info about comparing/benchmarking Linux on Xeon vs Pentium III processors? Thanks for advice! <<...OLE_Obj...>> Hans Skagerlind Technical Sales Representative Advanced Systems Group Tel: +46 08 590 05 462 Fax: +46 08 590 05 599 E-mail: hans_skagerlind at dell.com _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From bgbruce at it-curacao.com Sat Mar 24 10:27:10 2001 From: bgbruce at it-curacao.com (B.G. Bruce) Date: Sat, 24 Mar 2001 11:27:10 -0400 Subject: 2Gb Fibre channel ICS Message-ID: <01032411412804.01426@portal1.it-curacao.com> Has anyone looked at the performance-viability of small scale clusters (less than 16 nodes) utilizing QLogic's 230x adapters and their SanBOX2 switches? We are looking to build a cluster that primarily runs serialized apps, or VIA aware databases, which would benefit more from FC than say NFS/CODA servers running over myrinet ?that had a FC backend, however we may look at parallelizing some of the more compute intensive app servers. Thoughts anyone? Regards, Brian. _______________________________________________ Beowulf mailing list, Beowulf at beowulf.org To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf From Nordwall at pnl.gov Fri Mar 30 15:51:37 2001 From: Nordwall at pnl.gov (Nordwall, Douglas J) Date: Fri, 30 Mar 2001 12:51:37 -0800 Subject: VA Linux's system imager Message-ID: <3A2AF12EC5C8AE45B4EB90379D1235B98B6C4D@pnlmse04.pnl.gov> I actually use system imager for our client linux machines here at PNL. Not bad at all. For our clusters, we've been experimenting with npaci rocks. I've been impressed so far -----Original Message----- From: JParker at coinstar.com [mailto:JParker at coinstar.com] Sent: Friday, March 30, 2001 11:33 AM To: beowulf at beowulf.org Subject: VA Linux's system imager G'Day ! Has anyone used this ? Any comments ? Seems like a good way to keep a cluster updated. http://systemimager.sourceforge.net/ cheers, Jim Parker Sailboat racing is not a matter of life and death .... It is far more important than that !!! -------------- next part -------------- An HTML attachment was scrubbed... URL: