[Beowulf] multi-threading vs. MPI

Galen Arnold arnoldg at ncsa.uiuc.edu
Wed Dec 12 09:37:57 EST 2007


Gerry,

> Debates and differences aside, often-times, this forum *is* an authoritative 
> source of information.
>

Indeed it is.

By the way, we've got an old-ish course on multilevel 
parallel programming at ci-tutor.ncsa.uiuc.edu in case anybody wants to go 
there and see what people were thinking a couple years ago when they wrote 
it.

I've seen the benchmark speedups with mixed-mode as well.  With the right 
code, on a day with the wind to your back, threads can make good use of 
communication induced idle time on a node [yeah MPI supports overlap...
that's more difficult to achieve than it would appear, requiring-- 
excellent programming, most excellent MPI implementation].

By the way, if you've used Intel's mkl, you may have run with hybrid code 
already and not know it [do you know how your system sets OMP_NUM_THREADS 
?].

-Galen
_______________________________________________
Beowulf mailing list, Beowulf at beowulf.org
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf

!DSPAM:47602fd6219722071360113!



More information about the Beowulf mailing list