Minimal, fast single node queue software

Greg Lindahl lindahl at keyresearch.com
Mon Dec 16 16:21:35 EST 2002


On Mon, Dec 16, 2002 at 12:47:02PM -0800, David Mathog wrote:

> I have an application which is very simple and efficient
> so that the parallel compute node part can run in much less
> than 1 second.  And therein lies the rub - nothing I've tried
> so far can handle job queues across 20 nodes nearly that fast. 

"Doctor, it hurts when I do this."

What you want to do instead is write a "worker" which asks some server
for work units. You aren't going to get there with anything that opens
lots of sockets, generates lots of new processes, etc.

-- greg

_______________________________________________
Beowulf mailing list, Beowulf at beowulf.org
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf



More information about the Beowulf mailing list