Cluster of Subclusters with private networks

[Dean Johnson]

On Tue, 2002-07-23 at 10:55, Alejandro Frangi wrote:
> Hi,
> 
>  A quick question. I have two Linux-based PC clusters each of which has a
> front end (FE) and several PC nodes connected to the FE using a private
> network. Therefore, there is no direct connectivity between nodes from each
> cluster.
> 
>  Is it possible (and where can we find how-to information) to affiliate all
> nodes of both clusters to a single (hierarchical?) scheduler? Our ideal
> would be to have a single scheduler to which to submit jobs and that this
> will take care of scheduling the jobs to each node tunneling through each
> cluster front-end when needed.
> 

>From what I have seen is that many schedulers just view nodes as ip
addresses and if your private network numbering doesn't overlap, you
should be okay with appropriate additions to the host and routing
tables. For instance, have one private network as 10.0.1.x and the other
as 10.0.2.x and then just setup routes correctly.

There are efficiency issues with the routing through other boxes to get
to nodes, but that is more or less of a problem based on what you are
actually doing. Some domains have real locality issues, like molecular
dynamics, which going off the local network would wreak havoc on. Also,
depending on what you are doing, filesystems issues may have to be
worked on a bit too, as your filesystems may be setup very local
cluster-centric and access to home directories and such will be
problematic.

	-Dean

_______________________________________________
Beowulf mailing list, Beowulf at beowulf.org
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf