Archives


- Beowulf
- Beowulf Announce
- Scyld-users
- Beowulf on Debian

[Beowulf] using two separate networks for different data streams

Many of your questions may have already been answered in earlier discussions or in the FAQ. The search results page will indicate current discussions as well as past list serves, articles, and papers.

Search

Douglas Eadline deadline at clustermonkey.net
Thu Jan 26 13:35:22 PST 2006


Obviously two network interfaces are needed per node for this
to work. Most motherboards now come with two Ethernet interfaces so this
has become a more standard way of doing things.

The way it is done is as follows. You setup two networks.
For example, your /etc/hosts file looks something like:

#compute network 192.168.0
192.168.0.1    node1-compute
192.168.0.2    node2-compute
...
192.168.0.128    master-compute

#admin network 192.168.1
192.168.1.1    node1-admin
192.168.1.2    node2-admin
...
192.168.1.128    master-admin

Where node1-compute and node1-admin are the same physical node, etc.

When you mount NFS in the /etc/fstab you do it over the *-admin network.
When you run an MPI job your node list is made of *-compute
node names.

It is often easier to use a cluster distribution to do this. Doing it by hand
can be tedious and error prone)

If you take a look at:

http://www.clustermonkey.net//content/view/43/29/

you can see how we did it using warewulf (quite easy).

--
Doug

>
> Hi
>
>   I've looked around, in the list and google and didn't find anything
> elucidating enough on this so mabe someone could englight me or point me
> where to look.
>
>   I've seen architectures with two network switchs, one is used for I/O
> (writing, reading, so on) and another for message passing (MPI). how is
> this achieved? I get the idea, from one place, where the applications
> running must be aware of this but I was thinking that for this to work it
> must be transparent to the application. How can this be achieved?
>
>   Any thought will be appreciated.
>
>   best regards,
>
>   Ricardo Reis
>
>   "Non Serviam"
>
>   n.p.: http://radio.ist.utl.pt
>   n.r.: http://atumtenorio.blogspot.com
>                      <- Send with Pine Linux/Unix/Win/Mac OS->
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org
> To change your subscription (digest mode or unsubscribe) visit
> http://www.beowulf.org/mailman/listinfo/beowulf
>


-- 
Doug



More information about the Beowulf mailing list