No subject


Tue Nov 9 01:00:01 PST 2010


1 NIC transfer with FTP: (PUT and GET):
150 Opening BINARY mode data connection for kern.tar.gz.
8186400 bytes sent in 0.765 secs (1e+04 Kbytes/sec)

150 Opening BINARY mode data connection for kern.tar.gz (8186400 bytes).
8186400 bytes received in 0.779 secs (1e+04 Kbytes/sec)

2 NICs:

[root at n0 /tmp]# insmod bonding
Using /lib/modules/2.4.7mw2/kernel/drivers/net/bonding.o
[root at n0 /tmp]# ifconfig bond0 inet 10.0.0.2 netmask 255.255.255.0
[root at n0 /tmp]# ifenslave bond0 eth0
master has no hw address assigned; getting one from slave!
The interface eth0 is up, shutting it down it to enslave it.
[root at n0 /tmp]# ifenslave bond0 eth1

FTP transfer:
150 Opening BINARY mode data connection for kern.tar.gz.
8186400 bytes sent in 1.44 secs (5.6e+03 Kbytes/sec)

150 Opening BINARY mode data connection for kern.tar.gz (8186400 bytes).
8186400 bytes received in 1.28 secs (6.2e+03 Kbytes/sec)

So, it's not Scyld's 2.2 kernel causing this.  The switches are
capable of performing 10000 Kbytes/sec as proven by the single-NIC
transfer rates, so one would think that it's completely OS-dependent.


To further verify that the BONDING is setup properly, I monitored
the RX and TX packets of the bond0, eth0 and eth1 interfaces on
both ends, to make sure that BOTH NICs were operational:

One bug I noticed was that the RX packets for bond0 is 0. You can
add up TX for eth0 and eth1 to give you the TX for bond0. I don't
know if this is relevant since it's functional:

[root at n0 /root]# ifconfig -a
bond0     Link encap:Ethernet  HWaddr 00:01:02:ED:C4:C8
          inet addr:10.0.0.2  Bcast:10.255.255.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:42282 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 b)  TX bytes:36870337 (35.1 Mb)

eth0      Link encap:Ethernet  HWaddr 00:01:02:ED:C4:C8
          inet addr:10.0.0.2  Bcast:10.255.255.255  Mask:255.255.255.0
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:31673 errors:0 dropped:0 overruns:488 frame:0
          TX packets:39068 errors:0 dropped:0 overruns:0 carrier:6
          collisions:0 txqueuelen:100
          RX bytes:24773173 (23.6 Mb)  TX bytes:40110808 (38.2 Mb)
          Interrupt:11 Base address:0xe000

eth1      Link encap:Ethernet  HWaddr 00:01:02:ED:C4:C8
          inet addr:10.0.0.2  Bcast:10.255.255.255  Mask:255.255.255.0
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:17075 errors:0 dropped:0 overruns:458 frame:0
          TX packets:17475 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:100 
          RX bytes:13483933 (12.8 Mb)  TX bytes:14076285 (13.4 Mb)
          Interrupt:9 Base address:0xe400 


Using my "measure" script which takes differences, here's a before
and after:
root at n0 /root]# ./measure
bond0 rx 0 tx 0
eth0 rx 0 tx 0
eth1 rx 0 tx 0

<do the FTP transfer from 10.0.0.2 to 10.0.0.3>

[root at n0 /root]# ./measure
bond0 rx 0 tx 6532
eth0 rx 3269 tx 3266
eth1 rx 3264 tx 3266

The rx's and tx's matched on the other end as well.  the RX for bond0
is always 0 (bug?)


Any idea on what I should try next? 
Thanks!

-- 
Michael J. Weller, M.Sc.               office: (972) 235-7881 x.242
weller at zyvex.com                         cell: (214) 616-6340
Zyvex Corp., 1321 N Plano           facsimile: (972) 235-7882    
Richardson, TX 75081                      icq: 6180540





More information about the Beowulf mailing list