<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html><head><title></title>
<META http-equiv=Content-Type content="text/html; charset=iso-8859-1">
<meta http-equiv="Content-Style-Type" content="text/css">
<style type="text/css"><!--
body {
margin: 5px 5px 5px 5px;
background-color: #ffffff;
}
/* ========== Text Styles ========== */
hr { color: #000000}
body, table /* Normal text */
{
font-size: 9pt;
font-family: 'Courier New';
font-style: normal;
font-weight: normal;
color: #000000;
text-decoration: none;
}
span.rvts1 /* Heading */
{
font-size: 10pt;
font-family: 'Arial';
font-weight: bold;
color: #0000ff;
}
span.rvts2 /* Subheading */
{
font-size: 10pt;
font-family: 'Arial';
font-weight: bold;
color: #000080;
}
span.rvts3 /* Keywords */
{
font-size: 10pt;
font-family: 'Arial';
font-style: italic;
color: #800000;
}
a.rvts4, span.rvts4 /* Jump 1 */
{
font-size: 10pt;
font-family: 'Arial';
color: #008000;
text-decoration: underline;
}
a.rvts5, span.rvts5 /* Jump 2 */
{
font-size: 10pt;
font-family: 'Arial';
color: #008000;
text-decoration: underline;
}
span.rvts6
{
font-weight: bold;
color: #800000;
}
/* ========== Para Styles ========== */
p,ul,ol /* Paragraph Style */
{
text-align: left;
text-indent: 0px;
padding: 0px 0px 0px 0px;
margin: 0px 0px 0px 0px;
}
.rvps1 /* Centered */
{
text-align: center;
}
--></style>
</head>
<body>
<p>Hallo Joe,</p>
<p><br></p>
<p>Donnerstag, 28. Februar 2008, meintest Du:</p>
<p><br></p>
<p><span class=rvts6>JL> Have a few simple setups that I am trying to figure out if I have a</span></p>
<p><span class=rvts6>JL> problem, or if what I am seeing is normal.</span></p>
<p><br></p>
<p><span class=rvts6>JL> Two 10 GbE cards, connected with a CX4 cable. Server is one of our</span></p>
<p><span class=rvts6>JL> JackRabbits, with 750+ MB/s direct IO and 500-650 MB/s buffered IO </span></p>
<p><span class=rvts6>JL> (read-write), for IO about 10x system ram (~100x RAID cache).</span></p>
<p><br></p>
<p><span class=rvts6>JL> Getting ok iperf numbers, about 7 Gb/s single thread. Running NFS,</span></p>
<p><span class=rvts6>JL> and seeing ~200-300 MB/s best case between the systems. Is this what </span></p>
<p><span class=rvts6>JL> others have seen? Latest drivers from vendor, sent a note to them to </span></p>
<p><span class=rvts6>JL> see if we can figure this out. Figured I would tap into the 'wulf </span></p>
<p><span class=rvts6>JL> collective memory to learn what other people see.</span></p>
<p><br></p>
<p>The best i saw for NFS over 10 GE was about 350-400 MB/s write and about 450 MB/s read.</p>
<p>Single server to 8 simultaneous accessing clients (aggregated performance). </p>
<p><br></p>
<p>On the blockdevice i got 550 MB/s write and 1.1 GB/s read performance. </p>
<p><br></p>
<p><br></p>
<p><span class=rvts6>JL> 2.6.23.14 kernel on both sides, jumbo frames enabled. No switch, just</span></p>
<p><span class=rvts6>JL> a CX4 cable.</span></p>
<p><br></p>
<p>rsize/wsize are set to? </p>
<p><br></p>
<p>NFS3 or NFS4? </p>
<p><br></p>
<p>Cheers,</p>
<p>Jan</p>
</body></html>