[Beowulf] NFS over IPoIB

Peter Kjellström cap at nsc.liu.se
Mon Jun 15 00:34:46 PDT 2020


On Fri, 12 Jun 2020 22:49:35 -0700
Chris Samuel <chris at csamuel.org> wrote:

> On Friday, 12 June 2020 2:36:26 PM PDT John McCulloch wrote:
> 
> > It is my understanding that setting MTU to 9000 is recommended but
> > that seems to be applicable for 10GbE.  
> 
> That depends how you're running your IB fabric.  In datagram mode
> (which I think is the default these days) you're limited to an MTU of
> 2044 bytes, but in connected mode (which used to be the default) you
> could get (from memory) a 64KB MTU.

Well you can actually run 4092 MTU on datagram mode (assuming you run
4K IB of course). This is a bit of best of both worlds but does require
some configuration.

/Peter


More information about the Beowulf mailing list