[Beowulf] Performance tuning for Jumbo Frames

Patrick Geoffray patrick at myri.com
Tue Dec 15 23:41:59 EST 2009


Bogdan Costescu wrote:
> long as it fits in one page. At another time, the switch was more
> likely to drop large frames under high load (maybe something to do
> with internal memory management), so the 9000bytes frames worked most
> of the time while the 1500bytes ones worked all the time...

This is an important point. The way hardware flow-control works in 
Ethernet, a switch has to be able to buffer two full frames plus the 
time on the wire for the round-trip. For the curious, the PAUSEs packets 
are sent in-band and you cannot send or receive partial frames.
So, instead of requiring ~4K per port minimum, you need about ~20K per 
port. Add to that up to 8 priorities with DCB and the buffering 
requirement are quickly getting out of hand. That's one big drawbacks of 
large MTUs, along with contention with wormhole switching.

Patrick
_______________________________________________
Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf



More information about the Beowulf mailing list