NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.

Forum Discussion

XanderVR's avatar
XanderVR
Aspirant
May 15, 2017

Configuring RDMA and RoCE on Netgear M4300-24X24F stack

Good morning all,

 

I am working on a hyperconverged Hyper-V 2016 environment with Storage SPaces Direct (S2D) on 2 hosts, which requires Remote Direct Memory Acces (RDMA) over Converged Ethernet (RoCE).

We are using 2x of M4300-24X24F, and each host is setup with 2x Mellanox ConnectX-4 2x25Gb cards, giving each host 4x10Gbe connection to the stack.

 

I have found a nice deployment guide here here, however this is based on Lenovo switches.

In this guide they talk aboud Converged Enhanced Ethernet (CEE), Priority-Based Flow Control (PFC), and Enhanced Transmission Selection (ETS) which are needed.

 

However, what are the Netgear equivalents for these?

I have found PFC, but cannot find anything regarding the other 2 settings?

 

Does anyone has any experience with this?

4 Replies

  • LaurentMa's avatar
    LaurentMa
    NETGEAR Expert

    Hi XanderVR

     

    M4300 isn't capable of DCB: in fact, only M6100 offers DCB.

     

    M4300 datasheet: http://www.netgear.com/business/products/switches/managed/m4300.aspx#tab-resources

     

    M6100 datasheet: http://www.netgear.com/business/products/switches/managed/m6100.aspx#tab-resources

     

    The Priority Flow Control (PFC) is standardized by the IEEE 802.1Qbb specification and enables flow control per traffic class on IEEE 802 full-duplex links. The Data Center Bridging Exchange Protocol (DCBX) is used by DCB devices to exchange configuration information with directly connected peers. Enhanced Transmission Selection (ETS) provides an operational model for priority processing and bandwidth allocation for the switch in a DCB environment.

     

    Datasheets commit for features supported by NETGEAR Fully Managed Switch respective platforms and I'm afraid there's no other equivalent for such Lossless Ethernet.

     

    Regards,

    • XanderVR's avatar
      XanderVR
      Aspirant

      So the short answer is: No it is not possible to use RoCE with M4300?

       

      • LaurentMa's avatar
        LaurentMa
        NETGEAR Expert

        Let me take that back: I think you can use M4300 for RoCE.

         

        Please keep me honnest here, but first I believe RoCE can work either in Lossless Ethernet environments (so, in a network with Global Flow Control enabled, or Priority Flow Control - PFC - implemented), or Lossy Ethernet environments (so, without any Flow control). 

         

        In Lossy Ethernet environment, RoCE can be configured in Resilient RoCEv2 mode on server/storage side.

         

        M4300 can certainly be configured for RoCE Lossless Ethernet mode instead, either using standard 802.3x Flow Control, or better, the only feature inherited from M6100, namely Priority Flow Control in order to be able to differentiate between different flows.

         

        PFC is available in M4300 CLI . You can download the CLI manual here http://www.netgear.com/support/product/M4300-24X24F#docs

         

        PFC configuration commands and examples can be found starting page 980. Pleae kindly let us know how it goes. Please follow the configuration flow starting page 980.

         

        Regards,

NETGEAR Academy

Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology! 

Join Us!

ProSupport for Business

Comprehensive support plans for maximum network uptime and business peace of mind.

 

Learn More