Networking: FlashBlade Connectivity to SN5600 Leaf Switches

XFM to TOR Components and Connectivity

The FlashBlade connects to the SN5600 leaf switches via OSFP Optics. The OSFP optics support two connections at 400Gb/s bandwidth each.

The FlashBlade optics are 400Gb/s each and a total of 16 ports are configured into an active port channel at the SN5600(s). All ports are involved in data traffic distribution to the FlashBlade via the XFMs.

Figure 1. XFM to SN5600 connection speeds

As seen in the diagram below, each port is providing network connectivity to two ports on the XFM switches at the FlashBlade Array.

Figure 2. XFM to TOR SN5600 port mapping example

FlashBlade Chassis to XFM Connectivity

Each FlashBlade chassis is connected to the XFM switches via specific ports on the XFMs dedicated to linking the FlashBlade chassis together. The XFMs support up to 10 chassis in total. Each chassis connects directly to the FlashBlade XFM switches via splitter cables, provided in the “MC-Accessory Kits” available from Pure.

Connection and configuration of chassis to the XFMs is done during the initial physical install process. Please ensure that proper installation procedures and configuration guidelines have been followed when installing a FlashBlade array.

Note: For full details on specific installation connectivity please see the multichassis install guide.

Figure 3. FlashBlade chassis to XFM splitter cable connectivity detail

Note: The cable map shown in Figure 3 of the splitter cable connections to the chassis is just a single chassis example. The references to A, B, C, D ports on the XFM’s and the F1 and F2 ports on the FIOMs are explained in full detail in the Multichassis Install Guide.

The example in Figure 4 does not indicate that a single chassis FlashBlade would be installed into an NVIDIA DGX SuperPOD cluster. For proper sizing of a FlashBlade to an NVIDIA DGX SuperPOD SU, please reference Appendix A.

SN5600 Configuration Commands

Below is an example of the commands used to configure the SN5600 switch for the FlashBlade array.


nv set interface bond1102 bond member swp41
nv set interface bond1102 description nv5600-to-xfm-uplink
nv set interface bond1102 bond mlag id 1102
nv set interface bond1102 bridge domain br_default
nv set interface bond1102 bond member swp41s0

Note: The commands above are provided only as an example. Nvidia installation team members would be responsible for the proper configuration of the SN5600 switches in the NVIDIA DGX SuperPOD Storage Fabric.