BP1058 DCB Config

download BP1058 DCB Config

of 17

Transcript of BP1058 DCB Config

  • 8/10/2019 BP1058 DCB Config

    1/17

    EqualLogic DCB Configuration Best PracticesA Dell EqualLogic Best Practices Technical White Paper

    Dell Storage EngineeringMay 2014

  • 8/10/2019 BP1058 DCB Config

    2/17

    2 BP1058 | EqualLogic DCB Configuration Best Practices

    Revisions

    Date Description

    February 2013 Initial publication

    February 2013 Changed PC81xx configuration steps to external SGC link

    May 2013 Added Force10 S4820T information

    May 2014 Updated links to new Switch Configuration Guides

    2014 Dell Inc. All Rights Reserved. Dell, the Dell logo, and other Dell names and marks are trademarks of Dell Inc. in

    the US and worldwide. All other trademarks mentioned herein are the property of their respective owners.

  • 8/10/2019 BP1058 DCB Config

    3/17

    3 BP1058 | EqualLogic DCB Configuration Best Practices

    Table of Contents1

    Introduction ................................................................................................................................................................................ 4

    1.1

    Objective...........................................................................................................................................................................

    1.2

    Audience ........................................................................................................................................................................... 4

    2

    DCB configuration guidelines ................................................................................................................................................. 5

    2.1 DCB requirements summary ........................................................................................................................................ 5

    2.2 Configuration process overview .................................................................................................................................. 5

    2.3 Enabling DCB and configuring the VLAN ................................................................................................................... 6

    2.4 Switch configuration ...................................................................................................................................................... 7

    2.5 Disabling DCB on the SAN ............................................................................................................................................ 8

    2.6

    DCB configuration verification ..................................................................................................................................... 8

    2.6.1

    Priority Group, ETS, and PFC verification ................................................................................................................... 8

    2.6.2

    Invalid DCB configuration detection ........................................................................................................................... 9

    3

    Switch specific configuration steps ....................................................................................................................................... 11

    3.1 Configuration for switches with DCB support .......... .......... ........... .......... ........... .......... .......... ........... .......... ........... . 11

    3.1.1 Force10 S4810 ................................................................................................................................................................ 11

    3.1.2 Force10 S4820T ............................................................................................................................................................. 11

    3.1.3 Force10 MXL ................................................................................................................................................................... 11

    3.1.4 PowerConnect 81XX Series .......................................................................................................................................... 11

    3.1.5 Cisco Nexus 5548UP ..................................................................................................................................................... 11

    3.1.6

    Brocade B8000 ............................................................................................................................................................. 12

    3.2

    Configuration for switches that do not support DCB for EqualLogic ................................................................. 12

    3.2.1

    PowerConnect 8024, 8024F, and M8024 ................................................................................................................ 12

    3.2.2

    Cisco Nexus 5010/5020 and Nexus 7000................................................................................................................ 12

    A EqualLogic command line reference for DCB configuration verification ..................................................................... 13

    B Broadcom 57810S configuration and verification ............................................................................................................. 15

    B.1 Broadcom 57810S DCBX willing mode verification ............................................................................................... 15

    B.2 Broadcom 57810S iSCSI VLAN configuration .......................................................................................................... 16

    B.3

    Broadcom 57810S DCB configuration verification ................................................................................................. 16

  • 8/10/2019 BP1058 DCB Config

    4/17

    4 BP1058 | EqualLogic DCB Configuration Best Practices

    1 IntroductionData Center Bridging (DCB) is a networking standard that first appeared on Fibre Channel over Ethernet

    (FCoE) SANs as a method to ensure lossless delivery of Fibre Channel (FC) traffic from Ethernet hosts to FC

    storage targets. Over recent years, this technology has been extended to deliver similar benefits for iSCSI

    storage solutions and continues to gain acceptance with storage networking device manufacturers and

    customers. Beginning with Dell EqualLogicFirmware release 5.1 in 2010, Dell introduced DCB for

    iSCSI on all 10 GbE PS Series products. Given that all network elements in a DCB-enabled iSCSI SAN need

    to support DCB, Dell offers PowerEdge converged network adapters (CNAs) and Ethernet switches in

    the PowerConnect and Force10 product line that support DCB for iSCSI. A complete listing of all

    Ethernet switches and CNAs validated for DCB compliance with EqualLogic can be found in the

    EqualLogic Compatibility Matrixat

    http://en.community.dell.com/techcenter/storage/w/wiki/2661.equallogic-compatibility-matrix.aspx

    1.1

    ObjectiveThe purpose of this document is to provide an overview of the DCB requirements for EqualLogic and to

    assist with identifying and resolving basic DCB configuration issues in the EqualLogic SAN. This

    information may be used to ensure that DCB is properly enabled across all devices in the SAN or to ensure

    that DCB is effectively disabled if it is not required.

    Note: For an in-depth tutorial of DCB, refer to the Dell white paper, Data Center Bridging: Standards,

    Behavioral Requirements, and Configuration Guidelines with Dell EqualLogic iSCSI SANsat

    http://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20283700/download.aspx

    1.2 AudienceThis document is primarily targeted at storage and networking administrators who are responsible for the

    design, deployment, and maintenance of Dell EqualLogic SANs and related system components. It is

    assumed that the reader has operational and administrative knowledge of EqualLogic storage, iSCSI SAN

    network design, and related EqualLogic networking best practices. For a comprehensive listing of

    EqualLogic networking best practices, please refer to the EqualLogic Configuration Guideat

    http://en.community.dell.com/techcenter/storage/w/wiki/2639.equallogic-configuration-guide.aspx

    http://en.community.dell.com/techcenter/storage/w/wiki/2661.equallogic-compatibility-matrix.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/2661.equallogic-compatibility-matrix.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20283700/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20283700/download.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/2639.equallogic-configuration-guide.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/2639.equallogic-configuration-guide.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/2639.equallogic-configuration-guide.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20283700/download.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/2661.equallogic-compatibility-matrix.aspx
  • 8/10/2019 BP1058 DCB Config

    5/17

    5 BP1058 | EqualLogic DCB Configuration Best Practices

    2 DCB configuration guidelines

    2.1 DCB requirements summaryIt is required that all devices in the EqualLogic SAN support DCB for iSCSI when this functionality is

    enabled. If any device in the SAN does not support DCB, then DCB must be disabled at the switches for

    the entire SAN. Once all devices in the SAN are DCB compliant, then DCB can be re-enabled. Devices that

    are designated as DCB Supported in the EqualLogic Compatibility Matrixhave been fully validated by Dell

    to ensure compatibility for EqualLogic SANs. In deployments that contain devices not listed in the

    EqualLogic Compatibility Matrix, ensure that all Ethernet switches and CNAs in the SAN adhere to the

    following DCB standards:

    Support for DCB versions 1.01 (also known as Baseline DCBx or CEE DCBx) or IEEE DCB.

    Data Center Bridging Exchange (DCBX)DCB protocol that performs discovery, configuration, and

    mismatch resolution using Link Layer Discovery Protocol (LLDP).

    iSCSI application priority Support for the iSCSI protocol in the application priority DCBX Type

    Length Value (TLV). Advertises the priority value (IEEE 802.1p CoS, PCP field in VLAN tag) for iSCSI

    protocol. End devices identify and tag Ethernet frames containing iSCSI data with this priority value.

    Enhanced Transmission Selection (ETS) Provides minimum, guaranteed bandwidth allocation per

    traffic class/priority group during congestion and permits additional bandwidth allocation during

    non-congestion.

    Priority-based Flow Control (PFC)-Independent traffic priority pausing and enablement of lossless

    packet buffers/queuing for iSCSI.

    2.2 Configuration process overview

    Important:With all network configuration changes, there is the possibility of service interruptions.Network changes required to properly configure DCB for EqualLogic will result in a temporary loss of

    connectivity. Therefore, Dell strongly recommends that all network environment changes are performed

    during a planned maintenance window.

    This section provides general steps to configure DCB for EqualLogic andSection 3contains detailed steps

    for specific Dell and other switch models. These steps apply to both new deployments and those

    deployments that have DCB improperly configured. It is important to verify that all components in the SAN

    are listed in the EqualLogic Compatibility Matrixas DCB Supported or that the components support all

    EqualLogic requirements for DCB. If multiple switches are in the path between iSCSI Hosts and EqualLogic

    arrays, then all configuration steps below must be applied to these switches. For SAN deployments with

    two or more switch hops, please refer to Data Center Bridging: Standards, Behavioral Requirements, andConfiguration Guidelines with Dell EqualLogic iSCSI SANsfor additional configuration guidance and

    considerations at:

    http://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20283700/download.aspx

    http://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20283700/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20283700/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20283700/download.aspx
  • 8/10/2019 BP1058 DCB Config

    6/17

    6 BP1058 | EqualLogic DCB Configuration Best Practices

    When configuring DCB on a new array member, ensure the switch is setup properly first. The CLI setup

    wizard or the Remote Setup Wizard will detect the switch is DCB capable and prompt for the required

    configuration information, including the VLAN ID, during setup.

    To configure DCB on an existing EqualLogic array member:

    1.

    Disable DCB on the switch, if it is enabled.2.

    Verify that allCNAs are enabled and configured in DCB willing mode.

    3.

    Verify that the EqualLogic array has DCB enabled (Note: This is enabled by default and should

    never be disabled).

    4. Enter a VLAN ID from 2-4096 in Group Manager. With firmware v7 and later, the VLAN ID will

    default to 2 when DCB is detected on the switch.

    5. On the switch, create a VLAN in trunk mode for all switch ports connected to arrays and iSCSI

    hosts with the same VLAN ID configured on the array.

    6. Configure all CNAs with same VLAN ID configured on the array.

    7.

    On the switch, configure Priority Groups/ETS, PFC, and iSCSI application priority on all ports

    connected to EqualLogic arrays and iSCSI host CNAs. The same should be configured for any

    switch interconnects (LAGs, VLTi, vPC, and others)8.

    Enable DCB on the switch.

    9.

    Verify all DCB configuration and operational parameters on array ports via Group Manager.

    10. Verify DCB operational parameters on CNAs using the respective management application.

    Steps 1, 3, 4, 7, 8, and 9 are outlined in the following section.Appendix Bprovides additional guidance for

    steps 2, 6, and 10 using the Broadcom57810S CNA.

    2.3 Enabling DCB and configuring the VLAN

    The DCB VLAN setting can be found in the Group Manager Summarypage as seen below. For firmwareversions prior to 7.x, the Enable DCBcheckbox should always be checked. With firmware version 7.x and

    later, the checkbox is no longer displayed and DCB is always enabled and in willing mode.

  • 8/10/2019 BP1058 DCB Config

    7/17

    7 BP1058 | EqualLogic DCB Configuration Best Practices

    Figure 1 DCB VLAN setting from Group Manager v7

    Important: At no point should DCB be disabled on the array.

    This is important for several reasons:

    DCB is enabled on 10 Gb capable arrays by default and in willing mode. It can only be disabled via

    CLI and should only be done if instructed by Dell support.

    Disabling DCB on the array does not ensure that DCB is fully disabled in the SAN and flow control

    may not be enabled between the switch ports, hosts, and arrays.

    When DCB is enabled, the arrays receive DCB configuration information from the switch and will

    continue to provide real-time DCB status which can be used to verify the configuration. If the

    attached switch ports are not DCB enabled, then the array ports will operate in standard (802.3x)

    flow control mode.

    Next, a valid VLAN ID must be entered. The range of recommended values is 2-4096. However, verify that

    the VLAN ID choice does not conflict with any default or reserved IDs for your specific switch make and

    model. With firmware v7 and later, the VLAN ID will default to 2 when DCB is detected on the switch.

    Important:When DCB is enabled on the switch, it is necessary to configure a non-default VLAN on the

    array, switch, and all host ports that are part of the EqualLogic SAN. VLAN IDs 0 and 1 should not be used

    as these may be the default or reserved VLAN for some switches, and as such, may forward frames

    untagged (with no VLAN tagging). VLAN tagging is required to fully support DCB.

    2.4

    Switch configurationFor switch configuration steps, refer toSection 3and find your specific switch model. If the specific switch

    is not listed, consult with your switch vendor to confirm the DCB support requirements for EqualLogic and

    obtain instructions for configuring (or disabling) DCB on the switch as needed.

  • 8/10/2019 BP1058 DCB Config

    8/17

    8 BP1058 | EqualLogic DCB Configuration Best Practices

    2.5 Disabling DCB on the SANWhen DCB functionality is not required for the SAN deployment, DCB must be disabled on all switches in

    the SAN. Once DCB is disabled on the SAN, the attached EqualLogic arrays and CNAs will no longer

    receive DCBx messages from the attached switches, effectively disabling DCB functionality on the SAN

    completely. Configuration steps for disabling DCB can also be found inSection 3.

    Important:If DCB is disabled on the switch, ensure that 802.3x flow control is enabled on all switch ports

    attached to the EqualLogic arrays and iSCSI hosts. EqualLogic best practices recommend a minimum of

    RX flow control on the switch ports. Also it is assumed that the switches are dedicated for SAN traffic

    alone when DCB is disabled.

    Important:If DCB is disabled on a switch, then all DCB functionality will be disabled, including support

    for other protocols such as FCoE. Mixing of FCoE and iSCSI on the same converged fabric is not

    recommended and not supported by Dell.

    Note: VLAN tagging is only supported when DCB mode is fully enabled and configured. If DCB is disabled

    on the switch, switch ports must be configured as untagged or as access ports (or left in the native

    VLAN).

    2.6 DCB configuration verificationThe following sections show how to verify the DCB configuration of a switch via the EqualLogic Group

    Manager. Equivalent methods for verifying the configuration via the command line interface (CLI) are

    provided inAppendix A.

    2.6.1 Priority Group, ETS, and PFC verificationTo determine what configuration steps inSection 2are needed to properly configure switches and correct

    the error condition, verify the following information in Group Manager.

    1.

    In Group Manager, click a member array and go to the Networktab.

    2. Right-click on each 10 Gb interface (for example eth0) and click DCB Detailsto display the dialog

    box shown below.

  • 8/10/2019 BP1058 DCB Config

    9/17

    9 BP1058 | EqualLogic DCB Configuration Best Practices

    3. From these details, verify the following:

    a. Column 1: For the iSCSI Traffic Class Group (Group 1, in this example), only iSCSI is present (no

    other traffic classes should appear, such as FCoE).

    b. Column 2: ETS % from 1 to 100% (recommend 50% as an initial setting).

    c.

    Column 3: Priority level for iSCSI is 4 (recommended).

    d.

    Column 4: Lossless state for iSCSI equals PFC ON for priority 4.

    4.

    Repeat this verification for all 10 Gb array interfaces in the group.

    2.6.2 Invalid DCB configuration detectionA new capability released with version 6.0 of the EqualLogic firmware automatically detects if there is an

    invalid configuration state on the Ethernet switch attached to the EqualLogic array due to the following

    conditions:

    PFC is configured (PFC TLV received)

    iSCSI is using a priority group which is not PFC enabled (lossless)

    This state will result in a warning message that will be displayed at the bottom of the EqualLogic Group

    Manager interface as shown inFigure 3.

    Figure 2

    Invalid DCB configuration detection warning message in Group Manager v7

    If a switch does not support the iSCSI TLV, it may not be possible to properly classify the iSCSI traffic and

    assign it to a priority group and enable DCB Priority-based Flow Control. In this case, the array will place

    all iSCSI frames in default priority 0. Typically, priority 0 will not have PFC enabled on the switch, which

    means that iSCSI traffic would be treated with the same priority as all other traffic or in some cases, with a

  • 8/10/2019 BP1058 DCB Config

    10/17

    10 BP1058 | EqualLogic DCB Configuration Best Practices

    lower priority. It is also possible that even when the iSCSI TLV is supported by the switch, the iSCSI priority

    may not have PFC enabled for that priority. Upon detection of either of these conditions, the array will

    issue a warning message that Ethernet flow control has been disabled on one or more interfaces.

    Operation with no flow control may cause performance degradation and service interruptions.

    Refer to subsequent sections in this document for information on corrective actions.

    Figure 3 Invalid DCB configuration detection warning message in Group Manager v6

    In addition to this warning message, a more detailed message will appear in the event log and CLI as

    shown in these examples:

    Firmware Versions up to 6.0.3:

    Interface eth0 has negotiated DCB Priority-based Flow Control with the switch. However, the switch did

    not configure iSCSI traffic for a lossless priority. No Ethernet flow control is enabled for iSCSI on this

    interface.

    Firmware versions 6.0.4 and higher:

    Interface eth0 has detected an invalid switch configuration. All iSCSI initiators and targets connected to

    this switch will have no flow control for iSCSI until this is corrected.

    Firmware version 7.0.0 and higher:

    An invalid switch configuration has been detected. This issue must be corrected in the networkinfrastructure. Refer to the document located at:

    http://en.community.dell.com/techcenter/storage/w/wiki/4355.configuring-dcb-with-equallogic-

    sans.aspx

    http://en.community.dell.com/techcenter/storage/w/wiki/4355.configuring-dcb-with-equallogic-sans.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/4355.configuring-dcb-with-equallogic-sans.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/4355.configuring-dcb-with-equallogic-sans.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/4355.configuring-dcb-with-equallogic-sans.aspxhttp://en.community.dell.com/techcenter/storage/w/wiki/4355.configuring-dcb-with-equallogic-sans.aspx
  • 8/10/2019 BP1058 DCB Config

    11/17

    11 BP1058 | EqualLogic DCB Configuration Best Practices

    3 Switch specific configuration stepsIn this section, switch-specific commands are provided to correctly configure DCB for the EqualLogic SAN

    or disable it completely if DCB is not required. This is not a comprehensive set of configuration commands

    for EqualLogic deployments; it is only intended to address the DCB configuration aspect of switches

    within the EqualLogic SAN.

    3.1 Configuration for switches with DCB supportThe following switches feature DCB with the requirements necessary to fully support EqualLogic storage

    systems. These switches can be configured for DCB mode or as a dedicated SAN switch with standard

    link-level (802.3x) flow control.

    3.1.1 Force10 S4810Refer to the Dell Force10 S4810 Switch Configuration Guidefor instructions related to DCB or non-DCB

    configuration at

    http://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20220824/download.aspx

    3.1.2 Force10 S4820TRefer to the Dell Force10 S4820TSwitch Configuration Guidefor instructions related to DCB or non-DCB

    configuration at

    http://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20293376/download.aspx

    3.1.3

    Force10 MXLRefer to the Dell Force10 MXL 10/40 GbE Blade Switch Configuration Guidefor instructions related to

    DCB or non-DCB configuration at

    http://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20279157/download.aspx

    3.1.4 PowerConnect 81XX SeriesRefer to the Dell PowerConnect 8100Series Switch Configuration Guidefor instructions related to DCB or

    non-DCB configuration at

    http://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20308559/download.aspx

    3.1.5 Cisco Nexus 5548UP

    Refer to the Cisco Nexus 5548-UP Switch Configuration Guidefor instructions related to DCB or non-DCB configuration at

    http://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20293377/download.aspx

    http://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20220824/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20220824/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20293376/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20293376/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20279157/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20279157/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20308559/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20308559/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20293377/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20293377/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20293377/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20308559/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20279157/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20293376/download.aspxhttp://en.community.dell.com/dell-groups/dtcmedia/m/mediagallery/20220824/download.aspx
  • 8/10/2019 BP1058 DCB Config

    12/17

    12 BP1058 | EqualLogic DCB Configuration Best Practices

    3.1.6 Brocade B8000Refer to the Brocade B8000 Switch Configuration Guidefor instructions related to DCB or non-DCB

    configuration at

    http://en.community.dell.com/techcenter/extras/m/white_papers/20439106/download.aspx

    3.2

    Configuration for switches that do not support DCB for

    EqualLogicThe following switches do not fully support DCB requirements for EqualLogic, so DCB must be disabled

    on these SAN switches.

    Important:If DCB is disabled on a switch, then all DCB functionality will be disabled, including support

    for other protocols such as FCoE. Mixing of FCoE and iSCSI on the same converged fabric is not

    recommended and not supported by Dell.

    3.2.1

    PowerConnect 8024, 8024F, and M8024The first step in configuring this line of switches is to first verify the firmware version installed is 5.0.0.4 or

    higher.

    Note:If an earlier firmware version is installed, it will not be possible to fully disable DCB on the switch

    and correct the invalid flow control condition on the arrays and hosts.

    Upgrade instructions can be found under the corresponding product firmware download pages at

    http://support.dell.com.

    To disable DCB, refer to the following guide:

    http://en.community.dell.com/techcenter/extras/m/white_papers/20437136/download.aspx

    3.2.2 Cisco Nexus 5010/5020 and Nexus 7000

    The Cisco Nexus 5010/5020 and Nexus 7000 family enables DCB by default, but it does not support the

    iSCSI TLV. Furthermore, Cisco does not provide a method for fully disabling DCB on the switch.

    Note:All firmware versions do not support DCB with iSCSI TLV. DCB support on these switches is for

    FCoE only.

    DCB functionality can be disabled on the Nexus 5000 and 7000 switches by disabling LLDP on all portsthat connect to EqualLogic array controller ports. This essentially prevents the transmission of DCBX

    advertisements to the storage system.

    http://en.community.dell.com/techcenter/extras/m/white_papers/20439106/download.aspxhttp://support.dell.com/http://support.dell.com/http://en.community.dell.com/techcenter/extras/m/white_papers/20437136/download.aspxhttp://en.community.dell.com/techcenter/extras/m/white_papers/20437136/download.aspxhttp://en.community.dell.com/techcenter/extras/m/white_papers/20437136/download.aspxhttp://support.dell.com/http://en.community.dell.com/techcenter/extras/m/white_papers/20439106/download.aspx
  • 8/10/2019 BP1058 DCB Config

    13/17

    13 BP1058 | EqualLogic DCB Configuration Best Practices

    A EqualLogic command line reference for DCB configuration

    verification

    From the CLI (GroupAdmin login), the following commands can be executed to obtain the same

    information that is presented in the Group Manager GUI:

    show grpparams(Display Global DCB and VLAN status):

    PG1> show grpparams__________________________ Group Information __________________________Name: PG1Group-Mgmt-Gateway: 192.168.140.1Def-Snap-Warn: 10%Def-Thin-Growth-Warn: 60%DateAndTime: Fri Nov 9 13:32:41 2012Description:Def-Iscsi-Alias: yes

    Info-Messages: enabledWebaccess-noencrypt: enabledCliaccess-Telnet: enabledSyslog-Notify: disabledEmail-List:Smtp-Server-List:DNS-Suffix-List:Target-Auth-UserName:Zphr8HHZj2PJX22HEmail-From:Conn-Balancing: enabledEmail-Contact:Disallow-Downgrades: yesSSH-V1-Protocol: enabledStandby-Button: disabledDef-DCB-VLAN-Id: 100Crypto-Legacy-Protocols: enabledSession-Idle-Timeout: 0Session-Banner-Enable: disabled

    Group-Ipaddress: 10.10.10.150Def-Snap-Reserve: 100%Def-Snap-Depletion: delete-oldestDef-Thin-Growth-Max: 100%TimeZone: America/New_YorkDef-Iscsi-Prefix:iqn.2001-05.com.equallogic

    Webaccess: enabledCliaccess-SSH: enabledEmail-Notify: disablediSNS-Server-List:NtpServers:DNS-Server-List:Syslog-Server-List:Target-Auth-Password:BbH822Bx2xXpBRJZLocation: defaultDiscovery-Use-Chap: disabledPerf-balancing: enabledManagement-Ipaddress:192.168.140.170FTP-service: enabledDCB: enabledThermal-Shutdown: enabledVolume-Recovery: enabledSession-Idle-Timeout-Enable:disabledDef-Snapshot-Borrow: disabled

    member select eth show (Display DCB ON/OFF):

    The example below is from an EqualLogic PS6110, so eth0 is the iSCSI port and eth1 is the

    management port which shows the DCB as off for the management port.

    PG1> member select P1 eth showName ifType ifSpeed Mtu Ipaddress Status Errors DCBeth0 ethernet-

    csmacd10 Gbps 9000 10.10.10.141 up 0 on

    eth1 ethernet-csmacd

    100 Mbps 1500 192.168.140.171 up 0 off

  • 8/10/2019 BP1058 DCB Config

    14/17

    14 BP1058 | EqualLogic DCB Configuration Best Practices

    member select eth select 0 dcb show (Display DCB details):

    PG1> member select P1 eth select 0 dcb show_________________________ Eth DCB Information _________________________Name: eth0Lossless-Priorities: on

    Congestion Notification: off

    DCB: onTraffic-Classes: on

    iSCSI-Priority: 4

    member select eth select 0 dcb lossless-priority show (Display Lossless Priority

    configuration):

    PG1> member select P1 eth select 0 dcb lossless-priority showPriority Status0123

    offoffoffoff

    4 on567

    offoffoff

    member select eth select 0 dcb traffic-class show (Display Traffic Classes):

    PG1> member select P1 eth select 0 dcb traffic-class showTrafficClass

    Bandwidth Priorities

    12

    50%50%

    40,1,2,3,5,6,7

  • 8/10/2019 BP1058 DCB Config

    15/17

    15 BP1058 | EqualLogic DCB Configuration Best Practices

    B Broadcom 57810S configuration and verification

    B.1 Broadcom 57810S DCBX willing mode verification

    Figure 4 below shows a screen shot from the Broadcom Advanced Control Suite (BACS). This is applicableto the Broadcom 57810S Dual-Port 10 GbE SFP+ adapter and the Broadcom 57810S Dual-Port 10 GbE KR

    Blade Converged Mezzanine Card on Windows Server 2008 R2 SP1. The parameter local machine willing

    indicates the willing mode state and is enabled by default.

    Figure 4 Initiator willing mode configuration

    In this figure, the adapter is configured with willing mode enabled by default. Also the local DCBX settings

    are shown in the default configuration. These settings include the priority and PFC values for FCoE and

    iSCSI. This also includes the priority groups with their bandwidth allocation and priority mapping. Once the

    adapter port establishes an operational link with a peer switch port and receives the switch DCBX settings,

    it will use those settings for DCB operations. The local settings will not be operational at that point. The

    default local DCBX setting can be changed by overriding them.

  • 8/10/2019 BP1058 DCB Config

    16/17

    16 BP1058 | EqualLogic DCB Configuration Best Practices

    B.2 Broadcom 57810S iSCSI VLAN configuration

    The figure below illustrates the VLAN configuration for iSCSI traffic on the adapter port.

    Figure 5

    Initiator VLAN ID configuration

    B.3

    Broadcom 57810S DCB configuration verification

    The image below is the screen shot from the Broadcom Advanced Control Suite. This is applicable to the

    Broadcom 57810S Dual-Port 10 GbE SFP+ adapter and the Broadcom 57810S Dual-Port 10 GbE KR Blade

    Converged Mezzanine Card on Windows Server 2008 R2 SP1. The DCB parameters shown are the values

    advertised by the switch peer and accepted by the NIC port. It also indicates the DCB operational state for

    each feature.

    Figure 6 DCBX operation state and configuration verification

  • 8/10/2019 BP1058 DCB Config

    17/17

    17 BP1058 | EqualLogic DCB Configuration Best Practices

    The local and remote DCBX settings are displayed in the DCBX Advancedsection of the BACS, seeFigure7.

    Figure 7

    Advanced DCB operation state and configuration verification