Readme for IBM Flex System EN4054 4-port 10Gb Ethernet Adapter *10**/**25**/2013**: See Document Change History <#Change_history> for details on changes to this document.* Contents * 1.0 Overview <#_1.0_Overview> * 2.0 Adapters Affected <#_2.0_Adapters_Affected> * 3.0 Microcode Description and Revision History <#_3.0_Microcode_Description> * 4.0 Cautions and Important Notes <#_4.0_Cautions_and> * 5.0 To Determine Adapter Microcode Levels <#_5.0_To_Determine> o 5.1 AIX Systems <#_5.1_AIX_Systems> o 5.2 Linux Systems <#_5.2_Linux_Systems> * 6.0 Install RPM Package <#_6.0_Install_RPM> o 6.1 AIX RPM Package <#_6.1_AIX_RPM> o 6.2 Linux using the Standalone Diagnostics CD <#_6.2_Linux_RPM>** * 7.0 Installing the Adapter's Microcode <#_7.0_Installing_the> o 7.1 Using the AIX Command-Line Method <#_7.1_Using_the> o 7.2 Using the Diagnostic Service Aid Method <#_7.2_Using_the> * 8.0 Verifying the Update <#_8.0_Verifying_the> o 8.1 Verifying the Update on AIX <#_8.1_Verifying_the> o 8.2 Verifying the Update on Linux <#8.2_Verifying_the_Update_on_Linux> * Document Change History <#_Document_Change_History> ------------------------------------------------------------------------ 1.0 Overview This update contains the AIX RPM file for the current level of microcode for the IBM Flex System EN4054 4-port 10Gb Ethernet Adapter, Feature Code 1762. This is a multiport adapter with two ASICs. Each ASIC requires it?s own microcode update. To update the microcode for the entire adapter, all of the adapter resources (ports) need to be updated to ensure both ASICs are updated. Back to Contents <#Contents> ------------------------------------------------------------------------ 2.0 Adapters Affected This microcode is for feature code 1762: Option PN 81Y3124: CCIN 2B5D, Asm PN 81Y3126 To determine the part number of the adapter on an AIX system, on the command line key the following command: *lscfg -vl entX* where entX represents the adapter Affected adapters will be listed as: 10GbE 4-port Mezzanine Adapter (a2191007df1033e7) To determine the presence of this adapter on a Linux system, on the command line key in: *lspci -nn* Affected adapters will be listed as: Emulex Corporation OneConnect 10Gb NIC (be3) [19a2:0710] The typical time to install the microcode is 0.4 hr. Back to Contents <#Contents> ------------------------------------------------------------------------ 3.0 Microcode Description and Revision History *Microcode Level* *Changes* 0400602810015 0400602810008 Fix config Patterns cannot configure bandwidths on Emulex CN4054 Adapter from Virtual Fabric Mode to Switch Independent with single deployment/reboot Fix ports are disappearing in the Storage (UEFI) when try to Reconnect Devices with IBM1212-24.1 0400104220000 This is the level of microcode that is initially supported when it became generally available. *The Firmware Levels Below Are No Longer Supported Please Update To The Latest Level At Your Earliest Convenience* Back to Contents <#Contents> ------------------------------------------------------------------------ 4.0 Cautions and Important Notes * *Concurrent Download* The microcode installation does *NOT* support concurrent download while the ent resources are available for use. If the ent resources are in use, they must manually be released prior to starting the download. Failure to do so will result in a message instructing that the ent resource be freed. *NOTE*: It is recommended that the installation be scheduled during a maintenance window or during non-peak production periods. * *NOTICE FOR AIX CUSTOMERS INSTALLING 0400602810015 MICROCODE* o *AIX Requirements* Prior to installing the microcode, it is required that the following AIX Service Packs or later be installed. + AIX 6.1 TL6 SP8 + AIX 6.1 TL7 SP3 + APAR IV14283 + AIX 7.1 TL0 SP6 + AIX 7.1 TL1 SP3 + APAR IV14284 The Service Packs can be obtained from the IBM Fix Central website located at http://www.ibm.com/eserver/support/fixes. o *VIOS Requirements *If the adapter is running in a partition running VIOS, it is required that VIOS 2.2.1.4 or later be installed. o *Linux Requirements *RHEL5.7, RHEL 6.2 and SLES 11 SP2 or later are supported Linux distributions. o *Known Issues* + *Refer to these retain tips for other known issues.* 1. Title: CN4054/EN4054: CMM SHOWS FW MISMATCH AFTER FIRMWARE UPDATE The management module obtains the firmware version by reading a EEPROM memory module on the adapter. On the reboot following a firmware update the two network controllers of the adapter arbitrate for their chance to update the firmware information stored in the memory module. On some firmware update, it may require two reboots before both controller successfully update the EEPROM memory module. 2. Title: FLEX: MAC ADD +1 SEEN ON SWITCH CONNECTED TO CN4054/EN4054 The adapter uses the second or the MAC+1 port address for LLDP/DCBX (Link Layer Discovery Protocol)/(Data Center Bridging eXchange) link exchange. The DCBX engine is built into the network controller ASIC for FCoE and is always active although FCoE is not supported. This MAC+1 address remains constant and is not changed with OFM. The forwarding data base of the switch will show the Ethernet Base port MAC + 1 address value. A user may expect to only see the port Base MAC address. This is a potential point of confusion for a user who is unaware of the reason why the base MAC+1 address is present. Back to Contents <#Contents> ------------------------------------------------------------------------ 5.0 To Determine Adapter Microcode Levels Before installing the microcode, it is important to determine the current microcode level of the adapter. 5.1 AIX Systems 1. List the Ethernet adapters installed in the system by typing on the command line: *lsdev | grep -e ent* Note the names of all the Ethernet adapters installed. The adapters will be identified as: 10GbE 4-port Mezzanine Adapter. The adapter names will be entX, where X is 0, 1, or some other number. 2. Determine the current microcode level on the adapter by typing on the command line: *lsmcode -d entX* where X is the number of the adapter's port returned from the "lsdev" command above. A screen similar to the following will be displayed: DISPLAY MICROCODE LEVEL 802111 ent0 PCIe2 4-port 10GbE Mezz Adapter (a2191007df1033e7) The current microcode level is 0400602810015. Use Enter to continue. F3=Cancel F10=Exit Enter If the current microcode level is not 0400602810015, then the microcode image on the adapter is not at the latest level. Back to Contents <#Contents> 5.2 Linux Systems 1) List the Ethernet adapters installed in the system by typing: #ifconfig -a | grep eth Note: All of the Ethernet adapters that are installed will be displayed. They will be listed as ethX, where X is 0, 1, etc. 2) Use ethtool -i ethX to display the microcode level for each device. If the firmware-version is not 4.1.422.0, then the firmware on the adapter is not at the latest level. Back to Contents <#Contents> ------------------------------------------------------------------------ 6.0 Install RPM Package 6.1 AIX RPM Package Use this method to install the AIX RPM package on an AIX system. Note that the commands are case sensitive and must be entered exactly as shown, including file names. Installing the RPM places the binary file a2191007df1033e7.0400602810015 into the /etc/microcode directory. 1. If the /etc/microcode directory does not exist, make a directory to receive the RPM format file. On the command line type: *mkdir /etc/microcode* 2. Transfer the RPM format file, a2191007df1033e7.0400602810015.aix.rpm to any temporary directory on the target system. 3. Unpack the file. On the command line type: *rpm -ihv --ignoreos a2191007df1033e7.0400602810015.aix.rpm* 4. If the microcode package unpacks successfully, the microcode file will be added to the /etc/microcode directory. If a message is received saying the "package ** is already installed", you will need to uninstall the rpm package. On the command line type: *rpm -e * where is the name of the package that was returned in the message. Return to step 3 and attempt to unpack the file again. 5. To complete the update go to section 7.0. Back to Contents <#Contents> 6.2 Linux using the Standalone Diagnostics CD Below are references and the general flow on how to update microcode update via CD 1) Boot the system via a Standalone Diagnostic's CD a) To create a bootable Diagnostic's CD go to the following URL. http://www.software.ibm.com/webapp/set2/sas/f/diags/home.html b) After booting to Standalone Diagnostics, the Diagnostic's CD can be removed. 2) The Diagnostic's CD should be replaced by a CD containing the unpacked microcode image(s). The CD containing the microcode images should be prepared prior. This can be done by taking the oc11-4.6.281.15_IBM.ufi.rpm file(s) and unpacking them on a usable server. The unpacked files can then be burned on to the CD media. Back to Contents <#Contents> ------------------------------------------------------------------------ 7.0 Installing the Adapter's Microcode 7.1 Using the AIX Command-Line Method Login as root user. From the command line key in: *diag -d entX -T download* where X is the port on which you want to install the microcode. Self-explanatory menus will step you through the microcode installation. All of the ent resources needs to be updated for the entire adapter to be updated. Back to Contents <#Contents> 7.2 Using the Diagnostic Service Aid Method Login as root user. From the command line key in: *diag* Select: *Task Selection (Diagnostics, Advanced Diagnostics, Service Aids, etc.)* Select: *Microcode Tasks* Select: *Download Latest Available Microcode* Select: *file system* * /etc/microcode* Select the device: *ent** Press enter when prompted to download the microcode. All of the ent resources needs to be updated for the entire adapter to be updated. Upon completion, a message will state that the microcode has been successfully downloaded and that the new level is 0400602810015. _Back to Contents_ <#Contents> ------------------------------------------------------------------------ 8.0 Verifying the Update 8.1 Verifying the Update on AIX 1. List the Ethernet adapters installed in the system by typing on the command line: *lsdev | grep -e ent* Note the names of all the Ethernet adapters installed. The adapters will be identified as 10GbE 4-port Mezzanine Adapter (a2191007df1033e7). The adapter names will be entX, where X is 0, 1, or some other number. 2. Determine the current microcode level on the adapter by typing on the command line: *lsmcode -d entX* where X is the number of the adapter's port returned from the "lsdev" command above. A screen similar to the following will be displayed: DISPLAY MICROCODE LEVEL 802111 ent0 PCIe2 4-port 10GbE Mezz Adapter (a2191007df1033e7) The current microcode level is 0400602810015. Use Enter to continue. F3=Cancel F10=Exit Enter If the current microcode level is 0400602810015, then the microcode has been updated. _Back to Contents_ <#Contents> 8.2 Verifying the Update on Linux 1) List the Ethernet adapters installed in the system by typing: #ifconfig -a | grep eth Note: All of the Ethernet adapters that are installed will be displayed. They will be listed as ethX, where X is 0, 1, etc. 2) Use ethtool -i ethX to display the microcode level for each device. If the current microcode level is 4.1.422.0, then the microcode has been updated. _Back to Contents_ <#Contents> ------------------------------------------------------------------------ Document Change History *Date* *Change* 05/09/2012 Initial Document 08/14/2013 Update with firmware 0400602810008 10/25/2013 Update with firmware 0400602810015 _Back to Contents_ <#Contents> ------------------------------------------------------------------------