Readme for IBM Flex System EN4132 2-port 10Gb RoCE Adapter Image 1 and Image 2 *1**6**/08/201**3**: See Document Change History <#Change_history> for details on changes to this document.* Contents * 1.0 Overview <#_1.0_Overview> * 2.0 Adapters Affected <#_2.0_Adapters_Affected> * 3.0 Microcode Description and Revision History <#_3.0_Microcode_Description> * 4.0 Cautions and Important Notes <#_4.0_Cautions_and> * 5.0 To Determine Adapter Microcode Levels <#_5.0_To_Determine> o 5.1 AIX Systems <#_5.1_AIX_Systems> o 5.2 Linux Systems <#_5.2_Linux_Systems> * 6.0 Install RPM Package <#_6.0_Install_RPM> o 6.1 AIX RPM Package <#_6.1_AIX_RPM> o 6.2 Linux <#_6.2_Linux_RPM> * 7.0 Installing the Adapter's Microcode <#_7.0_Installing_the> o 7.1 Using the AIX Command-Line Method <#_7.1_Using_the> o 7.2 Using the Diagnostic Service Aid Method <#_7.2_Using_the> * 8.0 Verifying the Update <#_8.0_Verifying_the> o 8.1 Verifying the Update on AIX <#_8.1_Verifying_the> o 8.2 Verifying the Update on Linux <#8.2_Verifying_the_Update_on_Linux> * Document Change History <#_Document_Change_History> * Apendix: Vendor Firmware Notice <#_Apendix_Vendor_Firmware_Notice> ------------------------------------------------------------------------ 1.0 Overview This update contains the AIX RPM files ( 1 of 2 images) for the current level of microcode for IBM Flex System EN4132 2-port 10Gb RoCE Adapter, Feature Code EC26. This is a multiport adapter with two ASICs. Each ASIC requires it?s own microcode update and RPM package, either Image 1 or Image 2. To update the microcode for the entire adapter, all of the adapter resources (ports) need to be updated to ensure both ASICs are updated. On AIX, this adapter is supported by 2 different device drivers which configure the adapter with 2 different logical names. In this document, the default configuration is assumed and the instructions are written with the default logical name of *roceX* (where X is a number 0, 1, 2, etc.). If the alternative driver is in use, the logical name will be *entX* (where X is a number 0, 1, 2 etc), and in the instructions below, the roceX name should be replaced with the entX name. For Linux, the adapter firmware is included in the Mellanox OFED 1.5.3-4.0.22.3 software release. OFED releases for SLES11 SP2, and RHEL6.3 are available at the Mellanox website. Refer to the OFED documentation for Linux. Back to Contents <#Contents> ------------------------------------------------------------------------ 2.0 Adapters Affected This microcode is for feature code EC26: PN 90Y3480: CCIN 2B05. To determine the part number of the adapter on an AIX system, on the command line key the following command: *lscfg** -vl roceX* where roceX represents the adapter Affected adapters will be listed as: PCIe2 10GbE RoCE Converged Network Adapter The typical time to install the microcode is 0.4 hr. Back to Contents <#Contents> ------------------------------------------------------------------------ 3.0 Microcode Description and Revision History *Microcode Level* *Changes* 000200091314 Increase the PCI buffer to enhance MPI applications. 000200091302 This is the initial level of microcode. *The Firmware Levels Below Are No Longer Supported Please Update To The Latest Level At Your Earliest Convenience* Back to Contents <#Contents> ------------------------------------------------------------------------ 4.0 Cautions and Important Notes * *Concurrent Download* The microcode installation does *NOT* support concurrent download while the adapter roceX resources are in use. If the roceX resources are in use, they must manually be released prior to starting the download. Failure to do so will result in a message instructing that the roceX resource be freed. *NOTE*: It is recommended that the installation be scheduled during a maintenance window or during non-peak production periods. * *NOTICE FOR AIX CUSTOMERS INSTALLING 000200091314 MICROCODE* o *AIX Requirements* Prior to installing the microcode, it is required that the following AIX Service Packs or later be installed. AIX V7.1 with the 7100-02 Technology Level AIX V6.1 with the 6100-08 Technology Level The Service Packs can be obtained from the IBM Fix Central website located at http://www.ibm.com/eserver/support/fixes. Back to Contents <#Contents> ------------------------------------------------------------------------ 5.0 To Determine Adapter Microcode Levels Before installing the microcode, it is important to determine the current microcode level of the adapter. 5.1 AIX Systems 1. List the RoCE adapters installed in the system by typing on the command line: *lsdev** | grep -e roce* Note the names of all the RoCE adapters installed. The adapters will be identified as: PCIe2 10GbE RoCE Converged Network Adapter. The adapter names will be roceX, where X is 0, 1, or some other number. 2. Determine the current microcode level on the adapter by typing on the command line: *lsmcode** -d roceX* where X is the number of the adapter's port returned from the "lsdev" command above. A screen similar to the following will be displayed: DISPLAY MICROCODE LEVEL 802111 roce0 PCIe2 10GbE RoCE Converged Network Adapter The current microcode level for roce0 is 000200091314. Use Enter to continue. F3=Cancel F10=Exit Enter If the current microcode level is not 000200091314, then the microcode image on the adapter is not at the latest level. Back to Contents <#Contents> 5.2 Linux Systems Refer to Mellanox OFED 1.5.3-4.0.22.3* * release information. ------------------------------------------------------------------------ 6.0 Install RPM Package 6.1 AIX RPM Package Use this method to install the AIX RPM packages on an AIX system. Note that the commands are case sensitive and must be entered exactly as shown, including file names. Installing both of the RPM file places two binary files, b3155067b3157265.000200091314 and b3155067b3157365.000200091314, into the /etc/microcode directory. 1. If the /etc/microcode directory does not exist, make a directory to receive the RPM format file. On the command line type: *mkdir** /etc/microcode* 2. Transfer the RPM format files, *b3155067b3157265.000200091314.aix.rpm** *(Image 1) and *b3155067b3157**365.000200091314.aix.rpm** *(Image 2) to any temporary directory on the target system. 3. Unpack the file. On the command line type: *rpm** -ihv --ignoreos b3155067b3157265.000200091314.aix.rpm*** *rpm** -ihv --ignoreos b3155067b3157**365.000200091314.aix.rpm* 4. If the microcode package unpacks successfully, the microcode file will be added to the /etc/microcode directory. If a message is received saying the "package ** is already installed", you will need to uninstall the rpm package. On the command line type: *rpm** -e * where is the name of the package that was returned in the message. Return to step 3 and attempt to unpack the file again. 5. To complete the update go to section 7.0. Back to Contents <#Contents> 6.2 Linux Refer to Mellanox OFED 1.5.3-4.0.22.3 release information. Back to Contents <#Contents> ------------------------------------------------------------------------ 7.0 Installing the Adapter's Microcode 7.1 Using the AIX Command-Line Method Login as root user. From the command line key in: *diag** -d roceX -T download * where X is the port on which you want to install the microcode. Self-explanatory menus will step you through the microcode installation. All of the roce resources need to be updated for the entire adapter to be updated. Back to Contents <#Contents> 7.2 Using the Diagnostic Service Aid Method Login as root user. From the command line key in: *diag* Select: *Task Selection (Diagnostics, Advanced Diagnostics, Service Aids, etc.)* Select: *Microcode Tasks* Select: *Download Latest Available Microcode* Select: *file system* * /etc/microcode* Select the device: * roce** Press enter when prompted to download the microcode. All of the roce resources need to be updated for the entire adapter to be updated. Upon completion, a message will state that the microcode has been successfully downloaded and that the new level is 000200091314. _Back to Contents_ <#Contents> ------------------------------------------------------------------------ 8.0 Verifying the Update 8.1 Verifying the Update on AIX 1. List the RoCE adapters installed in the system by typing on the command line: *lsdev** | grep -e roce* Note the names of all the RoCE adapters installed. The adapters will be identified as: PCIe2 10GbE RoCE Converged Network Adapter. The adapter names will be roceX, where X is 0, 1, or some other number 2. Determine the current microcode level on the adapter by typing on the command line: *lsmcode** -d roceX* where X is the number of the adapter's port returned from the "lsdev" command above. A screen similar to the following will be displayed: DISPLAY MICROCODE LEVEL 802111 roce0 PCIe2 10GbE RoCE Converged Network Adapter The current microcode level for roce0 is 000200091314. Use Enter to continue. F3=Cancel F10=Exit Enter If the current microcode level is 000200091314, then the microcode has been updated. _Back to Contents_ <#Contents> 8.2 Verifying the Update on Linux Refer to Mellanox OFED 1.5.3-4.0.22.3 release information. _Back to Contents_ <#Contents> ------------------------------------------------------------------------ Document Change History *Date* *Change* 11/08/2012 Initial Document 08/16/2013 Update with firmware 000200091314 _Back to Contents_ <#Contents> ------------------------------------------------------------------------ Apendix: Vendor Firmware Notice (Optional) ------------------------------------------------------------------------ _Privacy_ | _Legal_ | _Contact IBM_