10 Gigabit Ethernet-SR PCI Express Adapter (FC: 5769) PCIe LP 10GbE SR 1-port Adapter (FC: 5275) 10 Gigabit Ethernet-CX4 PCI Epress Adapter (FC: 5732) PCIe LP 10GbE CX4 1-port Adapter (FC: 5272) ******* PLEASE READ THIS ENTIRE NOTICE ********** * *DATE: **September 24, 2014*** *Table of Contents* 10 Gigabit Ethernet-SR PCI Express Adapter (FC: 5769) 1 <#_Toc224382818> 10 Gigabit Ethernet-CX4 PCI Epress Adapter (FC: 5732) 1 <#_Toc224382819> 1.0 Microcode and Document Revision History: 1 <#_Toc224382820> 2.0 General information. 2 <#_Toc224382821> 3.0 Installation time. 2 <#_Toc224382822> 4.0 Machine's Affected: 2 <#_Toc224382823> 5.0 AIX Requirements: 2 <#_Toc224382824> 6.0 Determine the Current Microcode Level for AIX: 3 <#_Toc224382825> 7.0 Downloading the RPM Format File to the Target Server for AIX.. 3 <#_Toc224382826> 8.0 Discovery Tool Microcode CD-ROM creation and download instructions. 4 <#_Toc224382827> 9.0 Verifying microcode before download and notes for AIX.. 5 <#_Toc224382828> 10.0 Microcode Download Procedure for AIX: 5 <#_Toc224382829> 10.1 Setting up for Microcode download. 5 <#_Toc224382830> 10.2 Downloading Microcode to the Adapter 6 <#_Toc224382831> 10.3 Verify and Re-configure adapters. 6 <#_Toc224382832> *=====================================================================================* 1.0 Microcode and Document Revision History: *Firmware Level* *Description* RR0100 Beta Level RR0120 Release Level RR0140 Memory Barrier Support – to adapt to the new Power PC architecture and its order of instruction execution Improved method of replenishing receive buffers *Document Revision History* *Description* 05/30/2009 Original README file 09/24/2014 Updating Readme file with latest microcode for this adapter - RR0140 2.0 General information This Readme file is intended to give directions on how to update the microcode found on the 10 Gigabit Ethernet-SR PCI Express Adapter (FC 5769) / 10 Gigabit Ethernet-CX4 PCI Epress Adapter (FC 5732). 3.0 Installation time Approximately 20 minutes. 4.0 Machine's Affected: (5769) 8202-E4B, 8203-E4A, 8204-E8A, 8205-E6B, 8231-E2C, 8233-E8B, 8234-EMA, 8236-E8C, 8246-L2S, 8248-L4T, 8261-E4S, 8286-41A, 8286-42A, 8408-E8D, 8412-EAD, 9109-RMD, 9117-MMA, 9119-FHA, 9125-F2A, 9179-MHB and any new system that supports PCI-Express slots (5275) 8202-E4B, 8205-E6B, 8231-E1C, 8231-E2B, 8246-L1C, 8246-L2B, 8247-21L, 8247-22L, 8268-E1D, 8284-22A and any new system that supports PCI-Express slots (5732) 8202-E4B, 8203-E4A, 8204-E8A, 8205-E6B, 8231-E2C, 8233-E8B, 8234-EMA, 8236-E8C, 8246-L2S, 8248-L4T, 8261-E4S, 8408-E8D, 8412-EAD, 9109-RMD, 9117-MMA, 9119-FHA, 9125-F2A, 9179-MHB and any new system that supports PCI-Express slots (5272) 8202-E4B, 8205-E6B, 8231-E1C, 8231-E2B, 8246-L1C, 8246-L2B, 8268-E1D and any new system that supports PCI-Express slots 5.0 AIX Requirements: Basic card function is supported on : AIX 5L Version V5.3 technology level 5300-10 and later AIX 6L Version V6.0 technology level 6100-03 and later 6.0 Determine the Current Microcode Level for AIX: Before you install the microcode, it is important to determine the microcode level of the Adapter installed in the target system. Use the following instructions to read the ROM level stored in the Adapter's VPD. 1) List the Host Bus Adapters installed in the system by typing: lsdev -C | grep hba Note: All of the Host Bus Adapters that are installed will be displayed. They will be listed as hbaY, where Y is 0, 1, etc. 2) To check the current microcode level for the adapter or controller enter the following command lscfg -vl hbaY Where “Y” is the instance of the adapter. The command will produce output similar to: For the SR adapter: # lscfg -vl hba1 hba1 U78A0.001.DNWH3MG-P1-C3-T1 10 Gigabit Ethernet-SR PCI-Express Host Bus Adapter (2514300014108c03) 10 Gigabit Ethernet-SR PCI Express Adapter: EC Level....................D76809 FRU Number..................46K7897 Part Number.................46K7897 Manufacture ID..............1037 Feature Code/Marketing ID...5769 Serial Number...............YL1120079190 Network Address.............00145E990914 ROM Level.(alterable).......RR0140 Hardware Location Code......U78A0.001.DNWH3MG-P1-C3-T1 And for the CX4 adapter: # lscfg -vl hba3 hba3 U78A0.001.DNWH3MG-P1-C3-T1 10 Gigabit Ethernet-CX4 PCI-Express Host Bus Adapter (251430001410a303) 10 Gigabit Ethernet-CX4 PCI Express Adapter: EC Level....................D76809 FRU Number..................46K7899 Part Number.................46K7899 Manufacture ID..............1037 Feature Code/Marketing ID...5732 Serial Number...............YL1020039638 Network Address.............001A64DA9171 ROM Level.(alterable).......RR0140 Hardware Location Code......U78A0.001.DNWH3MG-P1-C3-T1 If the *ROM Level* is less than *RR0140* you should update the microcode. 7.0 Downloading the RPM Format File to the Target Server for AIX Use this method to download to an AIX system: *NOTE:* The instructions that follow are specific AIX commands. AIX commands are CASE (lower and upper) SENSITIVE, and */must/* be entered exactly as shown, including filenames. 1) Make two directories on your AIX system to receive the RPM format file. Enter: "mkdir /tmp/microcode" and then create this directory Enter: "mkdir /tmp/microcode/RPM" 2) Transfer the RPM format file to the /tmp/microcode/RPM directory (using "Save as ..."). Change to that directory, "cd /tmp/microcode/RPM". You'll see the filename for the RPM file. "rpm -ihv --ignoreos pciex.251430001410-RR0140-1.aix.noarch.rpm" 3) For AIX: The microcode files will be added to /usr/lib/microcode/. *NOTE:* - "/etc/microcode" is a symbolic link to "/usr/lib/microcode". - If permission does not allow the copy to the above stated directory or file then the user will be prompted for a new location. 8.0 Discovery Tool Microcode CD-ROM creation and download instructions To obtain information how to burn a CD-ROM and run the Discovery Tool for an AIX or Linux System please go to: http://techsupport.services.ibm.com/server/mdownload/CDROMhelp.html 1) After running the Discovery Tool successfully the "/tmp/microcode/RPM" directory was created and your rpm files are copied from the CD-ROM. 2) Change to that directory, "cd /tmp/microcode/RPM". 3) Unpack the file by executing the instructions below: Enter the commands: rpm -ihv --ignoreos pciex. 251430001410-RR0140-1.aix.noarch.rpm 4) Two microcode files will be copied to "/etc/microcode". The file size and checksum of the microcode image will be verified in Section 9.0. File Names: 2514300014108c03.RR0140 251430001410a303.RR0140 *NOTE:* - "/etc/microcode" is a symbolic link to "/usr/lib/microcode". - If permission does not allow the copy to the above stated directory or file then the user will be prompted for a new location. 9.0 Verifying microcode before download and notes for AIX Please verify the file size and checksum of the raw microcode files matches what is listed below. For AIX : "ls -l /etc/microcode/2514300014108c03.RR0140" to verify file size is 131072. "ls -l /etc/microcode/251430001410a303.RR0140" to verify file size is 131072. "sum /etc/microcode/2514300014108c03.RR0140" to verify Checksum is 02090. "sum /etc/microcode/251430001410a303.RR0140" to verify Checksum is 02090. 10.0 Microcode Download Procedure for AIX: Microcode download must be performed separately for each Adapter under each Logical Partitions (LPAR's). 10.1 Setting up for Microcode download 1) Stop all applications that use the Ethernet interface on the Host Bus or Ethernet Adapter 2) Determine which Ethernet Adapter/Interface (entX/enX) is associated to Host Bus Adapter (hbaY) by issuing the follow command: lscfg | egrep ‘25143000|ct3’ The following is an example of the result of this command. # lscfg | egrep '25143000|ct3' + hba0 U789C.001.DQDM323-P1-C3-T1 10 Gigabit Ethernet-SR PCI-Express Host Bus Adapter (2514300014108c03) * ent3 U789C.001.DQDM323-P1-C3-T1-L0 10 Gigabit Ethernet Adapter (ct3) + hba1 U789C.001.DQDM323-P1-C2-T1 10 Gigabit Ethernet-CX4 PCI-Express Host Bus Adapter (251430001410a303) * ent8 U789C.001.DQDM323-P1-C2-T1-L0 10 Gigabit Ethernet Adapter (ct3) The above screen shot shows the parent and child relationship for these adapters. The child shares the same root hardware location code as the parent, but adds an extra level of identification to help keep parent and child separated. Make note of these relationships, so that the proper Ethernet Interface is detached for the corresponding Host Bus Adapter (ie. hba0 is the parent of ent3/en3 and hba1 is the parent of ent8/en8) 3) ***This step is for VIOS Users only*** – Detach and Remove the SEA (Shared Ethernet Adapter) interface # lsdev -C |grep ent ent8 Available 05-00-00 10 Gigabit Ethernet Adapter (ct3) ent9 Available Shared Ethernet Adapter a) Before detaching the Shared Ethernet Adapter’s interface, record the ip address and any other pertinent information that was configured on the Adapter. This information may be needed if the microcode update overwrites this section on the Adapter. b) “ifconfig en”X” detach” – where “X” is the interface number for the Shared Ethernet Adapter. c) “rmdev –l ent”X” – where “X” is the interface number for the Shared Ethernet Adapter. 4) Detach the Adapter’s interface a) Before detaching the interface, record the ip address and any other pertinent information that was configured on the Adapter. This information may be needed if the microcode update overwrites this section on the Adapter. b) Under normal conditions, to detach the adapter from the network use the following command: “ifconfig en”X” detach” – where “X” is the interface number for the adapter. 10.2 Downloading Microcode to the Adapter 1) At the command line type “diag” 2) Select the "Task Selection" from diagnostics menu. 3) Select "Download Microcode" or "Microcode Tasks” then select “Download Microcode" from the menu. 4) Select all of the *10 Gigabit Ethernet-SR PCI Express Host Bus Adapter (2514300014108c03)* */ 10 Gigabit Ethernet-CX4 PCI Express Adapter Adapters (251430001410a303) *that need to be updated from the list of devices by using the arrow keys to highlight the entry and pressing "Enter" to mark it. The devices will be displayed as hbaY, where Y is the number of the device. Press "F7" when you are done mark all the adapters you want to flash. 5) Select "/usr/lib/microcode" or “/etc/microcode”. 6) A dialogue box may be displayed on screen. It will state that the current microcode level on the adapter could not be found on the selected source. This is acceptable because the adapter will reject any incorrect code. Press "Enter" to continue. 7) Select *RR0140* level and press "Enter" to flash the adapter. 8) The following message will appear on the screen when download is completed: "Microcode download complete successfully. The current microcode level for the device hbaY is ... Please run diagnostics on the adapter to ensure that it is functioning properly." 9) If you selected more than one adapter to update, then steps 6-9 will repeat until all adapters are updated. 10) Exit diagnostics. 10.3 Verify and Re-configure adapters 1) Verify the code level is *RR0140* by typing "lscfg -vl hbaY" for each Host Bus Adapter updated. (Where Y is the instance of the Host Bus Adapter) 2) ***This step is for VIOS Users only*** Re-Configure the SEA adapter by executing the following command: “cfgmgr” Any VIOS specific issues please contact IBM VIOS support team. 3) Re-configure/Verify the adapter’s interface ip information through the “smit” menus.