10 Gigabit Ethernet-SR PCI Express Adapter (FC: 5769)

Firmware Level	Description
RR0100	Beta Level
RR0120	Release Level
RR0140	Memory Barrier Support – to adapt to the new Power PC architecture and its order of instruction execution Improved method of replenishing receive buffers

Document Revision History	Description
05/30/2009	Original README file
09/24/2014	Updating Readme file with latest microcode for this adapter - RR0140

2.0 General information

This Readme file is intended to give directions on how to update the microcode found on the 10 Gigabit Ethernet-SR PCI Express Adapter (FC 5769) / 10 Gigabit Ethernet-CX4 PCI Epress Adapter (FC 5732).

3.0 Installation time

Approximately 20 minutes.

4.0 Machine's Affected:

(5769) 8202-E4B, 8203-E4A, 8204-E8A, 8205-E6B, 8231-E2C, 8233-E8B, 8234-EMA, 8236-E8C, 8246-L2S, 8248-L4T, 8261-E4S, 8286-41A, 8286-42A, 8408-E8D, 8412-EAD, 9109-RMD, 9117-MMA, 9119-FHA, 9125-F2A, 9179-MHB and any new system that supports PCI-Express slots

(5275) 8202-E4B, 8205-E6B, 8231-E1C, 8231-E2B, 8246-L1C, 8246-L2B, 8247-21L, 8247-22L, 8268-E1D, 8284-22A and any new system that supports PCI-Express slots

(5732) 8202-E4B, 8203-E4A, 8204-E8A, 8205-E6B, 8231-E2C, 8233-E8B, 8234-EMA, 8236-E8C, 8246-L2S, 8248-L4T, 8261-E4S, 8408-E8D, 8412-EAD, 9109-RMD, 9117-MMA, 9119-FHA, 9125-F2A, 9179-MHB and any new system that supports PCI-Express slots

(5272) 8202-E4B, 8205-E6B, 8231-E1C, 8231-E2B, 8246-L1C, 8246-L2B, 8268-E1D and any new system that supports PCI-Express slots

5.0 AIX Requirements:

Basic card function is supported on :

AIX 5L Version V5.3 technology level 5300-10 and later

AIX 6L Version V6.0 technology level 6100-03 and later

6.0 Determine the Current Microcode Level for AIX:

Before you install the microcode, it is important to determine the microcode level of the Adapter installed in the target system. Use the following instructions to read the ROM level stored in the Adapter's VPD.

1) List the Host Bus Adapters installed in the system by typing:

lsdev -C | grep hba

Note: All of the Host Bus Adapters that are installed will be displayed. They will be listed as hbaY, where Y is 0, 1, etc.

2) To check the current microcode level for the adapter or controller enter the following command

lscfg -vl hbaY

Where “Y” is the instance of the adapter. The command will produce output similar to:

For the SR adapter:

# lscfg -vl hba1

hba1 U78A0.001.DNWH3MG-P1-C3-T1 10 Gigabit Ethernet-SR PCI-Express Host Bus Adapter (2514300014108c03)

10 Gigabit Ethernet-SR PCI Express Adapter:

EC Level....................D76809

FRU Number..................46K7897

Part Number.................46K7897

Manufacture ID..............1037

Feature Code/Marketing ID...5769

Serial Number...............YL1120079190

Network Address.............00145E990914

ROM Level.(alterable).......RR0140

Hardware Location Code......U78A0.001.DNWH3MG-P1-C3-T1

And for the CX4 adapter:

# lscfg -vl hba3

hba3 U78A0.001.DNWH3MG-P1-C3-T1 10 Gigabit Ethernet-CX4 PCI-Express Host Bus Adapter (251430001410a303)

10 Gigabit Ethernet-CX4 PCI Express Adapter:

EC Level....................D76809

FRU Number..................46K7899

Part Number.................46K7899

Manufacture ID..............1037

Feature Code/Marketing ID...5732

Serial Number...............YL1020039638

Network Address.............001A64DA9171

ROM Level.(alterable).......RR0140

Hardware Location Code......U78A0.001.DNWH3MG-P1-C3-T1

If the ROM Level is less than RR0140 you should update the microcode.

7.0 Downloading the RPM Format File to the Target Server for AIX
Use this method to download to an AIX system:

NOTE: The instructions that follow are specific AIX commands. AIX commands are CASE (lower and upper) SENSITIVE, and must be entered exactly as shown, including filenames.

1) Make two directories on your AIX system to receive the RPM format file.
Enter: "mkdir /tmp/microcode"

and then create this directory

Enter: "mkdir /tmp/microcode/RPM"

2) Transfer the RPM format file to the /tmp/microcode/RPM directory (using "Save as ..."). Change to that directory, "cd /tmp/microcode/RPM".

You'll see the filename for the RPM file.
"rpm -ihv --ignoreos pciex.251430001410-RR0140-1.aix.noarch.rpm"

3) For AIX: The microcode files will be added to /usr/lib/microcode/.

NOTE:
- "/etc/microcode" is a symbolic link to "/usr/lib/microcode".
- If permission does not allow the copy to the above stated directory or file then the user will be prompted for a new location.

8.0 Discovery Tool Microcode CD-ROM creation and download instructions

To obtain information how to burn a CD-ROM and run the Discovery Tool for an AIX or Linux System please go to: http://techsupport.services.ibm.com/server/mdownload/CDROMhelp.html

1) After running the Discovery Tool successfully the "/tmp/microcode/RPM" directory was created and your rpm files are copied from the CD-ROM.

2) Change to that directory, "cd /tmp/microcode/RPM".

3) Unpack the file by executing the instructions below:
Enter the commands:
rpm -ihv --ignoreos pciex. 251430001410-RR0140-1.aix.noarch.rpm

4) Two microcode files will be copied to "/etc/microcode". The file size and checksum of the microcode image will be verified in Section 9.0.
            File Names:
             2514300014108c03.RR0140
            251430001410a303.RR0140

9.0 Verifying microcode before download and notes for AIX

Please verify the file size and checksum of the raw microcode files matches what is listed below.

For AIX :
"ls -l /etc/microcode/2514300014108c03.RR0140" to verify file size is 131072.
"ls -l /etc/microcode/251430001410a303.RR0140" to verify file size is 131072.
"sum /etc/microcode/2514300014108c03.RR0140" to verify Checksum is 02090.
"sum /etc/microcode/251430001410a303.RR0140" to verify Checksum is 02090.

10.0 Microcode Download Procedure for AIX:

Microcode download must be performed separately for each Adapter under each Logical Partitions (LPAR's).

10.1 Setting up for Microcode download

1) Stop all applications that use the Ethernet interface on the Host Bus or Ethernet Adapter

2) Determine which Ethernet Adapter/Interface (entX/enX) is associated to Host Bus Adapter (hbaY) by issuing the follow command: lscfg | egrep ‘25143000|ct3’

The following is an example of the result of this command.

# lscfg | egrep '25143000|ct3'

+ hba0             U789C.001.DQDM323-P1-C3-T1     10 Gigabit Ethernet-SR PCI-Express Host Bus Adapter (2514300014108c03)
* ent3             U789C.001.DQDM323-P1-C3-T1-L0 10 Gigabit Ethernet Adapter (ct3)
+ hba1             U789C.001.DQDM323-P1-C2-T1     10 Gigabit Ethernet-CX4 PCI-Express Host Bus Adapter (251430001410a303)
* ent8             U789C.001.DQDM323-P1-C2-T1-L0 10 Gigabit Ethernet Adapter (ct3)

The above screen shot shows the parent and child relationship for these adapters. The child shares the same root hardware location code as the parent, but adds an extra level of identification to help keep parent and child separated. Make note of these relationships, so that the proper Ethernet Interface is detached for the corresponding Host Bus Adapter (ie. hba0 is the parent of ent3/en3 and hba1 is the parent of ent8/en8)

3) ***This step is for VIOS Users only*** – Detach and Remove the SEA (Shared Ethernet Adapter) interface

# lsdev -C |grep ent

ent8 Available 05-00-00 10 Gigabit Ethernet Adapter (ct3)

ent9 Available Shared Ethernet Adapter

a) Before detaching the Shared Ethernet Adapter’s interface, record the ip address and any other pertinent information that was configured on the Adapter. This information may be needed if the microcode update overwrites this section on the Adapter.

b) “ifconfig en”X” detach” – where “X” is the interface number for the Shared Ethernet Adapter.

c) “rmdev –l ent”X” – where “X” is the interface number for the Shared Ethernet Adapter.

4) Detach the Adapter’s interface

a) Before detaching the interface, record the ip address and any other pertinent information that was configured on the Adapter. This information may be needed if the microcode update overwrites this section on the Adapter.

b) Under normal conditions, to detach the adapter from the network use the following command:

“ifconfig en”X” detach” – where “X” is the interface number for the adapter.

10.2 Downloading Microcode to the Adapter

1) At the command line type “diag”
2) Select the "Task Selection" from diagnostics menu.
3) Select "Download Microcode" or "Microcode Tasks” then select “Download Microcode" from the menu.
4) Select all of the 10 Gigabit Ethernet-SR PCI Express Host Bus Adapter (2514300014108c03) / 10 Gigabit Ethernet-CX4 PCI Express Adapter Adapters (251430001410a303) that need to be updated from the list of devices by using the arrow keys to highlight the entry and pressing "Enter" to mark it. The devices will be displayed as hbaY, where Y is the number of the device. Press "F7" when you are done mark all the adapters you want to flash.
5) Select "/usr/lib/microcode" or “/etc/microcode”.
6) A dialogue box may be displayed on screen. It will state that the current microcode level on the adapter could not be found on the selected source. This is acceptable because the adapter will reject any incorrect code. Press "Enter" to continue.
7) Select RR0140 level and press "Enter" to flash the adapter.
8) The following message will appear on the screen when download is completed: "Microcode download complete successfully. The current microcode level for the device hbaY is ... Please run diagnostics on the adapter to ensure that it is functioning properly."
9) If you selected more than one adapter to update, then steps 6-9 will repeat until all adapters are updated.
10) Exit diagnostics.

10.3 Verify and Re-configure adapters

1) Verify the code level is RR0140 by typing "lscfg -vl hbaY" for each Host Bus Adapter updated. (Where Y is the instance of the Host Bus Adapter)

2) ***This step is for VIOS Users only*** Re-Configure the SEA adapter by executing the following command: “cfgmgr”

Any VIOS specific issues please contact IBM VIOS support team.

3) Re-configure/Verify the adapter’s interface ip information through the “smit” menus.