PCIe2 LP 4-port 1GbE Adapter (FC: 5260 and EL11)

PCIe2 4-port 1GbE Adapter (FC: 5899)

 

 

 

******* PLEASE READ THIS ENTIRE NOTICE *********

DATE: June 13, 2019

Table of Contents

1.0 Microcode and Document Revision History

1.5 Additional Information

2.0 General information

3.0 Installation time

4.0 Machine's Affected

5.0 AIX Requirements

6.0 Determine the Current Microcode Level for AIX

7.0 Downloading the RPM Format File to the Target Server for AIX

8.0 Discovery Tool Microcode CD-ROM creation and download instructions

9.0 Verifying microcode before download and notes for AIX

10.0 Microcode Download Procedure for AIX

10.1 Setting up for Microcode download

10.2 Downloading Microcode to the Adapter

10.3 Verify and Re-configure adapters

11.0 Microcode Download Procedure for Systems Without AIX Installed

=====================================================================================

1.0 Microcode and Document Revision History:
 

Firmware Level

Description

10020120

Original Release

10040150

Enabling IBMi support for network boot over 100Mb connection.

10050160

A fix was added to handle a NIM installation bug.

10060160

VPD change for new adapter PN

10090180

HMC VPD fix; Etherchannel bug fix; SMS connection timing

10240180

Mandatory firmware update. Details in section 1.5 Additional Information

10240310

Impact: Usability Severity: ATT
Secure Boot support added

 

Document Revision History

Description

05/30/12

Updating Readme file with latest microcode for this adapter- 10040150

02/13/13

Updating Readme file with latest microcode for this adapter- 10050160

04/11/13

Updating Readme file with latest microcode for this adapter- 10060160

05/27/14

Updating Readme file with latest microcode for this adapter- 10090180

12/08/14

Updating Readme file with latest microcode for this adapter- 10240180

06/13/19

Updating Readme file with latest microcode for this adapter- 10240310

1.5 Additional Information:

Our supplier for the 1GB Ethernet adapters with Feature Codes 5899 and 5260, has informed us of an issue with the adapter when it is installed in a configuration that includes a PCIe switch.  A corner case exists if correctable errors are occurring on the PCIe link between the PCIe switch and the root complex inside the Power processor, where the adapter can lose 16 bytes of an Ethernet transmit packet while still marking the packet as being correct, thus disabling the ability for the receiver of the packet to detect the error.

 

The supplier has provided us a fix in adapter firmware code to fix this exposure that we are making available. This fix needs to be applied to all adapters with Feature Codes 5899 and 5260.

2.0 General information:

This Readme file is intended to give directions on how to update the microcode found on the PCIe2 4-port 1GbE Adapter (FC 5260, FC 5899, FC EL11).

3.0 Installation time:

Approximately 20 minutes.

4.0 Machine's Affected: 

FC: 5260: 8202-E4B, 8202-E4C, 8202-E4D, 8205-E6B, 8205-E6C, 8205-E6D, 8231-E1C, 8231-E1D, 8231-E2B, 8231-E2C, 8231-E2D, 8246-L1C, 8246-L1D, 8246-L1S, 8246-L1T, 8246-L2C, 8246-L2D, 8246-L2S, 8246-L2T, 8247-21L, 8247-22L, 8268-E1D, 8284-22A, 8335-GCA, 8335-GTA, 8384-21C, 9009-22A, 9080-M9S, 9080-MHE, 9080-MME, 9119-MHE, 9119-MME, 9223-22H

FC: 5899: 8202-E4B, 8202-E4C, 8202-E4D, 8205-E6B, 8205-E6C, 8205-E6D, 8231-E2C, 8231-E2D, 8233-E8B, 8236-E8C, 8246-L2S, 8246-L2T, 8247-21L, 8247-22L, 8247-42L, 8248-L4T, 8286-41A, 8286-42A, 8335-GCA, 8408-44E, 8408-E8D, 8408-E8E, 8412-EAD, 9008-22L, 9009-22A, 9009-41A, 9009-42A, 9040-MR9, 9080-M9S, 9080-MHE, 9080MME, 9109-RMD, 9117-MMB, 9117-MMC, 9117-MMD, 9117-MMU, 9119-FHB, 9119-MHE, 9119-MME, 9179-MHB, 9179-MHC, 9179-MHD, 9179-MHU, 9223-22H, 9223-42H

FC: EL11: 8246-L1C, 8246-L1D, 8246-L1S, 8246-L1T, 8246-L2C, 8246-L2D, 8246-L2S, 8246-L2T

5.0 AIX Requirements:

Basic card function is supported on:

  AIX®

·         AIX Version 7.1 with the 7100-01 Technology level and Service pack 4, or later.

·         AIX Version 7.1 with the 7100-00 Technology level and Service pack 6, or later.

·         AIX Version 6.1 with the 6100-07 Technology Level, and Service Pack 4, or later.

·         AIX Version 6.1 with the 6100-06 Technology Level, and Service Pack 8, or later.

·         AIX Version 5.3 with the 5300-12 Technology Level and Service Pack 6, or later.

  VIOS

·         VIOS support requires VIOS 2.2.1.5, or later.

FIX Central to download microcode:

http://www-933.ibm.com/eserver/support/fixes/fixcentral

To navigate this site, you will want to specify:

·     Product Group: Systems

·     System: Power

·     Product: Firmware, SDMC, and HMC

·     Machine Type: <Enter Machine Type>

·     Select: Device firmware. Obtain device firmware only. Available for adapters, hard disks, and media devices.

·     Select: By Feature Code

·     Input: 5899, 5260, or EL11

·     Download the RPM file

If you are using another release of AIX, ensure that the adapter is supported on that release before you install the adapter. Contact service and support for assistance.

6.0 Determine the Current Microcode Level for AIX:

Before you install the microcode, it is important to determine the microcode level of the Adapter installed in the target system. Use the following instructions to read the ROM level stored in the Adapter's VPD.

1)  List the Ethernet adapters installed in the system by typing:

    lsdev -C | grep ent

Note: All of the Ethernet adapters that are installed will be displayed. They will be listed as ent”X”, where X is 0, 1, etc.

2) To check the current microcode level for the adapter or controller enter the following command

   lscfg -vl ent”X”

Where “X” is the instance of the adapter. The command will produce output similar to:

# lscfg -vl ent10

  ent10            U789C.001.DQDM323-P1-C3-T1  4-Port Gigabit Ethernet PCI-Express Adapter (e414571614102004)

 

      PCIe2 4-port 1GbE Adapter:

        FRU Number..................74Y4064

        EC Level....................D77125A

        Customer Card ID Number.....576F

        Part Number.................00E1681

        Feature Code/Marketing ID...5899

        Serial Number...............YL502019701S

        Manufacture ID..............5CF3FC5D1338

        Network Address.............5CF3FC5D1338

        ROM Level.(alterable).......10240310

        Hardware Location Code......U789C.001.DQDM323-P1-C3-T1

 

If the ROM Level is less than 10240310 you should update the microcode.

7.0 Downloading the RPM Format File to the Target Server for AIX:

Use this method to download to an AIX system:

NOTE: The instructions that follow are specific AIX commands. AIX commands are CASE (lower and upper) SENSITIVE, and must be entered exactly as shown, including filenames.

1) Make two directories on your AIX system to receive the RPM format file.
    Enter:      "mkdir /tmp/microcode"

   and then create this directory

    Enter:      "mkdir /tmp/microcode/RPM"

2) Transfer the RPM format file to the /tmp/microcode/RPM directory (using "Save as ...").  Change to that directory, "cd /tmp/microcode/RPM".

You'll see the filename for the RPM file.
      
"rpm -ihv --ignoreos  e414571614102004.10240310.aix.rpm"                                                                       

3) For AIX:  The microcode files will be added to /usr/lib/microcode/.

NOTE:
 - "/etc/microcode" is a symbolic link to "/usr/lib/microcode".
 - If permission does not allow the copy to the above stated directory or file then the user will be prompted for a new location.

8.0 Discovery Tool Microcode CD-ROM creation and download instructions:

To obtain information how to burn a CD-ROM and run the Discovery Tool for an AIX or Linux System please go to:

http://www-304.ibm.com/webapp/set2/firmware/lgjsn?mode=10&page=cdrom.html

1) After running the Discovery Tool successfully the "/tmp/microcode/RPM" directory was created and your rpm files are copied from the CD-ROM.

2) Change to that directory, "cd /tmp/microcode/RPM".

3) Unpack the file by executing the instructions below:
    Enter the commands:
      rpm -ihv --ignoreos e414571614102004.10240310.aix.rpm

4) One microcode file will be copied to "/etc/microcode".  The file size and checksum of the microcode image will be verified in Section 9.0.      
             File Name:
            e414571614102004.10240310

NOTE:
- "/etc/microcode" is a symbolic link to "/usr/lib/microcode".

- If permission does not allow the copy to the above stated directory or file then the user will be prompted for a new location. 

- For customers using the AIX Diagnostics CD, please refer to the IBM System Hardware information Center for instructions.

9.0 Verifying microcode before download and notes for AIX:

Please verify the file size and checksum of the raw microcode files matches what is listed below.

Note: Microcode download must be performed separately for each Adapter bus under distinct Logical Partitions (LPAR’s). Please save current and older versions of the microcode update files in case you need to restore the system.

Installation Time:  Approximately 30 min System Time.

Please verify the file size and checksum of the raw microcode fillies matches below:

For AIX :
"ls -l /usr/lib/microcode/e414571614102004.10240310" to verify file size is 524288.
"sum /usr/lib/microcode/e414571614102004.10240310" to verify Checksum is 52105.

10.0 Microcode Download Procedure for AIX: 

Microcode download must be performed separately for each Adapter under each Logical Partitions (LPAR's).

10.1 Setting up for Microcode download:

1) Stop all applications that use this interface/adapter

2) ***This step is for VIOS Users only*** – Detach and Remove the SEA (Shared Ethernet Adapter) interface

# lsdev -C |grep ent

ent6       Available 02-08         4-Port Gigabit Ethernet PCI-Express Adapter (e414571614102004)

ent7       Available               Shared Ethernet Adapter

 

a)    Before detaching the interface, record the ip address and any other pertinent information that was configured on the Adapter.  This information may be needed if the microcode update overwrites this section on the Adapter.

b)    “ifconfig en”X” detach” – where “X” is the interface number for the Shared Ethernet Adapter.

c)    “rmdev –l ent”X” – where “X” is the interface number for the Shared Ethernet Adapter.

 

3) Detach the Adapter’s interface (not always needed, but it is a good practice to do this step.

a)    Before detaching the interface, record the ip address and any other pertinent information that was configured on the adapter.  This information may be needed if the microcode update overwrites this section on the Adapter.

b)    Under normal conditions, to detach the adapter from the network use the following command:
“ifconfig  en”X” detach” – where “X” is the interface number for the adapter. 

10.2 Downloading Microcode to the Adapter:

1) At the command line type “diag”
2) Select the "Task Selection" from diagnostics menu.
3) Select "Download Microcode" or "Microcode Tasks” then select “Download Microcode" from the menu.
4) Select all of the 4-Port Gigabit Ethernet PCI-Express Adapter (e414571614102004) that need to be updated from the list of devices by using the arrow keys to highlight the entry and pressing "Enter" to mark it.  The devices will be displayed as ent#, where # is the number of the device.  Press "F7" or "ESC+7" when you are done mark all the adapters you want to flash.
5) Select "/usr/lib/microcode" or “/etc/microcode”.
6) A dialogue box may be displayed on screen.  It will state that the current microcode level on the adapter is not in the /usr/lib/microcode directory.  This is acceptable because the adapter will reject any incorrect code.  Press "Enter" to continue.
7) Select 10240310 level and press "Enter" to flash the adapter.
8) The following message will appear on the screen when download is completed: "Microcode download complete successfully.  The current microcode level for the device ent# is ...  Please run diagnostics on the adapter to ensure that it is functioning properly." 
9) If you selected more than one adapter to update, then steps 6-9 will repeat until all adapters are updated.
10) Exit diagnostics.
11) Perform a 'dummy replacement' via the hot-plug procedure to the same adapter (if the system supports HOT-PLUG); if not, you will need to REBOOT the LPAR (partition) for the fix to be activated.

 

To Prepare a Hot Plug Slot for dummy replacement of a device

In AIX: Identify Slots on Hot Plug-able machine
# lsslot -c pci

# Slot Description Device(s)

U2C4E.001.DBJ3257-P2-C1 PCI-E capable, Rev 2 slot with 8x lanes ent0 ent1 ent3 ent4

 

Unconfigure devices on the slot of interest

1. Unconfigure Ethernet Network Interfaces
rmdev -l en0

rmdev -l en1

rmdev -l en2

rmdev -l en3

2. Unconfigure Ethernet Devices

rmdev -l ent0

rmdev -l ent1

rmdev -l ent2

rmdev -l ent3

 

3.Perform dummy hoptlug command
# drslot -R -c pci -s U2C4E.001.DBJ3257-P2-C1

 

The visual indicator for the specified PCI slot has

been set to the identify state. Press Enter to continue

or enter x to exit.

 

The visual indicator for the specified PCI slot has

been set to the action state. Replace the PCI card

in the identified slot and press Enter to continue.

Enter x to exit. Exiting now leaves the PCI slot

in the removed state.

 

Replace Operation Complete.

 

4.Configure devices
#cfgmgr

10.3 Verify and Re-configure adapters:

1) Verify the code level is 10240310 by typing "lscfg -vl ent#" for each Ethernet adapter updated. Where # is the instance of the Ethernet adapter

2) ***This step is for VIOS Users only*** Re-Configure the SEA adapter by executing the following command: “cfgmgr”

             Any VIOS specific issues please contact IBM VIOS support team.

3) Re-configure/Verify the adapter’s interface ip information through the “smit” menus.

If the customer runs into VIOS specific issues please contact IBM VIOS support.

NOTE: Once the firmware has been successfully updated, you must use smitty to reconfigure the network.

11.0 Microcode Download Procedure for Systems Without AIX Installed:

Use this procedure if the system has no OS installed or the installed OS (e.g., Linux) does not support microcode download for this device.

1)   Boot the system via a Standalone Diagnostic's CD

a)    To obtain a Standalone Diagnostic CD-ROM please go to the following webpage and follow the instructions
http://www-304.ibm.com/webapp/set2/sas/f/diags/home.html

b)    After booting to Standalone Diagnostics, the Diagnostic's CD can be removed.

2)   The Diagnostic's CD should be replaced by a CD containing the unpacked microcode image.

 The CD containing the microcode images should be prepared prior. Create a CD-ROM with the firmware e414571614102004.10240180 mentioned in section 8.4 and burn the CD with Joliet CD file system.

3)    From the Define a System Console menu either type or select vt320.

4)    Select the "Task Selection" from diagnostics menu then select "Download Microcode".

5)    Select resource 4-Port Gigabit Ethernet PCI-Express Adapter (e414571614102004) that microcode will be applied to and PRESS ENTER.

6)    Press "F7" or "ESC+7" to commit.(The current microcode level of the resource you selected earlier will be displayed at the top of the screen).

7)    Select Input Device (CD-ROM or DVD) then choose the Microcode level to download. 

NOTE: A prompt will ask you to insert the microcode CD-ROM into the CD/DVD drive.  Insert the CD-ROM which accompanies these instructions. If this level is already installed in the drive you've selected a message will let you know. A message also may come up to let you know that the CD_ROM does not have the previous level microcode file. This is true and is not required to complete the download. PRESS "F7" or "ESC+7" to commit.

8)    You will receive a msg. "Current Microcode is...." and "Download has completed successfully"(this may take a few minutes).

9)     Return to the Tasks Selection menu and repeat this procedure for each adapter that requires this microcode.

10) Exit diagnostic and reboot system in normal mode.