PCIe4 4-Port 32Gb FC Adapter

PCIe4 2-Port 64Gb FC Adapter

 

******* PLEASE READ THIS ENTIRE NOTICE *********

 

DATE: May 19, 2023

Table of Contents

1.0 Microcode and Document Revision History:

2.0 General information

3.0 Installation time

4.0 Machine's Affected:

5.0 Cautions and Important Notes

6.0 Determine the Current Microcode Level

6.1 AIX Systems:

6.2 Linux Systems:

7.0 Downloading the RPM Format File to the Target Server

7.1 Downloading AIX RPM Package

7.2 Downloading Linux RPM Package

8.0 Discovery Tool Microcode DVD-ROM creation and download instructions

9.0 Verifying microcode before download and notes

9.1 Verifying microcode before download for AIX

9.2 Verifying microcode before download for Linux

10.0 Microcode Download Procedure for AIX:

10.1 Setting up for Microcode download

10.2 Downloading Microcode to the Adapter

10.3 Verify and Re-configure adapters

11.0 Microcode Download Procedure for Linux using Emulex hbacmd utility

11.1 Download One Command Manager

11.2 Download Code to Adapter

 

 

 

1.0 Microcode and Document Revision History:
 

Microcode Level

Changes

070B00

Impact: New   Severity: New
* This is the initial level of microcode released on the adapters

The Firmware Levels Below Are No Longer Supported by IBM Once They Have Been Removed from The Microcode Download Website.

It is required to update to the latest FW level not only for continued IBM support of these products, but for optimal performance and to ensure that all the necessary HW/FW fixes are installed.

The latest level can be found at IBM Fix Central

·      https://www.ibm.com/support/fixcentral/

 

Document Revision History

Description

1.0

5/19/23: Initial firmware 070B00 release


2.0 General information

This Readme file is intended to give directions on how to update the microcode found on the following adapters:

PCIe4 4-Port 32G FC Adapter (CCIN: 2F06 with FC: EN2L and EN2M)

·      771089201410c606

 

PCIe3 2-Port 64G FC Adapter (CCIN: 2F05 with FC: EN2N and EN2P)

·      771089221410c506

 

3.0 Installation time

Approximately 20 minutes.

 

4.0 Machine's Affected: 

IBM Power 10 and Following

 

5.0 Cautions and Important Notes

 ·    Concurrent Download

The microcode installation supports concurrent download while the adapter and attached storage devices are available for use. HOWEVER, it is highly recommended that installation be scheduled during a maintenance window or during non-peak production periods.

·    AIX Diag and Standalone Diag DVD

Please also use the latest AIX Standalone Diagnostics DVD found here
Standalone Diagnostics CD Overview and Download (ibm.com)    

 Important Notice:  EEH error entries in AIX system errlog are expected when updating adapter FW.

  

6.0 Determine the Current Microcode Level

 6.1 AIX Systems:

Before you install the microcode, it is important to determine the microcode level of the Adapter installed in the target system. Use the following instructions to read the ROM level stored in the adapter's VPD.

1)  List the Fiber Channel adapters in the system by typing:

# lscfg -l fcs\*

Note: All of the Fiber Channel ports that are installed will be displayed. They will be listed as fcsX, where X is 0, 1, etc.

2) To check the current microcode level for the adapter or controller enter the following command

# lsmcode -cd fcsX <Where “X” is the instance of the adapter>

The command will produce output similar to:

The current microcode level for fcsX

is 070B00.

If the ROM Level is less than 070B00, you should update the microcode.
 

 6.2 Linux Systems:

The following steps are for Linux Red Hat or SuSE systems running 4.18 kernels which support the /sys filesystem. These steps assume you are logged in with root permissions and one or more Fibre Channel Adapters are installed.

1) Display the model description for each installed Fibre Channel adapter. Expect two instances of PCIe4 x-Port xxGb Fibre Channel Adapters to be displayed: one for each port on the dual or quad port adapter. Type the following commands to display a list showing the host{n}: description for each installed adapter. Note: this command may differ between linux versions.

# cd /sys/class/scsi_host;find -L host* -maxdepth 1 -name "model_desc" |xargs -i -t cat {}

The output will be similar to that shown here. The host{n} values will be used in the next step. If the list is empty, either there are no adapters installed or there was an error in typing the command. If the list contains other adapters but no IBM Fibre Channel adapters are listed, none are installed, and this firmware update should not be applied.

host0:IBM xxxP/Nxxx PCIe4 x-Port xxGb Fibre Channel Adapter

host1:IBM xxxP/Nxxx PCIe4 x-Port xxGb Fibre Channel Adapter

2) Display the firmware version for each adapter. Type the following command, replacing host{n} with the value reported for each adapter listed in Step 1. Note this command may be different depending on the Linux version you are running.

# cat /sys/class/scsi_host/host{n}/fw_version

The microcode version listed may vary but output will be similar to that shown here:

·      9.13.00 (d0d5)

Repeat this command for each host{n}. If one or more adapters lists a microcode version that is not 9.13.00 (d0d5), then the microcode update should be applied.

3) Display Linux Operating System version. Type the following command to display the Operating System version. Make a note of Operating System version, it will be needed later.

For Red Hat systems, type the following command.
# cat /etc/redhat-release

Output will be similar to: Red Hat Enterprise Linux Server release 8.6

For SuSE systems, type the following command:
# cat /etc/SuSE-release

Output will be similar to:
SUSE Linux Enterprise Server 15 (ppc64)
VERSION = 15
PATCHLEVEL = 4

 

7.0 Downloading the RPM Format File to the Target Server

7.1 Downloading AIX RPM Package

Use this method to download to an AIX system:  

NOTE: The instructions that follow are specific AIX commands. AIX commands are CASE (lower and upper) SENSITIVE, and must be entered exactly as shown, including filenames.

1) Make two directories on your AIX system to receive the RPM format file.
    Enter:      "mkdir /tmp/microcode”

    and then create this directory

    Enter:      "mkdir /tmp/microcode/RPM"

2) Transfer the RPM format file to the /tmp/microcode/RPM directory (using "Save as ...").  Change to that directory, "cd /tmp/microcode/RPM".

You'll see the filename for the RPM file.

·      rpm -ihv --ignoreos /tmp/microcode/RPM/<package name>.aix.rpm

 

3) For AIX:  The microcode files will be added to /etc/microcode/. 

NOTE:
 - "/etc/microcode" is a symbolic link to "/usr/lib/microcode".
 - If permission does not allow the copy to the above stated directory or file then the user will be prompted for a new location.

 

7.2 Downloading Linux RPM Package

Follow these steps to install the Linux RPM package on a Linux system. Note that the Linux commands are case sensitive and must be entered exactly as shown, including file names.

1)    Transfer the Linux rpm file to a temporary directory on the target server such as /tmp.

2)    Unpack the rpm file by typing:                                                                                                             

·      rpm -ihv --ignoreos /tmp/microcode/RPM/<package name>.grp.linux.rpm

3)    The microcode package extracts the firmware file to the /lib/firmware directory. If a message is displayed saying the "package <package_name> is already installed", you will need to uninstall the rpm package. On the command line type:

# rpm -e <package_name>

where <package_name> is the name of the package that was returned in the message. Return to Step 2 and attempt to unpack the file again.

 

8.0 Discovery Tool Microcode DVD-ROM creation and download instructions

To obtain information how to burn a DVD-ROM and run the Discovery Tool for an AIX or Linux System please go to: http://www14.software.ibm.com/support/customercare/mds/

1) After running the Discovery Tool successfully, the "/tmp/microcode/RPM" directory was created, and your rpm files are copied from the DVD-ROM.

2) Change to that directory, "cd /tmp/microcode/RPM".

3) Unpack the file by executing the instructions below:
    Enter the commands:

            rpm -ihv --ignoreos /tmp/microcode/RPM/<package name>.aix.rpm

4) A microcode file will be copied to "/etc/microcode".
               File Name: 771089201410c606.070B00

               or

               File Name: 771089221410c506.070B00

             
               NOTE:
 - "/etc/microcode" is a symbolic link to "/usr/lib/microcode".
 - If permission does not allow the copy to the above stated directory or file then the user will be prompted for a new location.

  

9.0 Verifying microcode before download and notes

9.1 Verifying microcode before download for AIX

Please verify the file size and checksum of the raw microcode files matches what is listed below.

For AIX:

Please verify the file size and checksum

# ls -l /usr/lib/microcode/771089201410c606.070B00

·      1376444 Apr 21 10:38 /usr/lib/microcode/771089201410c606.070B00

 

# sum /usr/lib/microcode/771089201410c606.070B00

·      56636  1345 /usr/lib/microcode/771089201410c606.070B00

Or

# ls -l /usr/lib/microcode/771089221410c506.070B00

·      1376444 Apr 21 10:39 /usr/lib/microcode/771089221410c506.070B00

 

# sum /usr/lib/microcode/771089221410c506.070B00

·      56636  1345 /usr/lib/microcode/771089221410c506.070B00 

9.2 Verifying microcode before download for Linux

 Please verify the file location, size and checksum of the raw microcode files matches what is listed below for Linux:

Please verify file size and checksum

# ls -l /lib/firmware/771089201410c606.070B00.grp

·      1376444 Apr 18 09:52 /lib/firmware/771089221410c506.070B00.grp

 

# sum /lib/firmware/771089201410c606.070B00.grp

·      56636  1345 /lib/firmware/771089201410c606.070B00.grp

or

# ls -l /lib/firmware/771089221410c506.070B00.grp

·      1376444 Apr 21 10:39 /lib/firmware/771089221410c506.070B00.grp

 

# sum /lib/firmware/771089221410c506.070B00.grp

·      56636  1345 /lib/firmware/771089221410c506.070B00.grp

 

10.0 Microcode Download Procedure for AIX: 

Microcode download must be performed separately for each Adapter under each Logical Partitions (LPAR's).

10.1 Setting up for Microcode download

1) Stop all applications that use this interface/adapter

2) You only need to pick one of the fcs#s per adapter for microcode update. Diag will update microcode for all ports.

 

10.2 Downloading Microcode to the Adapter

1) At the command line type “diag

2) Select the "Task Selection" from diagnostics menu.

3) Select "Microcode Tasks” then select “Download Microcode" from the menu.

4) Select all of the Fibre Channel Adapters that need to be updated from the list of devices

by using the arrow keys to highlight the entry and pressing "Enter" to mark it.  The devices will be displayed as fcs#, where # is the number of the device.  Press "F7" when you are done marking all the adapters you want to flash.

5) If a source selection menu is displayed, Select “/etc/microcode”.

6) A dialogue box will be displayed on screen. It will state the current microcode level and list the available levels.

7) Select the 070B00 level and press "Enter" to flash the adapter.

8) The following message will appear on the screen when download is completed: "Installation of the microcode has completed successfully on the following instances of the adapter:…  The current microcode level ……   Please run diagnostics on these resources to ensure that the adapter is functioning properly." 

9) If you selected more than one adapter to update, then steps 6-9 will repeat until all adapters are updated.

10) Exit diagnostics.

 

10.3 Verify and Re-configure adapters

1) Verify the code level is 070B00 by typing "lsmcode -cd fcs#" for each Fiber Channel adapter updated. <Where # is the instance of the adapter>

2) Re-configure/Verify the adapter’s information through the “smit” menus if necessary.

  

11.0 Microcode Download Procedure for Linux using Emulex hbacmd utility

Microcode download must be performed separately for each Adapter under each Logical Partitions (LPAR's).

11.1 Download One Command Manager

Microcode updates on Fibre Channel adapters installed in a Linux system require the use of the Marvell qaucli utility. The qaucli utility is included in the Marvell QConvergeConsloe CLI Application Kit for ppc.  Visit the Marvell support site to download.

https://www.marvell.com/support.html 

·      Category: Fibre Channel

·      Platform / OS: Linux

·      Keywords: QConvergeConsole

Select the latest QConvergeConsole CLI for ppc Application Kit link. 

When prompted, save the Application Kit to a directory of your choice on the target server and install.

Ensure that all I/O activity to storage devices controlled by the adapter is stopped prior to proceeding with firmware update as the adapter will be reset after firmware update.

 

11.2 Download Code to Adapter

Follow the instructions provided with the QConvergeConsole Users Guide.

https://www.marvell.com/support.html 

·      Category: Fibre Channel

·      Platform / OS: Linux

·      Keywords: QConvergeConsole

Select the latest “User’s Guide – QconvergeConsole CLI” and follow the instructions provided.

System must be rebooted for firmware to be loaded.  Reboot system

After system reboot, check firmware version to ensure it is as expected.

If, firmware version is not the version you are expecting, carefully retrace steps for omissions and examine console output for errors.  Contact IBM support if you need further assistance.