PCIe4 x16 2-Port
EDR 100 GB IB ConnectX-5 CAPI Capable Adapter (FC EC64 and EC65; CCIN 2CF2)
******* PLEASE
READ THIS ENTIRE NOTICE *********
DATE: July 17, 2019
|
Firmware Level |
Description |
|
16.24.8000 |
Impact: Usability
Severity: ATT (The following are
from vendor Bug Fixes History from fw release notes
that could potentially affect POWER products) Fixed an issue that
prevented IB QP counters for Acks/Responses from working as a result the
NACK/OOS counters showed as zero Fixed a rare case
that caused the transmission side to hang and an assertion in the RDMA ODP. Fixed a PCIe
bifurcation issue Fixed rare errors in
RX that resulted in double completion. Fixed an issue that
occasionally caused the link to drop after running the 'reboot' command due
to I2C being stuck. |
|
|
The Firmware Levels Below Are No Longer Supported By
IBM Once They Have Been Removed From The Microcode Down Load Website. It is best practices to update to the latest FW level not only for IBM
support of these products, but for optimal performance and to ensure that all of the required HW/FW fixes are installed. Once new FW
has been released to the field, we will provide a 6 month grace period for
customers to update these products to the currently supported FW level . Please Update To The Latest Level At Your
Earliest Convenience |
|
16.22.8042 (Linux) |
Impact: NEW
Severity: NEW |
|
Document Revision History |
Description |
|
V1.0 – 12/05/2018 |
Original Release |
|
07/17/2019 |
Update to level
16.24.8000 |
This readme file is intended to give directions on how to update the
microcode found on the PCIe4
2-port EDR IB Adapter.
Non-Concurrent Download (Linux
Only)
The microcode installation does NOT support concurrent download in
Linux. The device can be used during and after the download, but update will
not go into effect until a reboot is performed.
NOTE:
- It is recommended that the
installation be scheduled during a maintenance window or during non-peak
production periods.
- It is best practice to
update to latest FW level not only for IBM support of these products, but for
optimal performance and to ensure that all the required HW/FW fixes are
installed.
- Once new FW has been
released to the field, we will provide a 6 month grace
period for customers to update these products to the currently supported FW
level.
Approximately 20 minutes.
Feature Code:
EC64
· 8335-GTC
· 8335-GTG
· 8335-GTH
· 8335-GTW
· 8335-GTX
· 9008-22L
· 9009-22A
· 9080-M9S
· 9223-22H
Feature
Code: EC65
· 9009-41A
· 9009-42A
· 9040-MR9
· 9223-42H
For Linux operating systems, use the following
procedure:
1. Find the PCI slot the ConnectX-5 adapter is
plugged into. Issue the following command:
lspci -nnd 15b3:1019 -s.0 | grep -i infiniband
For example:
# lspci -nnd 15b3:1019
-s.0 | grep -i infiniband
0000:01:00.0 Infiniband controller [0207]: Mellanox Technologies MT28800
Family [ConnectX-5 Ex] [15b3:1019]
0003:01:00.0 Infiniband controller [0207]: Mellanox Technologies MT28800
Family [ConnectX-5 Ex] [15b3:1019]
0033:01:00.0 Infiniband controller [0207]: Mellanox Technologies MT28800
Family [ConnectX-5 Ex] [15b3:1019]
Note:
a)
This shows adapters in PCIe slots
0003:01:00.0 or 0033:01:00.0 may be eligible for update based on output of step
3.
b)
If updating on MTM 8335:GXX
and adapter is installed in slot 2, it will show as two separate adapters on
PCIe slot 0003 and 0033 due to this systems shared slot feature.
Only run the following procedure on 0003 or 0033, not both.
c)
Two port adapters show as both *.0 and
*.1, for example 0000:01:00.0 and 0000:01:00.1 are two ports on the same
adapter.
Only run the following procedure on *.0, not both.
2. Start MFT tools by running `mst
start`
#mst start
Starting MST (Mellanox Software Tools) driver set
Loading MST PCI module - Success
Loading MST PCI configuration module - Success
Create devices
If the system does not have the mst
command available, please install the Mellanox Firmware Tools (MFT) available
here: http://www.mellanox.com/page/management_tools
3. Verify the current Firmware level by running “flint -d <pci bus ID> -q”. Replace <pci bus ID> with the ID found in the lscpi command from step 2.
# flint -d 0003:01:00.0 q
Image type: FS4
FW Version: 16.22.8042
FW Release Date: 13.9.2018
Description: UID GuidsNumber
Base GUID: 248a070300ab05d2 4
Base MAC: 248a07ab05d2 4
Image VSD: N/A
Device VSD: N/A
PSID: IBM0000000002
Orig PSID: N/A
Security Attributes: N/A
This command reveals the current
version of the FW; which is 16.22.8042 in this particular case.
If the version is less than 16.24.8000, please update.
4. Download the firmware RPM file to the
destination machine.
Use this method to download the new
microcode to a Linux system:
NOTE: The instructions that follow are specific Linux
commands. Linux commands are CASE (lower and upper) SENSITIVE, and must
be entered exactly as shown, including filenames.
a)
Transfer the RPM
format file to the /tmp directory (using “Save
as....”). You will see the filename for the RPM file.
b)
Install rpm on your
Linux system by typing:
rpm
-ivh /tmp/fw-ConnectX5-rel-16_24_8000-00WT174_Ax.bin.Linux.rpm
The microcode package will install the
firmware images in the /lib/firmware directory. If a message is displayed
saying the "package <package_name> is
already installed", you will need to uninstall the listed rpm package. On
the command line type:
rpm
-e <package_name>
where <package_name>
is the name of the package that was returned in the message. Return to Step 2
and attempt to install the file again.
c)
The microcode file
will be installed to the /lib/firmware directory. The file name is：
5. Verify the contents of the image before flashing:
ls
-l /lib/firmware/fw-ConnectX5-rel-16_24_8000-00WT174_Ax.bin to verify file size:
·
fw-ConnectX5-rel-16_24_8000-00WT177_Ax.bin = 16777216
sum
/lib/firmware/fw-ConnectX5-rel-16_24_8000-00WT174_Ax.bin
48749 16384
or
shasum -a 256
/lib/firmware/fw-ConnectX5-rel-16_24_8000-00WT174_Ax.bin
d865e00f89569a6c383e2ae823b035f946298f63bbfbc385a35e7aff91cf76c7
6. Update the FW with "flint -d <pci bus id> -i <image
filename> burn"
For example:
#
flint -d 0003:01:00.0 -i
/lib/firmware/fw-ConnectX5-rel-16_24_8000-00WT174_Ax.bin burn
Current FW version on
flash: 16.22.8042
New FW version: 16.24.8000
Burning FW image without signatures - OK
Restoring signature
- OK
7. At this point we have burned the new FW on to
the Mellanox adapter. However, this FW will not take effect till the system is
rebooted.
Reloading the drivers is not enough; it requires the system linux partition to be
rebooted.
This adapter is not supported in
AIX.