Readme File for IBM® Spectrum LSF Data Manager 10.1 Fix Pack 14 (601546)
Abstract
IBM Spectrum LSF Data Manager 10.1 Fix Pack 14. This Fix Pack is a compilation of the fixes to resolve issues between 11 June 2021 and 20 April 2023, and also includes a new solution for LSF Data Manager.
Description
Readme documentation for IBM Spectrum LSF Data Manager 10.1 Fix Pack 14 (601546) including installation-related instructions, prerequisites and co-requisites, and list of fixes.
Note: For the Linux ARMv8 platform, download and install LSF Data Manager 10.1.0.13 from Passport Advantage first (part number M06NKEN), then apply this Fix Pack 14.
LSF Data Manager Version 10.1 Fix Pack 14 resolves the following issues by providing fixes for each one:
|
ID |
Fixed date |
Description |
|
P104852 |
2023/3/24 |
Fix to prevent LSF Data Manager from wrongly creating the #folderdata# subdirectory in the file destination location, if bstage in -all is used. |
|
P104797 |
2023/1/5 |
Fix to prevent LSF Data Manager transfer jobs from copying files to the staging area even though there are no changes in the source data files or folder. |
|
P103996 |
2022/9/8 |
Fix to enhance how the LSF Data Manager dmd daemon checks a source data file when it attempts to create a symbolic link from the staging area to the input data file.
1. Permissions: the dmd daemon uses root user to check the input file. If a file is only accessible by the data request user, but not accessible by root, dmd deems the file inaccessible, and therefore, triggers a transfer job instead of creating the symbolic link. However, it is the data request user who runs jobs that requires access to the file, not root. This fix allows the data request user, rather than root, to check if the file is accessible to create the symbolic link. 2. File contents: you can have a local file with the same name as the input data file, but different contents. This fix allows dmd to compare the files and if the checksum (from bsub, if LSF_DATA_BSUB_CHKSUBM=Y is configured) is the same, it creates the symbolic link. If different, it triggers a transfer job to copy the file to the staging area instead. |
|
P104519 |
2022/1/5 |
Fix to ensure that LSF Data Manager copies the latest contents in a folder to the destination host, when the folder content is updated. |
|
2968 |
2023/4/21 |
Changed the default values for the LSF_DATA_SCP_CMD and LSF_DATA_SSH_CMD parameters as follows:
LSF_DATA_SSH_CMD="ssh -q -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o PasswordAuthentication=no -o BatchMode=yes"
Previously, the LSF_DATA_SCP_CMD and LSF_DATA_SSH_CMD parameters affected job transfer scripts. As of Fix Pack 14, these parameters no longer affect job transfer scripts; they affect the bstage command when the staging area is not mounted on the execution host of the user's job instead. For an LSF administrator to change how job transfer scripts use scp or ssh, they must modify the job transfer scripts directly. |
In addition to addressing fixes for found issues, LSF Data Manager Version 10.1 Fix Pack 14 offers a new solution:
|
ID |
Fixed Date |
Description |
|
P104730 |
8/16/2022 |
LSF Data Manager now supports cross-cluster user account mapping for a multicluster environment, allowing cross-cluster job submission and execution for a multicluster environment which has different user accounts assigned to different hosts. |
Readme file for: IBM® Spectrum LSF Data Manager
Product/Component Release: 10.1
Update Name: Fix 601546
Fix ID: lsf-dm-10.1.0.14-spk-2023-Apr-build601546
Publication date: 9 June 2023
Contents:
1. List of fixes
2. Download location
3. Products or components affected
4. System requirements
5. Installation and configuration
6. List of files
7. Product notifications
8. Copyright and trademark information
1. List of fixes
P104852, P104797, P103996, P104519, 2968, P104730
2. Download location
Download Fix 601546 from the following location: http://www.ibm.com/eserver/support/fixes/
3. Products or components affected
Components affected by the new
issues addressed in LSF Data Manager Version 10.1 Fix Pack 14 include:
Data
Manager/bdata
Data
Manager/bstage
Data
Manager/dmd
Data
Manager/dm.def.h
Data
Manager/libdas.a
Data
Manager/dm_stagein_helper.sh
Data
Manager/dm_stagein_transfer.sh
Data
Manager/dm_stageout_transfer.sh
4. System requirements
linux2.6-glibc2.3-x86_64
linux3.10-glibc2.17-x86_64
linux3.10-glibc2.17-ppc64le
linux3.12-glibc2.17-armv8
5. Installation and configuration
5.1 Before you install
The prerequisite for applying this fix is that IBM Spectrum LSF 10.1 Fix Pack 14 is installed. Download LSF 10.1 Fix Pack 14 from http://www.ibm.com/eserver/support/fixes/. Search for build601547.
LSF_TOP is the full path to the top-level installation directory of LSF.
1) Log in to the LSF management host as the LSF primary administrator
2) Set your environment:
- For csh or tcsh: % source LSF_TOP/conf/cshrc.lsf
- For sh, ksh, or bash: $ . LSF_TOP/conf/profile.lsf
3) Shut down the LSF Data Manager daemon by running the
following commands:
lsadmin
limshutdown data_manager_hosts
bdata
admin shutdown
5.2 Installation steps
1) Log in to the LSF management host as root and set your environment:
- For csh or tcsh: % source LSF_TOP/conf/cshrc.lsf
- For sh, ksh, or bash: $ . LSF_TOP/conf/profile.lsf
2) Go to the fix install directory: cd $LSF_ENVDIR/../10.1/install/
3) Copy the LSF Data Manager 10.1 Fix Pack 14 fix file to the $LSF_ENVDIR/../10.1/install/ installation directory.
4) Run patchinstall: ./patchinstall <LSF Data Manager 10.1 Fix Pack 14> to install Fix Pack 14.
5.3 After installation
1) Start the LSF Data Manager daemon by running the
following command:
lsadmin
limstartup data_manager_hosts
5.4 Uninstallation
To roll back a fix:
1) Log in to the LSF management host as the LSF primary administrator and set your environment:
- For csh or tcsh: % source LSF_TOP/conf/cshrc.lsf
- For sh, ksh, or bash: $ . LSF_TOP/conf/profile.lsf
2) Shut down the LSF Data Manager daemon by running the
following commands:
lsadmin
limshutdown data_manager_hosts
bdata
admin shutdown
3) Log in to the LSF management host as root and set your environment:
- For csh or tcsh: % source LSF_TOP/conf/cshrc.lsf
- For sh, ksh, or bash: $ . LSF_TOP/conf/profile.lsf
4) Run ./patchinstall -r <LSF Data Manager 10.1 Fix Pack 14> to uninstall Fix Pack 14.
5) Start the LSF Data Manager daemon by running the
following command:
lsadmin
limstartup data_manager_hosts
6. List of files in package
filelist.txt
fixlist.txt
bdata
bstage
dmd
libdas.a
dm_stagein_helper.sh
dm_stagein_transfer.sh
dm_stageout_transfer.sh
dm.def.h
7. Product notifications
To receive information about product solution and patch updates automatically, subscribe to product notifications on the My notifications page (www.ibm.com/support/mynotifications) on the IBM Support website (support.ibm.com). You can edit your subscription settings to choose the types of information you want to get notification about, for example, security bulletins, fixes, troubleshooting, and product enhancements or documentation changes.
8. Copyright and trademark information
© Copyright IBM Corporation 2023
U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
IBM®, the IBM logo and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.