Readme file for IBM® Spectrum
LSF 10.1 Fix 601258
Abstract
P104730. The fix enhances LSF and LSF Data Manager to support user mapping in a multicluster environment.
Description
Readme documentation for IBM® Spectrum LSF 10.1 Fix 601258 including installation-related instructions, prerequisites and co-requisites, and list of fixes.
This fix addresses the following issue:
LSF and LSF
Data Manager did not support jobs with a data requirement that is forwarded
from one cluster to another when user mapping between the two clusters was
involved. Now user mapping is supported. Enhancement ensures that transfer
jobs are run as the mapped user, and that the transfer jobs are aware of the
submission user, which allows them to access the specified data. See the
following scenario example:
· Two LSF clusters lsfcluster1 and lsfcluster2
· LSF multicluster is set up so that jobs from cluster1 are forwarded to cluster2
· user1 exists in lsfcluster1, but not in lsfcluster2
· user2 exists in lsfcluster2
· Jobs that are submitted by user1 in lsfcluster1 are forwarded to lsfcluster2
· Configure user mapping so that jobs from user1 are run as user2 in lsfcluster2
· lsfcluster1 defined in lsb.users configuration file:
Begin UserMap
LOCAL REMOTE DIRECTION
user1 user2@lsfcluster2 export
End UserMap
· lsfcluster2 defined in lsb.users configuration file:
Begin UserMap
LOCAL REMOTE DIRECTION
user2 user1@lsfcluster1 import
End UserMap· When the mbatchd in lsfcluster2 receive the forwarded data job from lsfcluster1 (from user1) it reports a data requirement to the LSF data manager daemon (dmd), reporting the mapped user (that is user2).
· If the mbatchd in lsfcluster2 receives a request for a transfer job, the owner of the transfer job is the mapped user (that is user2).
· The original submission user (that is user1) is promoted to the transfer job by way of environment variable.
· The transfer job accesses the files or folders that are specified in the data requirement as the original submission user through ssh and scp.
· A requirement that the ssh keys of user1 be copied to user2 so that passwordless ssh and scp is possible.
Readme file for: IBM® Spectrum LSF
Product or component release: 10.1
Update name: Fix 601258
Fix ID: LSF-10.1-build601258
Publication date: 11 August 2022
Contents
1. List of fixes
2. Download location
3. Product or components affected
4. System requirements
5. Installation and configuration
6. List of files
7. Product notifications
8. Copyright and trademark information
1. List of fixes
P104730
2. Download locations
Download fix 601258 from the following location: https://www.ibm.com/support/fixcentral
3. Product or components affected
Affected product or components include:
LSF/mbatchd
LSF/mbschd
DM/dm_stagein_transfer.sh
DM/dm_stageout_transfer.sh
4. System requirements
linux2.6-glibc2.3-x86_64
linux3.10-glibc2.17-x86_64
5. Installation and configuration
Before you install
(LSF_TOP=Full path to the top-level installation directory of LSF.)
1. You must have LSF 10.1 Fix Pack 12 or above installed before installing this fix. Download this fix pack from IBM Fix Central (https://www.ibm.com/support/fixcentral) and search for build600488 (Fix Pack 12) or build601088 (Fix Pack 13).
2. You must have LSF Data Manager 10.1 Fix Pack 12 installed before installing this fix. Download this fix pack from IBM Fix Central (https://www.ibm.com/support/fixcentral) and search for build600489.
3. Starting in IBM Spectrum LSF Version 10.1 Fix Pack 13, the default values of the following three GPU parameters are changed to:
LSF_GPU_AUTOCONFIG=Y
LSB_GPU_NEW_SYNTAX=extend
LSF_GPU_RESOURCE_IGNORE=Y
If you have fix pack 13 installed, no further action is needed to set these parameters. If you have IBM Spectrum LSF Version 10.1 Fix Pack 12 or earlier, consider explicitly configuring the same values to these three parameters.
If you want to keep the former GPU behavior, and any one of the three parameters are missing in the lsf.conf configuration file, you must explicitly configure the following default settings that are defined in fix pack 12 or earlier:
LSF_GPU_AUTOCONFIG=N
LSB_GPU_NEW_SYNTAX=N
LSF_GPU_RESOURCE_IGNORE=N4. Log on to the LSF management host as root.
5. Set the LSF cluster environment:
- For csh or tcsh: % source LSF_TOP/conf/cshrc.lsf
- For sh, ksh, or bash: $ . LSF_TOP/conf/profile.lsf
Installation steps
1. Go to the install directory of the fix: cd $LSF_ENVDIR/../10.1/install/
2. Copy the fix file to the install directory: $LSF_ENVDIR/../10.1/install/
3. Run patchinstall: ./patchinstall <fix>
After you install
1. Log on to the LSF management host as the LSF cluster primary administrator and set the LSF cluster environment.
2. Run badmin mbdrestart
Uninstallation
1. Log on to the LSF management host as root and set the LSF cluster environment.
2. Go to the install directory of the fix: cd $LSF_ENVDIR/../10.1/install/
3. Run ./patchinstall -r <fix>
4. Log on to the LSF management host as the LSF cluster primary administrator and set the LSF cluster environment.
5. Run badmin mbdrestart
6. List of files
mbatchd
mbschd
dm_stagein_transfer.sh
dm_stageout_transfer.sh
7. Product notifications
To receive information about product solution and fix updates automatically, subscribe to product notifications on the My notifications page (www.ibm.com/support/mynotifications) on the IBM Support website (support.ibm.com). You can edit your subscription settings to choose the types of information you want to get notification about, for example, security bulletins, fixes, troubleshooting, and product enhancements or documentation changes.
8. Copyright and Trademark Information
©Copyright IBM Corporation 2022
U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
IBM®, the IBM logo, and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.