Readme file for IBM® Spectrum LSF 10.1 Fix 601992

Abstract

P105114. This fix supports defining the THREADLIMIT value at the queue and application levels according to number of tasks for each job.

Description

Readme documentation for IBM Spectrum LSF 10.1 Fix 601992 including installation-related instructions, prerequisites and co-requisites, and list of fixes.

This fix addresses the following issue:

LSF supports configuring the THREADLIMIT value at the queue and application levels for all jobs that belong to corresponding queues and applications. In this fix, LSF allows you to configure the THREADLIMIT value at the queue and application leveld based on each job’s number of tasks.

 

This fix introduces new parameter for the lsb.queues and lsb.applications configuration files:

 

THREADLIMIT_PER_TASK  

 

Syntax 

THREADLIMIT_PER_TASK = number_of_threads

 

Description 

A job’s thread limit value limits the number of concurrent threads that can be part of job and is defined in the THREADLIMIT parameter. Exceeding the limit causes the job to terminate. The limit must be a positive integer.

 

Using the THREADLIMIT_PER_TASK parameter to calculate a job’s thread limit value allows you to use a more refined thread limit based on the number of tasks for the job. When specified, LSF calculates a job’s thread limit by taking the THREADLIMIT_PER_TASK value and multiplying it by the number of tasks for the job. This way, the job’s thread limit is not a fixed value for the entire job queue. 

 

The THREADLIMIT_PER_TASK parameter is only used to calculate job’s thread limit, and will not limit the number of threads for each task.

 

The THREADLIMIT_PER_TASK parameter cannot be configured together with the THREADLIMIT parameter for the same queue or application. If you specify both values, only the THREADLIMIT_PER_TASK value will be used and the THREADLIMIT value will be ignored. 

 

Note the following rules for thread limit values when using the THREADLIMIT_PER_TASK parameter:

·       The job and application level THREADLIMIT value cannot exceed the THREADLIMIT_PER_TASK value multiplied by the number of tasks for the job. 

·       The application level THREADLIMIT_PER_TASK value cannot exceed the queue level THREADLIMIT_PER_TASK value. 

·       The application level THREADLIMIT_PER_TASK value cannot exceed the queue level THREADLIMIT value. 

 

Tip for resizable jobs: when jobs are running, LSF uses the current number of tasks multiplied by the THREADLIMIT_PER_TASK value. For jobs submitted but not yet running, LSF uses the MAX value multiplied by the THREADLIMIT_PER_TASK value to calculate the job’s thread limit value and merge job, application, and queue level thread limit.

 

Example

THREADLIMIT_PER_TASK=10 

 

Default 

Undefined.

 

 

Readme file for: IBM® Spectrum LSF

Product or component release: 10.1

Update name: Fix 601992

Fix ID: LSF-10.1-build601992

Publication date: 16 May 2024

 

Contents

1. List of fixes

2. Download location

3. Product or components affected

4. System requirements

5. Installation and configuration

6. List of files

7. Product notifications

8. Copyright and trademark information

 

1. List of fixes

P105114.

 

2. Download locations

Download Fix 601992 from the following location: https://www.ibm.com/support/fixcentral

 

3. Product or components affected

Affected product or components include:

LSF/mbatchd

LSF/mbschd

LSF/ebrokerd

LSF/bjobs

LSF/bhosts

LSF/bqueues

LSF/bapp

LSF/bresize

LSF/res

LSF/sbatchd

LSF/lsf.h

LSF/lsbatch.h

LSF/ liblsbstream.so

LSF/liblsbstream.a

LSF/libbat.so

LSF/libbat.a

LSF/liblsf.so

LSF/liblsf.a

 

4. System requirements

linux2.6-glibc2.3-x86_64

linux3.10-glibc2.17-x86_64

 

5. Installation and configuration

Before you install

LSF_TOP is the full path to the top-level installation directory of IBM Spectrum LSF.

1.      Before you apply this fix, ensure that you install LSF 10.1 Fix Pack 12 or later. You can download Fix Pack 12 from https://www.ibm.com/support/fixcentral. Search for build600488. Contact IBM LSF Support if you have any questions or problems with installing Fix Pack 12.

2.      Starting from LSF 10.1 Fix Pack 13, the default values of the following three GPU parameters are changed to:
LSF_GPU_AUTOCONFIG=Y
LSB_GPU_NEW_SYNTAX=extend
LSF_GPU_RESOURCE_IGNORE=Y

If you have installed Fix Pack 13, no further action is needed to set these parameters. If you have installed LSF Fix Pack 12 or earlier, consider explicitly configuring the same values to these three parameters:
LSF_GPU_AUTOCONFIG=N
LSB_GPU_NEW_SYNTAX=N
LSF_GPU_RESOURCE_IGNORE=N

 

Installation steps

1.      Log on to the LSF management host as the LSF cluster primary administrator and set your environment:
-For csh or tcsh: % source LSF_TOP/conf/cshrc.lsf

-For sh, ksh, or bash: $ . LSF_TOP/conf/profile.lsf

2.      Run badmin hclose all

3.    Run badmin qinact all

4.      Log on to the LSF management host as the root user and set your environment:
-For csh or tcsh: % source LSF_TOP/conf/cshrc.lsf

-For sh, ksh, or bash: $ . LSF_TOP/conf/profile.lsf

5.      Go to the install directory: cd $LSF_ENVDIR/../10.1/install/

6.      Copy the fix file to the install directory: $LSF_ENVDIR/../10.1/install/

7.      Run patchinstall: ./patchinstall <fix>

 

After you install

1.      Log on to the LSF management host as the LSF cluster primary administrator and set your environment:
-For csh or tcsh: % source LSF_TOP/conf/cshrc.lsf

-For sh, ksh, or bash: $ . LSF_TOP/conf/profile.lsf

2.    Run badmin hrestart all

3.    Run lsadmin resrestart all

4.    Run badmin mbdrestart

5.      Run badmin hopen all

6.    Run badmin qact all

 

Uninstallation

1.      Log on to the LSF management host as the LSF cluster primary administrator and set your environment:
-For csh or tcsh: % source LSF_TOP/conf/cshrc.lsf
-For sh, ksh, or bash: $ . LSF_TOP/conf/profile.lsf

2.      Run badmin hclose all

3.    Run badmin qinact all

4.      Log on to the LSF management host as the root user and set your environment:

-For csh or tcsh: % source LSF_TOP/conf/cshrc.lsf

-For sh, ksh, or bash: $ . LSF_TOP/conf/profile.lsf

5.      Go to the install directory: cd $LSF_ENVDIR/../10.1/install/

6.      Run ./patchinstall -r <fix>

7.      Log on to the LSF management host as the LSF cluster primary administrator and set your environment:
-For csh or tcsh: % source LSF_TOP/conf/cshrc.lsf
-For sh, ksh, or bash: $ . LSF_TOP/conf/profile.lsf

8.    Run badmin hrestart all

9.    Run lsadmin resrestart all

10.    Run badmin mbdrestart

11.      Run badmin hopen all

12.    Run badmin qact all

 

 

6. List of files

The following components in all Linux packages:

LSF/mbatchd

LSF/mbschd

LSF/ebrokerd

LSF/bjobs

LSF/bhosts

LSF/bqueues

LSF/bapp

LSF/bresize

LSF/res

LSF/sbatchd

LSF/lsf.h

LSF/lsbatch.h

LSF/ liblsbstream.so

LSF/liblsbstream.a

LSF/libbat.so

LSF/libbat.a

LSF/liblsf.so

LSF/liblsf.a

 

7. Product notifications

To receive information about product solution and fix updates automatically, subscribe to product notifications on the My notifications page (www.ibm.com/support/mynotifications) on the IBM Support website (support.ibm.com). You can edit your subscription settings to choose the types of information you want to get notification about, for example, security bulletins, fixes, troubleshooting, and product enhancements or documentation changes. 

8. Copyright and Trademark Information

©Copyright IBM Corporation 2024

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM®, the IBM logo, and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.