Readme file for IBM® Spectrum Conductor 2.4.1 Interim Fix 550382

Readme file for: IBM Spectrum Conductor
Product/Component release: 2.4.1
Update name: Interim Fix 550382
Fix ID: sc-2.4.1-build550382

Publication date: July 9, 2020


This interim fix resolves two issues:

·       Applications hang after submission, when using the --conf spark.scheduler.mode=FAIR option. No tasks are running in the application.

·       The maxNumConcurrentTasks() function in sparkContext always returns zero, causing the joblib or joblibspark to not run Spark jobs.
 

Contents

1.     List of fixes

2.     Download location

3.     Products or components affected

4.     Installation and configuration

5.     List of files

6.     Product notifications

7.     Copyright and trademark information

1.   List of fixes

APAR: P103696

2.   Download location

Download interim fix 550382 from the following location: http://www.ibm.com/eserver/support/fixes/.

3.   Products or components affected

Component name, Platform, Fix ID:                                                   

Spark 2.4.3, linux-x86_64 or linux-ppc64le, sc-2.4.1-build550382

4.   Installation and configuration

1.     Download the sc-2.4.1.0_build550382.tgz package to a local directory on your computer. Decompress the file. Once decompressed, you will have the following Spark package:

Spark2.4.3-Conductor2.4.1.tgz

2.     Launch a browser and log in to the cluster management console as a cluster administrator.

3.     Remove the existing Spark 2.4.3 package from the cluster:

a.     Click Resources > Frameworks > Spark Management.

b.     Select version 2.4.3.

c.     Click Remove.

d.     In the confirmation dialog, click Remove.

4.     Add the new Spark 2.4.3 package to the cluster:

a.     Click Resources > Frameworks > Spark Management.

b.     Click Add.

c.     Click Browse and select the Spark2.4.3-Conductor2.4.1.tgz package downloaded previously.

d.     Click Add.

5.   List of files

Spark2.4.3-Conductor2.4.1.tgz

6.   Product notifications

To receive information about product solution and patch updates automatically, subscribe to product notifications on the My Notifications page http://www.ibm.com/support/mynotifications/ on the IBM Support website (http://support.ibm.com). You can edit your subscription settings to choose the types of information you want to get notification about, for example, security bulletins, fixes, troubleshooting, and product enhancements or documentation changes.

7.   Copyright and trademark information

© Copyright IBM Corporation 2020

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM®, the IBM logo and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml