Readme file for IBM^® Spectrum Conductor 2.4.1 Interim Fix 600446

Readme file for: IBM Spectrum Conductor
Product/Component release: 2.4.1
Update name: Interim Fix 600446
Fix ID: sc-2.4.1-build600446-boa

Publication date: May 25, 2021

This interim fix provides an updated Spark package to addresses two issues using IBM Spectrum Conductor 2.4.1 with Spark:

1.    Delayed application status showing in the IBM Spectrum Conductor cluster management console and the REST API. This incorrect status shows for long periods (from 30 minutes to full days), before synchronizing.
2.    Spark jobs are stuck in WAITING state for long periods, the job will run into RUNNING state until another job is submitted to the Spark master.

Contents

1.     List of fixes

2.     Download location

3.     Product and components affected

4.     Installation and configuration

5.     List of files

6.     Product notifications

7.     Copyright and trademark information

1.   List of fixes

APAR: P104234

2.   Download location

Download interim fix 600446 from the following location: http://www.ibm.com/eserver/support/fixes/.

3.   Products or components affected

Component name, Platform, Fix ID:                                                   

Spark, linux-x86_64, sc-2.4.1-build600446-boa

4.   Installation and configuration

1.     Download the sc-2.4.1.0_build600446.tgz package to a local directory on your computer. Decompress the file. Once decompressed, you will have the following Spark packages:

Spark2.4.3-Conductor2.4.1.tgz

Spark3.0.1-Conductor2.4.1.tgz

2.     Launch a browser and log into the cluster management console as a cluster administrator.

3.     Remove the existing Spark package from the cluster. For example, to remove the existing Spark 2.4.3 package:

a.     Click Resources > Frameworks > Spark Management.

b.     Select version 2.4.3.

c.     Click Remove.

d.     In the confirmation dialog, click Remove.

4.     Add the new Spark package to the cluster. For example, to add the new Spark 2.4.3 package:

a.     Click Resources > Frameworks > Spark Management.

b.     Click Add.

c.     Click Browse and select the Spark2.4.3-Conductor2.4.1.tgz package downloaded previously.

d.     Click Add.

5.     Create a new Spark instance group that uses the new Spark 2.4.3 package. For details, see https://www.ibm.com/support/knowledgecenter/SSZU2E_2.4.1/developing_instances/instance_create_about.html.

 

6.     If required, upgrade your existing Spark instance groups to use the new Spark 2.4.3 package. For details, see https://www.ibm.com/support/knowledgecenter/SSZU2E_2.4.1/managing_instances/instance_update_spark_version.html.

5.   List of files

Spark2.4.3-Conductor2.4.1.tgz

Spark3.0.1-Conductor2.4.1.tgz

6.   Product notifications

To receive information about product solution and patch updates automatically, subscribe to product notifications on the My Notifications page http://www.ibm.com/support/mynotifications/ on the IBM Support website (http://support.ibm.com). You can edit your subscription settings to choose the types of information you want to get notification about, for example, security bulletins, fixes, troubleshooting, and product enhancements or documentation changes.

7.   Copyright and trademark information

© Copyright IBM Corporation 2021

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM®, the IBM logo and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml