Readme file for IBM® Spectrum Conductor 2.4.1 Interim Fix 550022

Readme file for: IBM Spectrum Conductor
Product/Component release: 2.4.1
Update name: Interim Fix 550022
Fix ID: sc-2.4.1-build550022

Publication date: June 5, 2020

This interim fix resolves three issues:

1. The spark-submit command fails with error Launching Python applications through spark-submit is currently only supported for local when the –py-files option points to a URI which is not local.

2. Deployment errors when the instance group deployment directory already exists but is empty.

3. Deployment errors when a Spark driver or executor tries to start on a new host before deployment on the host.

Contents

1.      List of fixes

2.      Download location

3.      Products or components affected

4.      Installation and configuration

5.      List of files

6.      Product notifications

7.      Copyright and trademark information

1.    List of fixes

APAR: P103677

2.    Download location

Download interim fix 550022 from the following location: http://www.ibm.com/eserver/support/fixes/.

3.    Products or components affected

Component name, Platform, Fix ID:                                                  

Spark 2.4.3, linux-x86_64 or linux-ppc64le, sc-2.4.1-build550022

4.    Installation and configuration

1.      Download the sc-2.4.1.0_build550022.tgz package to a local directory on your computer. Decompress the file. Once decompressed, you will have the following Spark package:

Spark2.4.3-Conductor2.4.1.tgz

2.      Launch a browser and log in to the cluster management console as a cluster administrator.

3.      Remove the existing Spark 2.4.3 package from the cluster:

a.      Click Resources > Frameworks > Spark Management.

b.      Select version 2.4.3.

c.      Click Remove.

d.      In the confirmation dialog, click Remove.

4.      Add the new Spark 2.4.3 package to the cluster:

a.      Click Resources > Frameworks > Spark Management.

b.      Click Add.

c.      Click Browse and select the Spark2.4.3-Conductor2.4.1.tgz package downloaded previously.

d.      Click Add.

5.    List of files

Spark2.4.3-Conductor2.4.1.tgz

6.    Product notifications

To receive information about product solution and patch updates automatically, subscribe to product notifications on the My Notifications page http://www.ibm.com/support/mynotifications/ on the IBM Support website (http://support.ibm.com). You can edit your subscription settings to choose the types of information you want to get notification about, for example, security bulletins, fixes, troubleshooting, and product enhancements or documentation changes.

7.    Copyright and trademark information

© Copyright IBM Corporation 2020

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM®, the IBM logo and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml