Readme file for IBM^® Spectrum Conductor with Spark 2.2 Interim Fix 534089  

Readme file for: IBM Spectrum Conductor with Spark
Product/Component Release: 2.2.0
Fix ID: cws-2.2-build534089

Publication date: November 14, 2019

When the Spark application batch master loses its connection to the VEMKD, the batch master starts on a new host in IBM Spectrum Conductor with Spark 2.2. However, Spark jobs cannot be started, with the following warning logged to the new batch master log: WARN ResourceCallbackManager: Cannot find callback for alloc. This interim fix provides a resolution for this issue.

Contents

1.      Download location 

2.      Products or components affected

3.      Installation and configuration

4.    Uninstallation 

5.      List of files

6.      Product notifications 

7.      Copyright and trademark information

1.    Download location

Download interim fix 534089 from the following location: http://www.ibm.com/eserver/support/fixes/.

2.    Products or components affected

Component name, Platform, Fix ID:

Spark version 2.1.0 and 2.1.1, Linux x86_64 or Linux ppc64le, cws-2.2-build534089

3.    Installation and configuration

Follow the instructions in this section to download and install this interim fix on Linux hosts in your cluster.

a.      On your client host, unzip the cws-2.2.0.0_build534089.tgz package, for example:

> mkdir -p /tmp/fix534089

> tar zoxf cws-2.2.0.0_build534089.tgz -C /tmp/fix534089

b.      Launch your web browser and clear the browser cache.

c.      Navigate to the cluster management console and log in as an administrator.

d.      Remove the Spark x.x.x package if it exists.

a)     Click Workload > Spark > Version Management.

b)     Select x.x.x.

c)      Click Remove.

e.      Add the Spark x.x.x package to your cluster.

a)     Click Workload > Spark > Version Management.

b)     Click Add.

c)      Click Browse and select the /tmp/fix534089/Sparkx.x.x-Conductor2.2.0.tgz file.

d)     Click Add.

f.        Create a new Spark instance group that uses the new Spark version x.x.x package. For details, see https://www.ibm.com/support/knowledgecenter/SSZU2E_2.2.0/developing_instances/instance_create_about.html.

g.      If required, upgrade your existing Spark instance groups to use the new Spark version x.x.x package. For details, see https://www.ibm.com/support/knowledgecenter/SSZU2E_2.2.0/managing_instances/instance_update_spark_version.html.

4.    Uninstallation

If required, follow the instructions in this section to uninstall this interim fix on Linux hosts in your cluster.

a.      Launch your web browser and clear the browser cache.

b.      Navigate to the cluster management console and log in as an administrator.

c.      Remove the Spark x.x.x package:

a)     Click Workload > Spark > Version Management.

b)     Select x.x.x.

c)      Click Remove.

d.      Log in to Fix Central, then download and extract the original Spark version package (Sparkx.x.x-Conductor2.2.0.tgz).

e.      Add the original Spark x.x.x package to your cluster:

a)     Click Workload > Spark > Version Management.

b)     Click Add.

c)      Click Browse and select the /tmp/fix534089/Sparkx.x.x-Conductor2.2.0.tgz file.

d)     Click Add.

f.        Create a new Spark instance group that uses the original Spark version x.x.x package. For details, see https://www.ibm.com/support/knowledgecenter/SSZU2E_2.2.0/developing_instances/instance_create_about.html.

5.    List of files

Spark2.1.0-Conductor2.2.0.tgz

Spark2.1.1-Conductor2.2.0.tgz

6.    Product notifications

To receive information about product solution and patch updates automatically, subscribe to product notifications on the My Notifications page http://www.ibm.com/support/mynotifications/ on the IBM Support website (http://support.ibm.com). You can edit your subscription settings to choose the types of information you want to get notification about, for example, security bulletins, fixes, troubleshooting, and product enhancements or documentation changes. 

7.    Copyright and trademark information 

© Copyright IBM Corporation 2019

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM®, the IBM logo and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml