Readme for IBM® Spectrum Conductor with Spark 2.1 Fix Pack 1 Interim Fix 489527 

Readme file for: IBM Spectrum Conductor with Spark

Product/Component Release: 2.1.0.1

Update Name: Interim Fix 489527

Fix ID: cws-2.1.0.1-build489527

Publication date: Apr 28, 2018

 

Abstract

Environment variable SPARK_EXECUTOR_MEMORY overrides spark.executor.memory.

Description

This interim fix resolves the issue about environment variable SPARK_EXECUTOR_MEMORY overrides spark.executor.memory for an IBM Spectrum Conductor with Spark v2.1 Fix Pack 1 Spark instance group that uses Spark version 1.6.1.

 

Contents

1.      List of fixes

2.      Download location

3.      Products or components affected

4.      Installation and configuration

5.      List of files

6.      Copyright and trademark information

 

1.        List of fixes

APAR: P102555

2.        Download location

Download Fix 489527 from the following location: http://www.ibm.com/eserver/support/fixes/

3.        Products or components affected 

·       IBM Spectrum Conductor with Spark v2.1 Fix Pack 1

·       Spark version 1.6.1

·       Linux 64-bit

·       cws-2.1.0.1-build489527

4.        Installation and configuration

System requirements

·       Linux x86_64

Before installation

·       IBM Spectrum Conductor with Spark v2.1 Fix Pack 1 must be installed on a supported operating system. For details, see 

https://www.ibm.com/support/knowledgecenter/SSZU2E_2.1.0/installing/install_roadmap_s.html. 

Installation

1.     On the client machine where you have a browser, decompress the conductorspark2.1.0.1_x86_64_build489527.tgz package. For example, on Linux:

> mkdir -p /tmp/fix489527

> tar zoxf conductorspark2.1.0.1_x86_64_build489527.tgz -C /tmp/fix489527

2.     Launch the browser and clear the browser cache; then, log in to the cluster management console as Admin.

3.     Remove the Spark 1.6.1 package if it exists.

a.     Click Workload > Spark > Version Management.

b.     Select 1.6.1.

c.     Click Remove.

4.     Add the Spark 1.6.1 package to your cluster.

a.     Click Workload > Spark > Version Management.

b.     Click Add.

c.     Click Browse and select the /tmp/fix489527/Spark1.6.1-Conductor2.1.0.tgz.

5.     Click Add.

After installation

1.     Create a new Spark instance group that uses the new Spark version 1.6.1 package. For details, see 

https://www.ibm.com/support/knowledgecenter/SSZU2E_2.1.0/developing_instances/developing_instances.html.

2.     If required, upgrade your existing Spark instance groups to use the new Spark version 1.6.1 package. For details, see 

https://www.ibm.com/support/knowledgecenter/SSZU2E_2.1.0/managing_instances/instance_update_spark_version.html.

 

5.        List of files 

·       Spark1.6.1-Conductor2.1.0.tgz

6.        Copyright and trademark information

© Copyright IBM Corporation 2018

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM®, the IBM logo and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml