Readme file for IBM^® Spectrum Conductor 2.4.1 RFE 146649

Readme file for: IBM Spectrum Conductor
Product/Component release: 2.4.1
Update name: RFE 146649
Fix ID: sc-2.4.1.0-build600097

Publication date: January 15, 2021

This enhancement provides the Spark 3.0.1 package for an IBM Spectrum Conductor 2.4.1 cluster.

 

Notes: Spark 3.0.1 with Jupyter notebooks does not support the R and Scala Spark cluster mode kernels. Support for this will become available when Jupyter Enterprise Gateway has a release supporting Spark 3.x with R and Scala.

 

 

Contents
1.     Download location 

2.     Products or components affected

3.     Installation and configuration

4.     List of files

5.     Product notifications 

6.     Copyright and trademark information

1.   Download location

Download RFE 146649 from the following location:http://www.ibm.com/eserver/support/fixes/.

2.   Products or components affected

Component name, Platform, Fix ID:                                                    

Spark 3.0.1, linux-x86_64 or linux-ppc64le, sc-2.4.1.0-build600097

 

3.   Installation and configuration

1.     Download the sc-2.4.1.0_build600097.tgz package to a local directory. Decompress the file. Once decompressed, you will have the following Spark package:

Spark3.0.1-Conductor2.4.1.tgz

2.     Launch a browser and log in to the cluster management console as a cluster administrator.

3.     Remove the existing Spark 3.0.1 package from the cluster if you have:

a.     Click Resources > Frameworks > Spark Management.

b.     Select version 3.0.1.

c.     Click Remove.

d.     In the confirmation dialog, click Remove.

4.     Add the new Spark 3.0.1 package to the cluster:

a.     Click Resources > Frameworks > Spark Management.

b.     Click Add.

c.     Click Browse and select the Spark3.0.1-Conductor2.4.1.tgz package downloaded previously.

d.     Click Add.

5.  Enable notebook to support Spark 3.0.1:

a.   Navigate to Resources > Frameworks > Notebook Management.

b.   Select the Jupyter 5.4.0 notebook and click Configure.

c.   Click the Environment Variables tab.

d.   Edit the value for supported_spark_versions to include 3.0.1.

e.   Click Update Notebook.

4.   List of files 

Spark3.0.1-Conductor2.4.1.tgz

5.   Product notifications

To receive information about product solution and patch updates automatically, subscribe to product notifications on the My Notifications page http://www.ibm.com/support/mynotifications/ on the IBM Support website (http://support.ibm.com). You can edit your subscription settings to choose the types of information you want to get notification about, for example, security bulletins, fixes, troubleshooting, and product enhancements or documentation changes. 

6.   Copyright and trademark information 

© Copyright IBM Corporation 2021

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM®, the IBM logo and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml