Readme for Jupyter 5.0.0 for IBM Spectrum Conductor with Spark 2.2.1

Readme file for: IBM Spectrum Conductor with Spark
Product/Component Release: 2.2.1
Update Name: Jupyter 5.0.0 notebook packages
Fix ID: cws-2.2.1-build476107
Publication Date: Dec 8, 2017

Contents

1. About the Jupyter 5.0.0 notebook packages
2. Installation and configuration
3. Copyright and trademark information

1. About the Jupyter 5.0.0 notebook packages

This update provides the Jupyter 5.0.0 notebook packages for IBM Spectrum Conductor with Spark v2.2.1.
There are four Jupyter 5.0.0 notebook packages available, supporting Linux 64-bit and Linux on POWER 64-bit LE with Python 2 and Python 3.

The JupyterPython3 and JupyterPowerPython3 packages support the Spark versions that are shipped with IBM Conductor with Spark 2.2.1. This includes Spark 1.6.1, Spark 2.1.1, and Spark 2.2.0. The JupyterPython3 and JupyterPowerPython3 notebook packages are installed with IBM Conductor with Spark 2.2.1. If you have removed the notebook package and want to add them back again, download the package and add it to your cluster using the cluster management console.

The JupyterPython2 and JupyterPowerPython2 packages support all Spark versions that are supported in IBM Conductor with Spark 2.2.1. This includes Spark 1.5.2, Spark 1.6.1, Spark 2.0.1, Spark 2.1.0, Spark 2.1.1, and Spark 2.2.0. To use Jupyter with Python 2, download the JupyterPython2 and JupyterPowerPython2 notebook packages and add them to your cluster using the cluster management console.

2. Installation and Configuration

System Requirements

Linux 64-bit or Linux on POWER 64-bit LE

Installation

Before you begin, IBM Spectrum Conductor with Spark v2.2.1 must be installed on a supported operating system. For more details, see https://www.ibm.com/support/knowledgecenter/SSZU2E_2.2.1/installing/install_upgrade.html.

1. Download the notebook package to a local directory on your computer:


2. Launch a browser and log in to the cluster management console as a cluster administrator.

3. Add the notebook package to your cluster:

            a. Click Workload > Spark > Notebook Management.

            b. Click Add.

            c. On the Deployment Settings tab, enter the required fields as follows:

·         Name: Name of the notebook that you are adding, for example JupyterPython3.

·         Version: 5.0.0

·         Package: Click Browse and select the notebook package that you downloaded previously.

·         Select the following check boxes:

o    Enable collaboration for the notebook

o    Enable SSL support

·         Start command: ./scripts/start_jupyter.sh

·         Stop command: ./scripts/stop_jupyter.sh

·         Job monitor command: ./scripts/jobMonitor.sh

            d. Click Add.

4. Create a new Spark instance group and select the Jupyter notebook that you added. Edit the notebook configuration to specify a base data directory for the notebook, as well as any other required changes. When choosing a resource group for the notebook, ensure that the resource group selected contains hosts with the correct architecture for the selected notebook. For example, the resource group selected for a JupyterPython3 notebook should contain only Linux 64-bit hosts, and the resource group selected for a JupyterPowerPython3 notebook should contain only Linux on POWER 64-bit LE hosts.
For more information, see https://www.ibm.com/support/knowledgecenter/SSZU2E_2.2.1/developing_instances/instance_create_about.html

5. Create Jupyter notebooks for users. For more information see https://www.ibm.com/support/knowledgecenter/SSZU2E_2.2.1/managing_instances/mapping_notebooks.html

6. Launch the Jupyter notebook. For more information see https://www.ibm.com/support/knowledgecenter/SSZU2E_2.2.1/managing_applications/notebooks_launching.html

3. Copyright and Trademark information

© Copyright IBM Corporation 2017

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM®, the IBM logo, and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml