Readme File for IBM® Spectrum Conductor 2.4.1 Interim Fix 553223

Readme File for: IBM Spectrum Conductor

Product Release: 2.4.1

Update Name: Interim Fix 553223

Fix ID: sc-2.4.1-build553223-boa

Publication Date: July 17, 2020

 

This interim fix allows the SparkCleanup service to clean up files in Spark’s event log directories.

Contents

1. List of fixes

2. Download location

3. Product and components affected

4. Installation

5. Uninstallation

6. List of files

7. Product notifications

8. Copyright and trademark information

 

1.     List of fixes

RFE 143906 – Duplicate Spark’s cleanup functionality for eventLog directories inside the cleanup script.

2.     Download location

Download interim fix 553223 from the following location: https://www.ibm.com/eserver/support/fixes/

3.     Product and components affected

Component name, Platform, Fix ID:

conductorsparkcore, Linux x86_64, sc-2.4.1-build553223

4.     Installation

Follow the instructions in this section to download and install this interim fix to your cluster.

System requirements

Linux x86_64

Installation

a)       Log on to the primary host as the cluster administrator and stop the SparkCleanup service:

> egosh user logon -u Admin -x Admin

> egosh service stop SparkCleanup

b)       On each of your hosts, download the following package to, for example, a /scfixes directory:
conductorsparkcore-2.4.1.0_x86_64_build553223.tar.gz

c)       On each of your hosts, run the egoinstallfixes command to install the downloaded package:

> egoinstallfixes /scfixes/conductorsparkcore-2.4.1.0_x86_64_build553223.tar.gz

Note: Running the egoinstallfixes command automatically backs up the current binary files to a fix backup directory for recovery purposes. Do not delete this backup directory; you will need it if you want to recover the original files. For more information on using this command, see the egoinstallfixes command reference.

d)       On each of your hosts, run the pversions command to verify the installation:

> pversions -b 553223

e)    Add the following environment variables to the SparkCleanup service profile:

1.      From the cluster management console, navigate to System & Services > EGO Services > Service Profiles > Other Services.

2.      Click SparkCleanup to open its service prolife.

3.      Navigate to the ego:ActivitySpecification section of the service profile, and from the Actions list, select Insert “ego:EnvironmentVariable”.

4.      Add these new environment variables:

    Name: EVENT_LOG_CLEANUP

    Value: true|false

    Description: Use this environment variable to enable or disable SparkCleanup from cleaning up Spark’s spark.eventLog.dir event log.

    Name: EVENT_LOG_RETENTION_IN_MINS

    Value: Any positive integer

    Description: Use this environment variable to specify the time, in minutes, that the SparkCleanup service will use to determine if a complete file is old enough to be deleted.

    Name: EVENT_LOG_INCOMPLETE_RETENTION_IN_MINS

    Value: Any positive integer

    Description: Optionally use this environment variable to specify the time, in minutes, that the SparkCleanup service will use to determine if an incomplete file is old enough to be deleted. This may be useful, for example, if Spark crashes and an *.inprogress file is left over in the event log directory.

g)   From the primary host, start the SparkCleanup service:

> egosh service start SparkCleanup

5.     Uninstallation

If required, follow the instructions in this section to uninstall this interim fix from your cluster.

a)       Log on to the primary host as the cluster administrator and stop the SparkCleanup service:

> egosh user logon -u Admin -x Admin

> egosh service stop SparkCleanup

b)       On each host, roll back this interim fix:

> egoinstallfixes -r 553223

c)    Edit the SparkCleanup service profile to remove the following environment variables:

    EVENT_LOG_CLEANUP

    EVENT_LOG_RETENTION_IN_MINS

    EVENT_LOG_INCOMPLETE_RETENTION_IN_MINS

e)    From the primary host, start the SparkCleanup service:

> egosh service start SparkCleanup

6.     List of files

$EGO_TOP/conductorspark/2.4.1/etc/cleanup.py

7.     Product notifications

To receive information about product solution and patch updates automatically, subscribe to product notifications on the My Notifications page http://www.ibm.com/support/mynotifications/ on the IBM Support website (http://support.ibm.com). You can edit your subscription settings to choose the types of information you want to get notification about, for example, security bulletins, fixes, troubleshooting, and product enhancements or documentation changes. 

8.     Copyright and trademark information

© Copyright IBM Corporation 2020

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM®, the IBM logo, and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.