Readme File for IBM® Spectrum Conductor 2.4.1 RFE 148093
Readme File for: IBM Spectrum Conductor
Product Release: 2.4.1
Fix ID: sc-2.4.1-build600132-boa
Publication Date: February 2, 2021
This enhancement allows the SparkCleanup service to enable cleanup file retention values to be overridden for an instance group.
Contents
1. Download location
2. Product and components affected
3. Installation and configuration
4. Uninstallation
5. List of files
6. Product notifications
7. Copyright and trademark information
1. Download location
Download enhancement 600132 from the following location: https://www.ibm.com/eserver/support/fixes/
2. Product and components affected
Component name, Platform, Fix ID:
conductorspark_core, Linux x86_64, sc-2.4.1-build600132-boa
3. Installation and configuration
Follow the instructions in this section to download and install this enhancement to your cluster.
System requirements
Linux x86_64
Installation
a) Log on to the primary host as the cluster administrator and stop the SparkCleanup service:
> egosh user logon -u Admin -x Admin
> egosh service stop SparkCleanup
b) On
each of your management hosts, download and extract the following package
to, for example, a /scfixes directory:
conductorsparkcore-2.4.1.0_x86_64_build600132.tar.gz
c) On each of your hosts, run the egoinstallfixes command to install the downloaded package:
> egoinstallfixes /scfixes/conductorsparkcore-2.4.1.0_x86_64_build600132.tar.gz
Note: Running the egoinstallfixes command automatically backs up the current binary files to a fix backup directory for recovery purposes. Do not delete this backup directory; you will need it if you want to recover the original files. For more information on using this command, see the egoinstallfixes command reference.
d) On each of your hosts, run the pversions command to verify the installation:
> pversions -b 600132
e) From the primary host, start the SparkCleanup service:
> egosh service start SparkCleanup
Configuration
a) When registering or modifying instance groups with Spark:
1. From the cluster management console, click Workload > Instance Groups to view a list of existing instance groups, select the instance group to work with, and click Configure.
2. In the Basic Settings tab, click Configuration to configure Spark.
3. From the All Parameters list, select Additional Environment Variables > Add An Environment Variable.
4. Add any of the following environment variables that the SparkCleanup service will read to use as override values for this instance group:
i) LOCAL_DIR_RETENTION_IN_MINS
ii) SERVICE_LOG_RETENTION_IN_MINS
iii) EVENT_LOG_RETENTION_IN_MINS
iv) EVENT_LOG_INCOMPLETE_RETENTION_IN_MINS
Examples of retention value priority using LOCAL_DIR_RETENTION_IN_MINS. Other retention values are prioritized similarly.
|
Case |
USE_SPARK_INSTANCE_GROUP_FILE_RETENTION_VALUES=false |
USE_SPARK_INSTANCE_GROUP_FILE_RETENTION_VALUES=true |
|
Highest Priority | | |
If LOCAL_DIR_RETENTION_IN_MINS is defined in the SparkCleanup service profile configuration, then this value overrides FILE_RETENTION_IN_MINS defined in the SparkCleanup service profile configuration. |
If LOCAL_DIR_RETENTION_IN_MINS is defined in the Spark configuration of instance group (refer to the instructions above), then this value overrides the LOCAL_DIR_RETENTION_IN_MINS defined in the SparkCleanup service profile configuration for that particular instance group. |
|
| | |
FILE_RETENTION_IN_MINS default setting in the SparkCleanup service profile. |
If LOCAL_DIR_RETENTION_IN_MINS is defined in the SparkCleanup service profile configuration, then this value overrides the Monitoring TTL value defined in the instance group. |
|
Lowest Priority |
|
Monitoring TTL defined in the instance group. |
4. Uninstallation
If required, follow the instructions in this section to uninstall this enhancement from your cluster.
a) Log on to the primary host as the cluster administrator and stop the SparkCleanup service:
> egosh user logon -u Admin -x Admin
> egosh service stop SparkCleanup
b) On each host, roll back this enhancement:
> egoinstallfixes -r 600132
c) From the primary host, start the SparkCleanup service:
> egosh service start SparkCleanup
5. List of files
$EGO_TOP/conductorspark/2.4.1/etc/cleanup.py
6. Product notifications
To receive information about product solution and patch updates automatically, subscribe to product notifications on the My Notifications page http://www.ibm.com/support/mynotifications/ on the IBM Support website (http://support.ibm.com). You can edit your subscription settings to choose the types of information you want to get notification about, for example, security bulletins, fixes, troubleshooting, and product enhancements or documentation changes.
7. Copyright and trademark information
© Copyright IBM Corporation 2021
U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
IBM®, the IBM logo, and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.