IBM Platform Symphony 6.1.1 Interim Fix 356027 Readme File

IBM Platform Symphony 7.1.1 Interim Fix 403868 Readme File

Abstract

MapReduce service logs should automatically rotate.

Description

The MapReduce service logs use a lot of space on each data node, and must be deleted manually daily. This fix allows you to configure the MapReduce service logs to auto-rotate.

This fix applies to IBM® InfoSphere BigInsights 4.1.0.2 Linux 64-bit.

Readme file for: IBM Platform Symphony

Product/Component Release: 7.1.1

Update Name: Interim Fix 403868

Fix ID: sym-7.1.1-build403868-iop

Publication date: 18 May 2016

Last modified date: 18 May 2016

Contents:

1. List of fixes

2. Download location

3. Products or components affected

4. Installation and configuration

5. List of files

6. Copyright and trademark information

1. List of fixes

APAR P101702

2. Download location

Download Fix 403868 from the following location: http://www.ibm.com/eserver/support/fixes/

3. Products or components affected

Product/Component Name:

Platform Symphony/MapReduce

4. Installation and configuration

4.1 Before installation

1. Log on to the symphony master host as the cluster administrator and disable all applications:

> source $EGO_TOP/cshrc.platform

> egosh user logon -u Admin -x Admin

> soamcontrol app disable all

2. Stop all services except Symphony from the Ambari GUI.

3. Back up files.

Log on to every management and compute host in the cluster and back up the following files that will be replaced by this fix to other directory:

> $PMR_HOME/integration/IBM_BigInsights_4.1/hadoop-mapreduce-client-core-plus-HDP2.3_2.7.1.jar

> $PMR_HOME/7.1.1/linux-x86_64/lib/hadoop-2.7.x/hadoop-mapreduce-client-core-2.7.1.jar

4.2 Installation steps

1. Log on to every management and compute host in the cluster and decompress the pssasetup2015_linux-x86_64_build403868.tar.gz package:

> tar zxfo pssasetup2015_linux-x86_64_build403868.tar.gz -C $PMR_HOME

2. Log on to every management and compute host in the cluster and do one of the following operations:

a) If normal user is in the same group with Symphony cluster administrator, normal user can run jobs.

b) Else, change the $PMR_HOME/logs directory permission to 777 to allow any user to run jobs.

4.3 After installation

1. After deploying the package, perform the Symphony integration from the Ambari GUI.

2. Restart Symphony from the Ambari GUI.

3. Start all services from the Ambari GUI.

4. Log on to each host as root and add two parameters to the log4j.properties file, located in /etc/hadoop/conf folder:

log4j.appender.pmr.service.MaxFileSize=10000KB

log4j.appender.pmr.service.MaxBackupIndex=10

where:

MaxFileSize: The output file is allowed to be rolled over to backup files when file size is larger than this maximum size value. MapReduce service logs auto-rotate feature will enable if this option being set correctly.
The MaxFileSize option takes a long integer in the range 0 - 2^63. You can specify the value with the suffixes "KB", "MB" or "GB" so that the integer is interpreted being expressed respectively in kilobytes, megabytes or gigabytes. For example, the value "10KB" will be interpreted as 10240.

MaxBackupIndex: the maximum number of backup files to keep around, the MaxBackupIndex option determines how many backup files are kept before the oldest is erased. This option takes a positive integer value. If set to zero, then there will be no backup files and the log file will be truncated when it reaches MaxFileSize.

There is one backup file by default.

Note:

The above two configuration parameters must be set after starting the cluster; otherwise, they will be removed if they are set before starting IBM Open Platform (IOP).

5. Log on to the master host as the cluster administrator and enable application:

> source $EGO_TOP/cshrc.platform

> egosh user logon -u Admin -x Admin

> soamcontrol app enable <AppName>

4.4 Uninstallation

1. Log on to the symphony master host as the cluster administrator and disable all applications:

> source $EGO_TOP/cshrc.platform

> egosh user logon -u Admin -x Admin

> soamcontrol app disable all

2. Stop all services except Symphony from the Ambari GUI.

3. Restore the backup files.

Log on to every management and compute host in the cluster and restore the backup files:

> $PMR_HOME/integration/IBM_BigInsights_4.1/hadoop-mapreduce-client-core-plus-HDP2.3_2.7.1.jar

> $PMR_HOME/7.1.1/linux-x86_64/lib/hadoop-2.7.x/hadoop-mapreduce-client-core-2.7.1.jar

4. Perform the Symphony integration from the Ambari GUI.

5. Restart Symphony from the Ambari GUI.

6. Start all services from the Ambari GUI.

7. Log on to the master host as the cluster administrator and enable application:

> source $EGO_TOP/cshrc.platform

> egosh user logon -u Admin -x Admin

> soamcontrol app enable <AppName>

5. List of files

hadoop-mapreduce-client-core-plus-HDP2.3_2.7.1.jar

hadoop-mapreduce-client-core-2.7.1.jar

6. Copyright and trademark information

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM®, the IBM logo and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.