IBM Spectrum Computing Suite for High Performance Analytics (HPA) V10.2.0 Fix Pack 8

 

Abstract

This release includes features and enhancements since the release of IBM Spectrum Computing Suite for HPA V10.2.0.0 on May 31, 2019. 

Description

Readme documentation for IBM Spectrum Computing Suite for HPA V10.2 Fix Pack 8 including installation-related instructions, prerequisites and co-requisites, and list of fixes.

Readme file for: IBM® Spectrum Computing Suite for HPA

Product/Component Release: 10.2 Fix Pack 8
Update Name: Fix 522098
Fix ID: Suite-10.2 Fix Pack 8-build
Publication date: 16 July 2019
Last modified date: 16 July 2019 

Contents

  1. What's new
  2. System requirements
  3. Known issues
  4. Product notifications
  5. Download location
  6. Backing up Elasticsearch when upgrading from Suite for HPA 10.2.0
  7. Installation and configuration
  8. Restoring the Elasticsearch data
  9. Uninstallation
  10. Copyright and trademark information

 

1.    What’s New

IBM Spectrum Computing Suite for HPA 10.2 Fix Pack 8 contains the following components:

·         LSF 10.1 Fix Pack 8

·         LSF Application Center 10.2 Fix Pack 8

·         LSF Explorer 10.2 Fix Pack 8

·         LSF Data Manager 10.1 Fix Pack 7

·         LSF Process Manager 10.2 Fix Pack 8

 

The following enhancements or fixes have been made to the Suite installation and life-cycle management functions:

·      201351      LSF beat installation failed when cannot reach Elasticsearch

 

2.     System requirements

Refer to IBM Spectrum Computing Suite for High Performance Analytics System Requirements

 

3.     Known issues

Refer to IBM Spectrum Computing Suite for High Performance Analytics Release Notes

 

4.    Product notifications: 

To receive information about product solution and patch updates automatically, subscribe to product notifications on the My notifications page http://www.ibm.com/support/mynotifications/ on the IBM Support website (http://support.ibm.com). You can edit your subscription settings to choose the types of information you want to get notification about, for example, security bulletins, fixes, troubleshooting, and product enhancements or documentation changes. 

 

5.    Download location

Download from the following location: https://www.ibm.com/support/fixcentral

 

 

6.    Backing up Elasticsearch when upgrading from Suite for HPA 10.2.0

Spectrum Computing Suite for HPA 10.2 Fix Pack 8 bundles Elasticsearch 6.6.1 when installing using the Suite installation method. It will upgrade Elasticsearch and perform a reindexing of the current indices.

It is strongly recommended to perform a data backup before proceeding.

Refer to https://www.elastic.co/guide/en/elasticsearch/reference/6.6/modules-snapshots.html for more details.

Note:  ES_PORT by default is 9200


a.  Repeat the following two steps on each GUI_ROLE machine:
1. Log in to every GUI_Role machine as root.
2. Configure the Elasticsearch snapshot repository.


A. If there is only one GUI_ROLE machine, put the repository on a local disk.
       - Change the following in /opt/ibm/elastic/elasticsearch/config/elasticsearch.yml:
       - Change path.repo: "/opt/ibm/elastic/elasticsearch_repo" to /opt/ibm/elastic/elasticsearch/config/elasticsearch.yml
       - Create a directory /opt/ibm/elastic/elasticsearch_repo with write and execute permission for lsfadmin

B. If there are multiple GUI_ROLE machines, the repository MUST be on a shared file system (NFS) that all GUI_ROLE machines can access.
- On each GUI_ROLE machine, define the same shared location.
- Create a directory [share_dir]/elasticsearch_repo with the write and execute permission for lsfadmin, eg. /mnt/elasticsearch_repo
       - Change the following in /opt/ibm/elastic/elasticsearch/config/elasticsearch.yml:
       - Change path.repo: “/mnt/elastic/elasticsearch_repo" to /opt/ibm/elastic/elasticsearch/config/elasticsearch.yml

b.  Restart Elasticsearch to make the change to take effect on each GUI_ROLE machine:
For example: systemctl restart elasticsearch-for-lsf.service

c.  Create the snapshot:
1. Stop the following services on each GUI_HOST machine:
       - perfadmin stop all
       - pmcadmin stop
       - systemctl stop logstash-for-lsf.service

2. Create repository location: es_backup in Elasticsearch:
       - Log in to a GUI_ROLE machine
       - Enter the following command at a command prompt:
       - curl -XPUT "[GUI_ROLE machine IP]:ES_PORT/_snapshot/es_backup" -H 'Content-Type: application/json' -d '{"type": "fs","settings": {"location": "es_backup_location","include_global_state": true,"compress": true}}'

3. Create a snapshot: es_snapshot
       - curl -XPOST [GUI_ROLE machine IP]:ES_PORT/_snapshot/es_backup/data_backup?wait_for_completion=true -H 'Content-Type: application/json' -d '{ "indices": "lsf*,mo*,ibm*", "ignore_unavailable": true, "include_global_state": false }'

4. Check the status of the snapshot:
       - curl -XGET [GUI_ROLE machine IP]:ES_PORT/_snapshot/es_backup/data_backup?pretty

 

 

7.    Installation and Configuration 

a.  Download the Suite installer (.bin file) from Fix Central

b.  Run the downloaded Suite installer (.bin file).

c.  Deploy the updated Suite installation by running the following command:
       ansible-playbook -i lsf-inventory lsf-upgrade.yml

 

8.    Restoring the Elasticsearch data

a.  To restore the data, follow the steps below:
- Stop perf on all gui_role machine: perfadmin stop all
- Stop PMC on all gui_role machine: pmcadmin stop
- Stop Logstash on all gui_role: systemctl stop logstash-for-lsf.service

b.  To restore a index, delete the index you want to restore first by doing the following to delete the data:
- curl -XDELETE [GUI_ROLE machine IP]:ES_PORT/[index_name]
- curl -X POST "[GUI_ROLE machine IP]:ES_PORT/_snapshot/es_backup/data_backup/_restore" -H 'Content-Type: application/json' -d' { "indices": "index_name*", "ignore_unavailable": true, "include_global_state": true }'
       eg. To restore lsf_events* indices
       - curl -XDELETE [GUI_ROLE machine IP]:ES_PORT/lsf_events*
       - curl -X POST "[GUI_ROLE machine IP]:ES_PORT/_snapshot/es_backup/data_backup/_restore" -H 'Content-Type: application/json' -d' { "indices": "lsf_events*", "ignore_unavailable": true, "include_global_state": true }'

c.  Restart all services:
       - perfadmin start all
       - pmcadmin start
       - systemctl start logstash-for-lsf.service

d.  Clean up the browser data before login to gui

9.    Uninstallation 

a.  Uninstall the Suite for HPA by running the following command on the host used to install Suite for HPA:
       ansible-playbook -i lsf-inventory lsf-uninstall.yml

 

10.    Copyright and trademark information 

©Copyright IBM Corporation 2019

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM®, the IBM logo and ibm.com® are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml