Readme file for: IBM® FileNet® P8 Content Search Services
Update name: 5.2.0.4-P8CSS
Fix ID: 5.2.0.4-P8CSS-FP004
Publication date: 31 August 2015
Last modified date: 31 August 2015
This fix pack requires:
This interim fix updates the whitney_core.jar file.
For example:
Following are some known problems and restrictions that are related to this fix pack:
Complete the following tasks to prepare the Content Search Services server for this fix pack.
Click the following link to access the files for this fix pack server update: Fix Central for Fix Pack 5.2.0.4-P8CSS-FP004. Download this fix pack to a temporary directory on your server.
The following table lists the names of the compressed fix pack server update files by operating system type:
Operating system type |
Name of compressed Content Search Services fix pack server update file |
|---|---|
AIX® |
5.2.0.4-P8CSS-AIX-FP004.tar.gz |
Linux® |
5.2.0.4-P8CSS-LINUX64-FP004.tar.gz |
Solaris |
5.2.0.4-P8CSS-SOLARIS-FP004.tar.gz |
Windows® |
5.2.0.4-P8CSS-WIN64-FP004.zip |
zLinux |
5.2.0.4-P8CSS-ZLINUX-FP004.tar.gz |
You can install the server updates either interactively or silently. This section consists of the following steps:
Complete the following procedure to install the Content Search Services server updates interactively.
Operating system |
Executable file name for the Content Search Services server update |
|---|---|
| AIX |
5.2.0.4-P8CSS-AIX.BIN |
| Linux |
5.2.0.4-P8CSS-LINUX64.BIN |
| Solaris |
5.2.0.4-P8CSS-SOLARIS.BIN |
| Windows |
5.2.0.4-P8CSS-WIN64.EXE |
| zLinux |
5.2.0.4-P8CSS-ZLINUX.BIN |
Complete the following procedure to install the Content Search Services server updates silently.
Operating system |
Command to install the Content Search Services server update |
|---|---|
| AIX |
5.2.0.4-P8CSS-AIX.BIN -i silent -f css_silent_install.txt |
| Linux |
5.2.0.4-P8CSS-LINUX64.BIN -i silent -f css_silent_install.txt
|
| Solaris |
5.2.0.4-P8CSS-SOLARIS.BIN -i silent -f css_silent_install.txt |
| Windows |
5.2.0.4-P8CSS-WIN64.EXE -i silent -f css_silent_install.txt
TIP You can use the Windows Task Manager to monitor completion of this fix pack server update installation on Windows based systems. |
| zLinux |
5.2.0.4-P8CSS-ZLINUX.BIN -i silent -f css_silent_install.txt |
Installation errors are recorded in the css_install_log_5.2.0.4.txt file, which is in the Content Search Services installation directory, normally under C:\Program Files\IBM\Content Search Services.
Windows 64 bit
Start the Content Search Services Windows service, or run the script:
css_install_location\server_name\bin\startup.bat
AIX, Linux, Solaris (all supported versions)
Run the script:
/css_install_location/server_name/bin/startup.sh
You can add the following parameters to the configuration.exm file to override the default values shown. In most cases, the default values are best. However, if customer support personnel ask you to change a value, you can do so by modifying the configuration.xml file. If the parameters are not added to the configuration.xml file, the default values apply.
Important You can change the settings of these parameters at any time after you finish installing this fix pack. However, you must stop Content Search Services before you change the settings, and you must restart Content Search Services server after your changes are complete.
This setting determines whether ECMTS should remove stop words from boolean queries.
For example, assuming that the word "the" is a stop word, and given the search phrase: the AND dog
If the value of removeStopwordsFromBooleanQuery is true, ECMTS will remove the stopword "the" and process the query as "dog".
In this case, all documents containing the word "dog" will be returned.
If the value of removeStopwordsFromBooleanQuery is false, ECMTS will NOT remove the stopword "the".
In this case, only documents that contain both the word "the" and the word "dog" will be returned.
This configuration property is designed to reduce memory consumption of each collection that is open for searching to allow higher values to be set for <numberOfSearchables> in cases where a high number (50+) of collections are being searched.
Default: 25To reduce memory consumption of each collection searched, use the following configTool command. For example:
./configTool.sh set -system -termInfosIndexDivisorCollectionSizeGB 13
Turns the indexingTrace on (true) and off (false).
Default: falseSets the frequency (in milliseconds) for checking whether the index has changed and the search must be reopened due to changes to the collection as a result of added / deleted documents.
Default: 60000 (1 minute)NOTE:
To ignore this setting for a specific query, add this line to your client code:
query.setQueryProperty(InyoConstants.PARAM_AVOID_INDEX_REFRESH_INTERVAL, "true");This doesn't affect the system setting, but tells the server to check (for individual queries) to see whether a refresh is necessary (and if so, forces one) regardless of the searchableRefreshRateMS setting.
Sets the "whitelist" of folders under which collections can be created.
Default: * (All folders)Sets the amount of space in memory that is allocated to the query cache.
Default: 200Sets the amount of time in minutes after which a warning is written to the log if the overall number of indexed documents has not increased when there are documents in the system waiting to be indexed.
Default: 15Turns the "indexing strategy" feature on (true) / off (false).
Default: trueWhen the "indexing strategy" feature is turned on, sets the amount of time in milliseconds to keep a collection open if there are documents in the input queue waiting to be indexed into that collection.
Default: 300000 (5 minutes)Turns the query cache functionality on (true) / off (false).
Default: trueSets the directory mapping method to use for searching - Simple, MMap or NIOFS When not specified, the default for each operating system is used. This replaces the setting useMMapDirectoryForSearch.
Default: not specifiedNote: The defaults per operating system are:
This fix pack changes the configuration parameter values from prior releases
Windows 64 bit
Start the Content Search Services Windows service, or run the script:
css_install_location\server_name\bin\startup.bat
AIX, Linux, Solaris (all supported versions)
Run the script:
/css_install_location/server_name/bin/startup.sh
This fix pack does not have an uninstall option. The install creates a backup which can be manually restored.
To manually restore to the previous version of Content Search Services:
Select which backup_directory ( _backup_####_####_##-##_##_## folder, where ####_####_##-##_##_## reflects the build, date, and time of the backup) you would like to restore.
(For example: /opt/IBM/ContentSearchServices/CSS_Server/_backup_3740_2014-01-13_16_30)
Select which backup_directory ( _backup_####_####_##-##_##_## folder, where ####_####_##-##_##_## reflects the build, date, and time of the backup) you would like to restore.
(For example: C:\Program Files\IBM\Content Search Services\CSS Server\_backup_3740_2014-01-13_16_30)
The following tables list the product fixes that are contained in this fix pack update.
| APAR |
Description |
|---|---|
PJ43151 |
Content Search Servcies (CSS) Text Extraction of Xerox OCR'd PDF files is removing necessary whitespace from extracted text |
PJ43160 |
Content Search Services (CSS) Indexing and Searching using NetApp device, the collectionConfiguration.xml is being overwritten with an empty file |
PJ43185 |
PSIRT 3149 (CVE-2015-0493, CVE-2015-0474) : Oracle Outside In Technology (OIT) April 2015 Critical Patch Advisory Update. See Security Bulletin 1883962 |
PJ43342 |
PSIRT 3328 (CVE-2014-4244, CVE-2014-4263, CVE-2014-3068) JRE "Logjam" Security vulnerabilities in IBM Java SDK. See Security Bulletin 1960191 |
| APAR |
Description |
|---|---|
PJ43199 |
PSIRT 3141: (CVE-2015-0488, CVE-2015-0478, CVE-2015-1916): Update the IBM private JRE of the Process Engine server to version 1.6 SR16 FP4 in response to a Java April 2015 security issues. See Security Bulletin 1883959 |
PJ43342 |
PSIRT 3328 (CVE-2014-4244, CVE-2014-4263, CVE-2014-3068): "Logjam" Java Technology Edition security vulnerability. See techdoc 1960191 |
| APAR |
Description |
|---|---|
PJ43169 |
PSIRT 3058 (CVE-2015-2808) RC4 Bar Mitzvah SSL/TLS - Vulnerability in RC4 stream cipher. See techdoc 1701597 |
| APAR |
Description |
|---|---|
PJ42998 |
PSIRT 2696 (CVE-2014-6593, CVE-2015-0410, CVE-2015-0393): IBM SDK Java Technology Edition Critical Patch Update - January 2015. See techdoc 1697152 |
PJ43079 |
PSIRT 2913 (CVE-2015-0138): IBM SDK Java Technology Edition Critical Patch Update - March 2015. See techdoc 1699589 |
| APAR |
Description |
|---|---|
PJ42607 |
Searching while Indexing is taking place on the same collection produces IOExceptions when collections are stored on NFS |
PJ42643 |
Content Based Retrieval (CBR) Summary feature producing invalid characters when iWorks file version/format is unrecognized by Outside In Technology (OIT) Filters. |
PJ42693 |
PSIRT 2290 (CVE-2014-3566): IBM SDK Java Technology Edition Quarterly November 2014 update. See techdoc 1688638 |
PJ42775 |
Indexing Document level errors for unsupported file types should be moved to a separate log file. |
PJ42783 |
New Message Type to IMessage interface for constructor use when an email format is determined to be unrecognized. |
PJ42914 |
Malformed XML receives NullPointerException when indexed in multi-language environment. |
| APAR |
Description |
|---|---|
PJ42527 |
PSIRT 1929 (CVE-2014-4263): IBM SDK Java Technology Edition Quarterly July 2014 update. See techdoc 1683298 |
PJ42782 |
Content Search Services installer missing correct FileNet Content Manager (FNCM) or IBM Content Manager (ICM) license. |
| APAR |
Description |
|---|---|
PJ41876 |
Content Search Services (CSS) indexing Stopwords not working correctly. |
PJ41982 |
PSIRT 1422: Oracle OIT 8.4.1 Security Patch p17733168. See techdoc, 1672337 |
PJ42175 |
Content Search Services (CSS) indexing first document in batch is not indexing added fields. |
PJ42241 |
Content Search Services (CSS) incorrectly indexing email attachments. |
PJ42358 |
PSIRT 1732: IBM SDK Java Technology Edition Quarterly April 2014 update. See techdoc, 1674132 |
| APAR |
Description |
|---|---|
PJ42142 |
Content Search Services (CSS) server resource leak and out of memory error. See flash alert 1667922 |
PJ42151 |
Content Search Services (CSS) Index corruption with Lucene 3.6. |
| APAR |
Description |
|---|---|
PJ41197 |
Content Search Services (CSS) indexing search performance improvements: optimization for search and configuration of searchable refresh rate. |
PJ41201 |
On the Content Search Services server (CSS), certain zip files cause long text extraction times |
PJ41371 |
Content Search Services (CSS) indexing text extractor fails on supported file types and consume memory on Solaris, AIX and Linux |
PJ41382 |
Occasionally Content Search Services (CSS) indexing might experience a large delay in the indexing performance on NAS devices. |
PJ41473 |
Content Search Services (CSS) indexing text filters do not use the configured TEMP folder. |
PJ41697 |
Content Search Services (CSS) indexing Windows service status does not reflect the real status of the CSS server when the java.exe process crashed |
PJ41698 |
Oracle Outside In Technology (OIT) upgrade from 8.4.0 to 8.4.1 |
PJ41722 |
IBM Content Collector searches (ICC) and IBM eDiscovery Manager (eDM) Content Search Services (CSS) indexing compliance searches might not return correct results for documents that contain a certain combination of Japanese characters. |
PJ41741 |
Content Search Services (CSS) indexing periodically slows down |
PJ41746 |
Oracle Outside In Technology (OIT) 8.4.1 Security Patch p_17459777 |
PJ41875 |
Content Search Services (CSS) allows SYNONYMs in boolean searches. No synonym expansion occurs for Boolean queries and Negated queries. Synonym expansion is done for exact match terms that appear inside an OR query. XML contains queries with an inner negative query are not handled correctly |
PJ41937 |
Content Search Services (CSS) indexing does not resume indexing after storage recovers from an out of disk space |
PJ41945 |
The current Content Search Services (CSS) indexing Secure Sockets Layer (SSL) implementation with self-signed or 3rd party CA certificate conflicts with the default trust store (and other trust stores) |
PJ41946 |
Content Search Services (CSS) indexing Secure Sockets Layer (SSL) implementation requires password JVM parameter for the trust store, which is a security issue |
PJ41947 |
Content Search Services (CSS) indexing java process will not stop after authentication token change |
PJ41948 |
Content Search Services (CSS) indexing with IBM Content Collector (ICC) received non-descriptive "G0020E.EXTERNAL_ERROR_MESSAGE" warning with no instruction for end users to take action |
PJ41949 |
Content Search Services (CSS) index job indicated that it terminated normally but no documents were reindexed successfully when using IBM Content Collector (ICC) |
PJ41950 |
Content Search Services (CSS) indexing changing authentication token with generateToken should prompt to restart CSS |
PJ42048 |
PSIRT 1455: Update the version of Java running on the Content Search Services (CSS) servers to 1.6.0 SR15 FP1. Resolves JVM problems with IBM Content Collector (ICC) Constructor. See techdoc 1665444 |
| APAR |
Description |
|---|---|
PJ41746 |
PSIRT 1267: Oracle OIT 8.4.1 Security Patch p_17459777. See techdoc 1660219 |
PJ41818 |
PSIRT 1285: Upgrade the JDK 1.6.0 to SR 15. See techdoc 1640073 |
| APAR |
Description |
|---|---|
PJ41174 |
Content Search Services IBM eDiscovery Manager searches are not returning back the expected results. |
NA |
IBM Content Collector non-exact match searches and IBM eDiscovery Manager compliance searches might not return correct results for documents that contain a certain combination of Japanese characters. |
| APAR |
Description |
|---|---|
PJ41131 |
Content Search Services communication sockets to Content Engine are not being closed when a read or timeout exceptions occur. |
PJ41161 |
Add configurable parameters to reduce Content Search Services search and indexing memory consumption. |
NA |
Enhancement: Add checking and logging to detect index corruption. |
NA |
Enhancement: Add an option to enable logging during index write operations in Content Search Services. |
NA |
After installing Content Search Services as a service, two executables (EcmtsService and EcmtsWinService) exist. |
NA |
PrE Retain build version and server configuration information appears in the Content Search Services rollover logs. |
NA |
Apply OIT patch p14660529_837 for bookmarks issues with spacing. |
NA |
Searchable object for collection cannot be loaded in concurrent indexing and search test. |
NA |
Errors occur during task execution. The task was not fully received. |
NA |
The Temp folder is not completely cleared when text extractor is terminated. |
NA |
An exact search on the Chinese dot character fails when the index language is English. |
This information was developed for products and services offered in the U.S.A.
IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service.
IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not grant you any license to these patents. You can send license inquiries, in writing, to:
IBM Director of Licensing IBM Corporation J74/G4
555 Bailey Avenue San Jose, CA 95141 U.S.A.
For license inquiries regarding double-byte (DBCS) information, contact the IBM Intellectual Property Department in your country or send inquiries, in writing, to:
Intellectual Property Licensing Legal and Intellectual Property Law IBM Japan, Ltd. 19-21, Nihonbashi-Hakozakicho, Chuo-ku Tokyo 103-8510, Japan
The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.
This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.
Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk.
IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.
Licensees of this program who wish to have information about it for the purpose of enabling: (i) the exchange of information between independently created programs and other programs (including this one) and (ii) the mutual use of the information which has been exchanged, should contact:
IBM Corporation J46A/G4 555 Bailey Avenue San Jose, CA 95141-1003 U.S.A.
Such information may be available, subject to appropriate terms and conditions, including in some cases, payment of a fee.
The licensed program described in this document and all licensed material available for it are provided by IBM under terms of the IBM Customer Agreement, IBM International Program License Agreement or any equivalent agreement between us.
Any performance data contained herein was determined in a controlled environment. Therefore, the results obtained in other operating environments may vary significantly. Some measurements may have been made on development-level systems and there is no guarantee that these measurements will be the same on generally available systems. Furthermore, some measurements may have been estimated through extrapolation. Actual results may vary. Users of this document should verify the applicable data for their specific environment.
Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
All statements regarding IBM's future direction or intent are subject to change or withdrawal without notice, and represent goals and objectives only.
This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental.
COPYRIGHT LICENSE:
This information contains sample application programs in source language, which illustrate programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs. The sample programs are provided "AS IS", without warranty of any kind. IBM shall not be liable for any damages arising out of your use of the sample programs.
IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.
Other product and service names might be trademarks of IBM or other companies.
| Date |
Description |
|---|---|
31 August 2015 |
Initial release of this fix pack. |