IBM System Storage™ DS Storage Manager version 10.36.xx.13 for VMware ESX Server 3.0.2 and 3.5 Important: With the release of 07.36.08.00 and 07.36.12.00 controller firmware for the DS4000 and DS5000, customers are encountering a firmware bug that is causing the controllers to go into a continuous reboot cycle, which causes loss of access. There is no exposure to customers currently at 7.30.21.00, 7.15.07.00, 7.15.10.01, or 7.10.23.00. Customers who have downloaded the 07.36.08.00 or 07.36.12.00 levels of firmware, should not install this level of firmware. Customers who have installed this level of firmware should not make any configuration changes to the system and contact IBM Support immediately. For Customers who have downloaded the DS Storage Manager 10.36.65.07 code package, from the IBM Support web site, but have not yet installed firmware 7.36.08.00 or 7.36.12.00 , it is recommended that Storage Manager Firmware Upgrade Utility version 10.36.xx.07 or 10.36.xx.08 be uninstalled and version 10.36.xx.10 Firmware Upgrade Utility be installed and used to upgrade the controller firmware to 07.36.14.xx or higher. Note: VMware ESX Server 2.0 is supported by the DS4000 Storage Manager version 8.x only. In addition, VMware ESX Server 2.1 is supported by the DS4000 Storage Manager version 9.1 only. VMware ESX Server 2.1 is not supported with DS4000 storage subsystems having version 06.12.xx.xx and higher controller firmware. VMWare ESX Server host attachment to the DS4000/DS5000 storage subsystems requires the additional purchase of the IBM DS4000/DS5000 VMWare Host Kit Option or Feature Code. The IBM VMWare Host Kit Option contains the required IBM licensing to attach a VMWare ESX Server host to the DS4000/DS5000 storage subsystems. Please contact your IBM service representatives or IBM resellers for purchasing information. NOTE TO SERVICE – Reference RETAIN # N/A (C) Copyright International Business Machines Corporation 1999, 2008. All rights reserved. US Government Users Restricted Rights - Use, duplication, or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Note: Before using this information and the product it supports, read the general information in "Notices and trademarks” in this document. Important: DS4000 Storage Manager version 9.19.xx.12 and later is required for DS4000 storage subsystem users in countries implementing the new Daylight Saving Time (DST) rules (which includes U.S., Canada, Bermuda). Storage Manager version 9.19.xx.12 or later release includes revised DST transition dates to comply with provision of the Energy Policy Act of 2005 extension of Daylight Saving Time (DST) by four weeks, beginning in year 2007. Please refer to section 1.3 Enhancements for more information. There are not any IBM System Storage™ DS Storage Manager host software packages for the VMWare ESX server operating system environments. To manage the DS4000/DS5000 storage subsystems that are IO attached to your VMware ESX Server hosts, you must install the DS Storage Manager client software (SMclient) on a Windows or Linux management workstation. (This can be the same workstation that you use for the browser-based VMware Management Interface.) The SMclient program is included in the IBM System Storage™ DS Storage Manager version 10 for the 32 and 64 bit version of Linux operating systems or the IBM System Storage™ DS Storage Manager version 10 for Microsoft Windows operating systems host software packages. Refer to the IBM System Storage™ Support Web Site or CD for the IBM System Storage DS Storage Manager Version 10 Installation and Host Support Guide. This guide along with the DS Storage Manager program Online Help provide the installation and support information. Last Update: 04/01/2009 Products Supported ---------------------------------------------------------------- | New Model | Old Model | Machine Type | Model | |------------|-----------|--------------|------------------------| | DS5300 | N/A | 1818 | 53A | |------------|-----------|--------------|------------------------| | DS5100 | N/A | 1818 | 51A | |------------|-----------|--------------|------------------------| | DS4800 | N/A | 1815 | 82A, 82H, 84A, 84H, | | | | | 88A, 88H, 80A, 80H | |------------|-----------|--------------|------------------------| | DS4700 | N/A | 1814 | 70A, 70H, 72A, 72H, | | | | | 70T, 70S, 72T, 72S | |------------|-----------|--------------|------------------------| | DS4500 | FAStT 900 | 1742 | 90X, 90U | |------------|-----------|--------------|------------------------| | DS4400 | FAStT 700 | 1742 | 1RX, 1RU | |------------|-----------|--------------|------------------------| | DS4300 | FAStT 600 | 1722 | 6LX, 6LU, 6LJ, 60X | | | | | 60U, 60J, 60K, and 60L | |------------|-----------|--------------|------------------------| | DS4200 | N/A | 1814 | 7VA, 7VH | |----------- |-----------|--------------|------------------------| | DS4100 | FAStT 100 | 1724 | 100, 1SC | ----------- ---------------------------------------------------- IBM System Storage DS4000 Manager version 9.1x and later for VMware does not support the FAStT500 and FAStT200 machine types 3552 and 2542) with ESX Server 2.1 or ESX Server 2.5 or higher. Please refer to the latest storage inter operability matrix and ServerProven matrix at the following web sites: http://www-1.ibm.com/servers/storage/disk/ds4000/interop-matrix.html CONTENTS -------- 1.0 Overview 2.0 Installation and Setup Instructions 3.0 Helpful Configuration Tips 4.0 WEB Sites and Support Phone Number 5.0 Trademarks and Notices 6.0 Disclaimer ======================================================================== 1.0 Overview ------------------ 1.1 Overview ------------------- There are not any IBM System Storage™ DS Storage Manager host software packages for the VMWare ESX server operating system environment. To manage the DS4000/DS5000 storage subsystems that are IO attached to your VMware ESX Server hosts, you must install the DS Storage Manager client software (SMclient) on a Windows or Linux management workstation and manage the DS4000/DS5000 storage subsystem via out-of-band management method. (This can be the same workstation that you use for the browser- based VMware Management Interface.) The SMclient program is included in the IBM System Storage™ DS Storage Manager version 10.36 for the 32 and 64 bit version of Linux operating systems or the IBM System Storage™ DS Storage Manager version 10.36 for Microsoft Windows operating systems host software packages. The usage permission of the SMclient program in the IBM System Storage™ DS Storage Manager version 10.36 host software packages for Windows and Linux does not give the user the entitlement to the Windows or Linux host IO privileges. In those DS4000/DS5000 storage subsystems that require the Windows and Linux host entitlement kits/ options, these kits/options must be purchased before these servers can be IO attached to the DS4000/DS5000 storage subsystems. The IBM Storage Manager host software version 10.36 new features and changes are described in the corresponding Change History document. Please refer to this document for more information on new features and modifications. ======================================================================= 1.2 Limitations --------------- IMPORTANT: The listed limitations are cumulative. However, they are listed by DS4000/DS5000 storage subsystem controller firmware and Storage Manager host software releases to indicate which controller firmware and Storage Manager host software release that they were first seen and documented. New limitations with Storage Manager Installer (SMIA) package version 10.36.xx.13 release. 1. There is not an IBM System Storage™ DS Storage Manager host software packages for the VMWare ESX server operating system environments. To manage the DS4000/DS5000 storage subsystems that are IO attached to your VMware ESX Server hosts, you must install the DS Storage Manager client software (SMclient) on a Windows or Linux management workstation and manage the subsystem out-of-band. Please review the Operating System limitations specific to Windows and Linux. In addition, review the controller firmware readme for limitations specific to the storage subsystem. Limitations with Storage Manager Installer (SMIA) package version 10.30.xx.09 release. 1. There is not an IBM System Storage™ DS Storage Manager host software packages for the VMWare ESX server operating system environments. To manage the DS4000/DS5000 storage subsystems that are IO attached to your VMware ESX Server hosts, you must install the DS Storage Manager client software (SMclient) on a Windows or Linux management workstation and manage the subsystem out-of-band. Please review the Operating System limitations specific to Windows and Linux. In addition, review the controller firmware readme for limitations specific to the storage subsystem. 2. The DS5300 and DS5100 are supported on VMware ESX v3.5 only. Limitations with Storage Manager Installer (SMIA) package version 10.15.xx.08 release. 1. Reconfiguration operation (DRM) is delayed under some circumstances. When a drive fails before the DRM completes, it can take up to eight times as long for the DRM to complete. DRM reconfigurations to RAID 6 have the longest impact since there are four times as many calculations and writes that have to occur compared to other RAID levels. 2. Host Software display of controller current rate is wrong below 4Gbps. Host Software Client - AMW - Logical/Physical View - Controller Properties - Host Interfaces - Current rate is displaying "Not Available" when the controller negotiated speed is 2Gbps. When the controller negotiated speed is reduced to 1GBs, the Current rate displays "2Gbps" New limitations with Storage Manager Installer (SMIA) package version 10.10.xx.xx release (controller firmware 07.10.xx.xx). 1. Controller Alarm Bell icon does not appear as a flashing icon indicator on the screen to get the user's attention but the icon does change appearances. 2. Miswire of drive tray cabling with DS4700 and DS4200 can cause continuous reboot of a controller. To correct this situation, power down the subsytem, cable the drive trays correctly, and power the subsystem back up. 3. Controller button may appeared enabled and mislead the user that a controller is selected where in fact, a controller was not highlighted for the botton to appear ready. 4. Search key is not marked correctly in that page due a JavaHelp Bug with JavaHelp 2.0_01. A search for keyword "profile" ended with phase "prese 'nting p' rofile" being marked. 5. storageArrayProfile.txt should be renamed as storageSubsystemProfile.txt in Support Data. 6. Bullets Incorrectly Placed in Volume Modification Help Page 7. Unable to Escape out of Help Display. User will be required to close the window by using window close procedure (exit, etc.) 8. Bullets and Descriptions not alligned into same line in "Viewing mirror properties". 9. The Help window is not getting refreshed properly when using the AMW.Help window. Workaround is to close and reopen SANtricity. 10. CLI command failure for creation of volume(s) if capacity parameter syntax is not specified. A space will need to be used between the integer value and the units used in the capacity option of this command or, "create volume volumeGroup[4] capacity=15 GB…". 11. Customer will see high ITW counts displayed in GUI (RLS feature) and logs (files) for diagnostics (support bundle, DDC, etc.) and may be concerned that he has a problem. This will not cause a Critical MEL event. Known problem previously restricted, when a DS4700 or DS4200 controller reboots, these counters increment. 12. Single tray powercycle during IO activity causes drives in tray to become failed. Customer may see loss of drive (failed) due to timing issue of drive detection & spin-up of the drive. There are one of two conditions that result on power-up: - (Most likely) Drive will be marked as optimal/missing with the piece failed, or - (rarely) Drive will be marked as failed with the piece failed. Workaround is to unfail (revive) drive which restarts reconstruction of all pieces. 13. Event log critical Event 6402 was reported after creating 64 mirror relations. Eventually, the mirror state transitions to synchronizing and proceeds to completion on mirror creation. Workaround is to ignore the MEL logging since this occurs on creation of mirror volumes. 14. Reconfiguration operations during host IO may result in IO errors when arrays contain more than 32 LUNs. These operations include Dynamic Capacity Expansion, Defragmentation, Dynamic Volume Expansion, Dynamic RAID Migration. The workaround is to quiesce host IO activity during reconfiguration. 15. Heavy IO to a narrow volume group of SATA drives can result in host IO timeouts. A narrow volume group refers to an array built of very few drives; namely 1 drive RAID 0, 1x1 RAID 1, and 2 + 1 RAID 5. The workaround is to build arrays of SATA drives out of 4 + 1 or greater. 16. When managing the storage subsystem in-band, the upgrade utility will show the upgrade as failed. This is because of the update and reboot of the controllers when activating the new firmware. SMagent is not dynamic and will need to be restarted to reconnect to the storage subsystem. 17. Selecting and dragging text within the storage profile window causes the window to be continuously refreshed. Work around is to select and copy, do not drag the text. 18. When configuring alerts through the task assistant, the option stays open after selecting OK. The window only closes when the cancel button is selected. 19. The Performance Monitor displays error messages when the storage subsystem is experiencing exception conditions. The performance monitor has a lower execution priority within the controller firmware than responding to system IO and can experience internal timeouts under these conditions. 20. Critical MEL event (6402 - Data on mirrored pair unsynchronized) can occur under certain circumstances with synchronous RVM. The most likely scenario is when both primary and secondary are on a remote mirror and an error occurs with access to that host. Resynchronization should occur automatically, when automatic resynchronization is selected for a mirror relationship. However if any of the host sites should go down during this interval, recovery by the user is required. 21. A persistent miswire condition is erroneously reported through the recovery guru even though the subsystem is properly wired. The frequency of occurrence is low and is associated with an ESM firmware download or other reboot of the ESM. The ESM that is reporting the problem must be reseated to eliminate the false reporting. Not all miswire conditions are erroneous and must be evaluated to determine the nature of the error. 22. Drive path loss of redundancy has been reported during ESM download. This occurs when a drive port is bypassed. In some instances this is persistent until the drive is reconstructed. In other cases it can be recovered through an ESM reboot (second ESM download, ESM pull and replace). 23. Unexpected drive states have been observed during power cycle testing due to internal controller firmware contention when flushing MEL events to disk. The drives have been observed as reconstructing or replaced when they should have been reported as failed. Also volume groups have been reported degraded when all drives were assigned and optimal. An indication that this is the situation would be when drive reconstruction has not completed in the expected amount of time and does not appear to be making any progress. The work around is to reboot the controller owning the volume where the reconstruction has stalled. 24. Sometimes when an ESM is inserted a drive's fault line is asserted briefly. The fault line almost immediately returns to inactive, but the ESMs may bypass the drive. In these circumstances, the administrator will have to reconstruct the failed drive. 25. After a drive fail, a manually initiated copyback to a global hot spare may also fail. The work around is to remove the failed drive and reinsert it, then the copyback should resume and complete successfully. 26. When an erronieous miswire condition occurs (as mentioned above in 21), the recovery guru reports the miswire on one controller but not on the other. In this situation, ignore the other controller and use the information supplied by the controller reporting the problem. 27. Occasionally a controller firmware upgrade to 07.10 will unexpectedly reboot a controller an extra time. This could generate a diagnostic data capture, however the firmware upgrade is always successfull. 28. When managing previous releases of firmware (06.19 and prior), "working" gets displayed as "worki" during volume creation. 29. The Performance Monitor error window does not come to the front. You must minimize all other foreground windows to get to the error popup window. 30. When a disk array is in a degraded state, the array will report "needs attention" to both the EMW and the AMW. After taking appropriate corrective action, the AMW view of the array will report "fixing" but the EMW state remains at "needs attention". Both statuses are valid, when the fault state is resolved both views will change to "optimal". 31. Configuring separate Email alerts when two Enterprise management windows are open on the same host will cause the alerts to disappear if one of the Enterprise windows is shut down and then restarted. It is recommended that if multiple Enterprise management windows needs to be open, that they are open on separate Hosts which will indeed allow the configuration of alerts to be saved if one of the enterprise management windows is shut down and restarted. Legacy restrictions that are still applicable: 1. Reflected Fibre Channel (FC) OPN frames occurs when intermixing the EXP810, EXP710 and EXP100s behind DS4700 or DS4800 storage subsystems. This behavior causes excessive drive side timeout, drive side link down and drive side link up events be posted in the DS4000 storage subsystem Event log (MEL.) It might also cause drives to be by-passed or failed by the controller. NEW DRIVE SIDE FC CABLING REQUIREMENT MUST BE ADHERED TO WHEN HAVING EXP100 CONNECTED TO THE DS4700 OR DS4800 STORAGE SUBSYSTEMS. Please refer to the latest version of the Installation, User's and Maintenance Guide for these storage subsystems that are posted in the IBM DS4000 Support web site for more information. http://www.ibm.com/servers/storage/support/disk/ 2. Can not increase the capacity of RAID arrays. RAID arrays with certain combinations of selected segment size and number of drives that made up the arrays will exceed the available working space in controller dacstore, causing a reconfiguration request (like expanding the capacity of the array) to be denied. These combinations are generally the largest segment size (512KB) with the number of drives in the array is 15 drives or more. There is no work-around. C324144 105008 3. Interoperability problem between the Tachyon DX2 chip in the DS4500 and the DS4300 storage subsystem controllers and the Emulex SOC 422 chip in the EXP810 expansion enclosure ESMs causing up to 5 Fibre Channel loop type errors to be posted in the DS4000 storage subsystem Major Event Log during a 24 hour period. There is a small window in the SOC 422 chip that multiple devices can be opened at one time. This ultimately leads to Fibre Channel loop errors of Fibre Channel link up/down, Drive returned CHECK CONDITION, and Timeout on drive side of controller. IBM recommends the use of the Read-Link-Status function to monitor drive loop for any problems in the drive loop/channel. There is no work-around. 4. The single digit of the Enclosure IDs for all enclosures (including the DS4000 storage subsystem with internal drive slots) in a given redundant drive loop/channel pair must be unique. For example, with four enclosures attached to the DS4300, the correct enclosure ID settings should be x1, x2, x3, and x4 (where x can be any digit that can be set). Examples of incorrect settings would be 11, 21, 31, and 41 or 12, 22, 32, and 62. These examples are incorrect because the x1 digits are the same in all enclosure IDs (either 1 or 2). If you do not set the single digit of the enclosure IDs to be unique among enclosures in a redundant drive loop/channel pair, then drive loop/channel errors might be randomly posted in the DS4000 subsystem Major Event Log (MEL), especially in the cases where the DS4300 storage substems are connected to EXP810s and EXP100s. In additon, enclosure IDs with same single digits in a redundant drive loop/channel pair will cause the DS4000 subsystem controller to assign a soft AL_PA address to devices in the redundant drive loop/channel pair. The problem with soft AL_PA addressing is that AL_PA address assignment can change between LIPs. This possibility increases the difficulty of troubleshooting drive loop problems because it is difficult to ascertain whether the same device with a different address or a different device might be causing a problem. 5. In DS4000 storage subsystem configurations with controller firmware 6.15.2x.xx and higher installed, the performance of write intense workloads such as sequential Tape restores to DS4000 Logical drives with large I/O request sizes (e.g. 256kB) is degraded if the DS4000 logical drives are created with small segment sizes such as 8KB or 16KB. The work around is to create the DS4000 logical drives with segment size of 64KB or higher. 6. Do not pull or insert drives during the drive firmware download. In addition, ALL I/Os must also be stopped during the drive firmware download. Otherwise, drives may be shown as missing, unavailable or failed. 7. Do not perform other storage management tasks, such as creating or deleting logical drives, reconstructing arrays, and so on, while downloading the DS4000 storage subsystem controller firmware and DS4000 EXP ESM firmware. It is recommended that you close all storage management sessions (other than the session that you use to upgrade the firmware) to the DS4000 storage subsystem that you plan to update. ======================================================================= 1.3 Enhancements ------------------------------ The DS Storage Manager version 10.36 host software in conjunction with controller firmware version 7.36.xx.xx provides supports for - Maintenance Release for DS5300, DS5100, DS4800, DS4700, and DS4200. See change history file for detail list of field fixes. - Increased the number of supported Host Types from 16 to 32. - Storage Manager v10.36 Event Monitor installation default changed from disabled to enabled. - Additional MEL Health Checks have been included in the Storage Manager Firmware Upgrade Utility; > MEL entries have wrapped during the last 24 hours > More than 10 DDE Critical MEL events reported in the last 7 days > More than 2 Page 2C Critical MEL events reported in the last 7 days > More than 1 Unscheduled Controller Reboot Critical MEL evens (0x5005, 0x5040) reported in the last 7 days > More than 2 Degraded Drive Channel Critical MEL events reported in the last 7 days > More than 8 Host side Channel Error Critical MEL events reported in the last 7 days > Non-redundant Drive Side cabling on the drive side > More than 4 critical MEL entries in the last 7 days > Add check for event showing MEL was cleared and record this in the Utility Log. Please refer to the New Features section of the IBM System Storage DS Storage Manager Version 10 Installation and Host Support Guide for additional information about the IBM DS Storage Manager version 10 enhancements. ======================================================================= 1.4 Prerequisites ------------------ N/A ======================================================================= 1.5 Dependencies ----------------- 1. The IBM System Storage DS4000 Controller Firmware Upgrade Tool is required to upgrade any system from 6.xx controller firmware to the 7.36.xx.xx controller firmware. 2. Always check the README files (especially the Dependencies section) that are packaged together with the firmware files for any required minimum firmware level requirements and the firmware download sequence for the DS4000 drive expansion enclosure ESM, the DS4000 storage subsystem controller and the hard drive firmware. 3. The DS5100 and DS5300 storage subsystems do not support the attachment of the DS4000 EXP100, EXP700, EXP710, EXP810 drive expansion enclosures. 4. The DS5000 EXP5000 drive expansion enclosure is supported attached to the DS5100 and DS5300 only. 5. The DS4700 and DS4800 storage subsystems do not support the attachment of the DS4000 EXP700 drive expansion enclosures. The EXP700 enclosure must be upgraded into DS4000 EXP710 enclosure using the DS4000 EXP700 Models 1RU/1RX Switched-ESM Option Upgrade Kit before it can be attached to the DS4700 and DS4800 storage subsystems. 6. Required installation order for Storage Manager 10.36.xx.xx and controller firmware 07.36.xx.xx: 1. SMruntime - always first 2. SMesm - required by client 3. SMclient 4. SMagent 5. SMutil 6. Controller firmware and NVSRAM 7. ESM firmware 8. Drive firmware 7. IN-BAND MANAGEMENT IS NOT SUPPORTED WITH VMWARE ESX SERVER. THERE ARE NOT ANY HOST SOFTWARE PACKAGES FOR THE VMWARE ESX SERVER OPERATING SYSTEMS ENVIRONMENT. THE STORAGE MANAGER 10.36 CLIENT PROGRAM MUST BE INSTALLED IN OUT-OF-BAND MANAGEMENT CONFIGURATIONS, PREFERABLY ON THE SAME SYSTEM THAT IS USED TO MANAGE THE ESX SERVER 2.5 OR HIGHER. THE DS4000 STORAGE MANAGER 10.36 CLIENT PROGRAMS FOR THE FOLLOWING OPERATING SYSTEMS - MICROSOFT WINDOWS 2000 AND WINDOWS SERVER 2003 AND LINUX THAT ARE INCLUDED IN THE CD. PLEASE REFER TO THE FOLLOWING DIRECTORIES IN THE CD FOR THE DS4000 STORAGE MANAGER 10.36 CLIENT PROGRAM THAT IS APPROPRIATE FOR THE OPERATING SYSTEM IN THE COMPUTER THAT IS USED TO MANAGE THE DS4000 STORAGE SERVER - WIN32 (WINDOWS 2000), WS03_32BIT AND WS03_64BIT (WINDOWS SERVER 2003 IA32 AND IA64, RESPECTIVELY) AND LINUX (REDHAT 4 or 5 AND SUSE SLES 9 or 10). IBM DS Storage Manager version 10.36 host software requires the DS4000/DS5000 storage subsystem controller firmware be at version 05.30.XX.XX or higher. The only IBM DS4000 Storage Manager supported on DS4000 storage subsystems with controller firmware version 04.xx.xx.xx up to 05.2x.xx.xx is version 09.60.xx.xx. ======================================================================= 2.0 Installation and Setup Instructions ----------------------------------------- None ======================================================================= 3.0 Helpful Configuration Tips ------------------------------ 1. Storage processors can be configured to return either Unit Attention or Not Ready when quiescent. A DS4000 storage processor that is running Windows as a guest operating system should return Not Ready sense data when it is quiescent. Returning Unit Attention might cause the Windows guest to crash or receive IO errors during a failover. Refer to the VMWare SAN Configuration guide to configure the DS4000 subsystem. 2. Storage Management software should not be installed on the ESX server or within the Virtual Machines. ESX Server has its own built-in failover mechanism and path management is handled through the ESX Server Storage Manager GUI. 3. VMware Tools should be installed on all virtual machines using DS4000 logical drives. 4. The ESX Server Advanced options for SCSI device reset should be configured as follows: Disk.UseDeviceReset=0 (disabled for DS4000 logical drives) Disk.UseLunReset=1 (enabled for DS4000 logical drives) Disk.ResetOnFailover=0 This option should be enabled (changed to 1) when using System/LUN (Raw) disk mappings or when using Microsoft cluster nodes across multiple ESX servers as the Virtual Machine configuration file is edited to use the scsi target address (vmhbaX.X.X.X) instead of the VMFS volume label Disk.RetryUnitAttention=1 5. When using a "bootfromsan" configuration with volume mappings from multiple Controllers you must enable persistent bindings to ensure that the Controller containing the Boot LUN is the lowest numbered SCSI target address (vmhba0:0). If persistent bindings are not set the boot lun can be re-ordered to a higher numbered target address causing the server to not boot. To set persistent bindings run the command "/usr/sbin/pbind.pl -A" while the Controller containing the boot LUN is vmhba0:0. 6. ESX 2.1, 2.5, 2.5.1 or 2.5.2 server customers we recommend the use of "LNXCL" as the host type to disable AVT. This reduces path thrashing behavior in the VM kernel during failover. In certain conditions this change can cause the vmkernel to hang on boot up due to a known issue with LUN discovery in ESX Server. Prior to implementing this change, please reference the IBM RedBook: "Implementing VMware ESX Server 2.1 with IBM System Storage DS4000 ", available from the IBM support web-site. The LUN discovery issue is to be corrected with the ESX Server 2.5 or later release. 7. MRU (Most Recently Used) is the supported failover policy when AVT is disabled. Preferred Path can be configured using the DS4000 Storage Manager client and then using the Rescan SAN option within the Storage Management MUI. 8. LUNS should be assigned to the ESX Server starting with LUN number 0. 9. The Access LUN should not be mapped to the ESX server host. 10. The VMware ESX Server 2.1 and higher FC HBA driver includes failover support. You will need to have two HBAs in the server to enable failover. Using a single HBA is supported; but, you will not have path failover support. VMware ESX Server 2.5 or later does not have the capability to utilize FAStT Management Suite Java (FAStT MSJ) program for multi-path I/O configuration. Instead, use the VMware ESX server 2.5 instructions in the ESX Server 2.x Administration Guide to set up IO path fail-over support and to redistribute the LUNs between the FC HBAs. 11. Always use the VMware ESX Server driver for the FC HBA. Please refer to VMware documentation on how to install and configure these FC HBA drivers. 12. Unique partition labels should be used if multiple targets (multiple DS4000 ) are installed to insure proper labeling of logical volumes when the server is rebooted. 13. With ESX Server 2.1 or higher it is no longer necessary to reboot when creating or deleting LUNS. Use the Rescan SAN function within the Storage Management MUI to automatically recognize changes on the Storage Subsystem. 14. Please refer to the ESX Server 2.5 Administrator guides and README for more info on how to setup storage in a SAN environment. 15. The DS4000 controller host ports or the Fibre Channel HBA ports can not be connected to a Cisco FC switch ports with "trunking" enable. You might encounter failover and failback problems if you do not change the Cisco FC switch port to "non-trunking" using the following procedure: a. Launch the Cicso FC switch Device Manager GUI. b. Select one or more ports by a single click. c. Right click the port(s) and select Configure, a new window pops up d. Select the "Trunk Config" tab from this window, a new window opens e. In this window under Admin, select the "non-trunk" radio button, it is set to auto by default. f. Refresh the entire fabric. 16. When making serial connections to the DS4000 storage controller, the baud rate is recommended to be set at either 38200 or 57600. Note: Do not make any connections to the DS4000 storage server serial ports unless it is instructed by IBM Support. Incorrect use of the serial port might result in lost of configuration, and possibly, data. 17. All enclosures (including DS4000 storage subsystem with internal drive slots) on any given drive loop/channel should have complete unique ID's, especially the single digit (x1) portion of the ID, assigned to them. For example, in a maximum configured DS4500 storage subsystem, enclosures on one redundant drive loop should be assigned with id's 10-17 and enclosures on the second drive loop should be assigned with id's 20-27. Enclosure id's with the same single digit such as 11, 21 and 31 should not be used on the same drive loop/channel. In addition, for enclosures with mechanical enclosure ID switch like DS4300 storage subsystems, EXP100 or EXP710 storage expansion enclosures, do not use enclosure ID value of 0. The reason is with the physical design and movement of the mechanical enclosure ID switch, it is possible to leave the switch in a “dead zone” between ID numbers, which return an incorrect enclosure ID to the storage management software. The most commonly returned enclosure ID is 0 (zero). In addition to causing the subsystem management software to report incorrect enclosure ID, this behavior also result in enclosure ID conflict error with the storage expansion enclosure or DS4000 storage subsystem intentionally set the ID to 0. The DS4200 and DS4700 storage subsystems and the EXP420 and EXP810 storage expansion enclosures did not have mechanical ID switches. Thus, they are not susceptible to this problem. In addition, these storage subsystems and storage expansion enclosures automatically set the Enclosure IDs. IBM recommendation is not make any changes to these settings unless the automatic enclosure ID settings resulting in non- unique single digit settings for enclosures (including the storage subsystems with internal drive slots) in a given drive loop/channel. 18. The DS4500 and DS4300 storage subsystem have new recommended drive-side cabling instructions. The DS4500 instructions are documented in the IBM System Storage DS4500 Installation, Users. and Maintenance Guide (GC27- 2051-00 or IBM P/N 42D3302). The DS4300 instructions are documented in the IBM System Storage DS4300 Installation, Users. and Maintenance Guide (GC26-7722-02 or IBM P/N 42D3300). Please follow the cabling instructions in these publication to cable the new DS4500 and DS4300 setup. If you have an existing DS4500 setup with four drive side minuhub installed that was cabled according to the previously recommended cabling instructions, please schedule down time as soon as possible to make changes to the drive side FC cabling. Refer to the IBM System Storage DS4500 and DS4300 Installation, Users. and Maintenance Guide for more information. 19. Running script files for specific configurations. Apply the appropriate scripts to your subsystem based on the instructions you have read in the publications or any instructions in the operating system readme file. A description of each script is shown below. - SameWWN.script: Setup RAID controllers to have the same World Wide Names. The World Wide Names (node) will be the same for each controller pair. The NVSRAM default sets the RAID controllers to have the same World Wide Names. - DifferentWWN.script: Setup RAID controllers to have different World Wide Names. The World Wide Names (node) will be different for each controller pair. The NVSRAM default sets the RAID controllers to have the same World Wide Names. - DisableUA_reporting_inVMware.script: To configure the Storage Subsystem RAID Controller to return Not Ready sense data. Storage Subsystem RAID Controllers can be configured to return either the Unit Attention or Not Ready message when quiescent. A DS4000/DS5000 Storage Subsystem that is running Windows as a guest operating system should return Not Ready sense data when it is quiescent. Returning Unit Attention might cause the Windows guest to fail during a failover. =========================================================================== 4.0 WEB Sites and Support Phone Number -------------------------------------- 4.1 IBM System Storage™ Disk Storage Systems Technical Support web site: http://www.ibm.com/servers/storage/support/disk/ 4.2 IBM System Storage™ Marketing Web Site: http://www.ibm.com/servers/storage/disk 4.3 You can receive hardware service through IBM Services or through your IBM reseller, if your reseller is authorized by IBM to provide warranty service. See http://www.ibm.com/planetwide/ for support telephone numbers, or in the U.S. and Canada, call 1-800-IBM-SERV (1-800-426- 7378). IMPORTANT: You should download the latest version of the DS Storage Manager host software, the DS4000/DS5000 storage subsystem controller firmware, the DS4000/DS5000 drive expansion enclosure ESM firmware and the drive firmware at the time of the initial installation and when product updates become available. For more information about how to register for support notifications, see the following IBM Support Web page: www.ibm.com/systems/support/storage/subscribe/moreinfo.html You can also check the Stay Informed section of the IBM Disk Support Web site, at the following address: www.ibm.com/systems/support/storage/disk ======================================================================= 5.0 Trademarks and Notices -------------------------- The following terms are trademarks of the IBM Corporation in the United States or other countries or both: IBM DS4000 System Storage™ the e-business logo xSeries pSeries HelpCenter Microsoft, Windows, and Windows NT are trademarks of Microsoft Corporation in the United States, other countries, or both. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Sun Microsystems, Inc. in the United states, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a registered trademark of Linus Torvalds. ESX Server is a registered trademark of VMware Corporation. Other company, product, and service names may be trademarks or service marks of others. ======================================================================= 6.0 Disclaimer --------------- THIS DOCUMENT IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND. IBM DISCLAIMS ALL WARRANTIES, WHETHER EXPRESS OR IMPLIED, INCLUDING WITHOUT LIMITATION, THE IMPLIED WARRANTIES OF FITNESS FOR A PARTICULAR PURPOSE AND MERCHANTABILITY WITH RESPECT TO THE INFORMATION IN THIS DOCUMENT. BY FURNISHING THIS DOCUMENT, IBM GRANTS NO LICENSES TO ANY PATENTS OR COPYRIGHTS. Note to U.S. Government Users -- Documentation related to restricted rights -- Use, duplication or disclosure is subject to restrictions set forth in GSA ADP Schedule Contract with IBM Corporation. Refer to the appropriate Storage Manager Client package for the Operating system that you plan to use for management of the DS4000 Storage Subsystem.