Professional Documents
Culture Documents
GA32-0612-02
IBM System Storage™
GA32-0612-02
Note: Before using this information and the product it supports, read the general information in “Notices” on page E-1, the
Warranty and Support Information document, and the Environmental Notices and User's Guide on the IBM Documentation
CD.
1 Introduction .................................................................................................................................... 1
1.1 The IBM DCS9900 3S1 Storage Expansion Unit System .......................................................... 1
1.2 Enclosure Core Product ............................................................................................................. 2
1.2.1 Enclosure Chassis ............................................................................................................. 3
1.3 The Plug-in Modules ................................................................................................................... 3
1.3.1 Power Cooling Module (PCM) ........................................................................................... 3
1.3.2 Input/Output (I/O) Module .................................................................................................. 4
1.3.3 Drive Carrier Module and Status Indicator ........................................................................ 6
1.3.4 DEM Card .......................................................................................................................... 6
1.4 Front Panel Indicators ................................................................................................................ 8
1.5 Environment ............................................................................................................................... 9
1.6 IBM DCS9900 3S1 Storage Expansion Unit Technical Specification ........................................ 9
1.6.1 Dimensions ........................................................................................................................ 9
1.6.2 Weight ............................................................................................................................... 9
1.6.3 AC INPUT PCM ............................................................................................................... 10
1.6.4 PCM Safety and EMC Compliance ................................................................................. 10
1.6.5 Power Cord ..................................................................................................................... 10
1.6.6 Temperature .................................................................................................................... 10
1.6.7 Electrical Power ............................................................................................................... 11
1.6.8 Acoustical (Noise) Level .................................................................................................. 11
3 Operation ...................................................................................................................................... 19
3.1 Before You Begin ..................................................................................................................... 19
3.2 Power On / Power Down .......................................................................................................... 19
3.2.1 PCM LEDs ....................................................................................................................... 19
3.2.2 I/O Panel LEDs ................................................................................................................ 20
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 1
4.4.1 Thermal Control ............................................................................................................... 26
4.4.2 Thermal Alarm .................................................................................................................. 27
4.4.3 Thermal Shutdown ........................................................................................................... 27
4.5 Dealing with Hardware Faults ................................................................................................... 27
4.6 Continuous Operation During Replacement ............................................................................. 28
4.7 Replacing a Module .................................................................................................................. 28
4.7.1 Power Cooling Modules ................................................................................................... 28
4.7.2 I/O Module ........................................................................................................................ 30
4.7.3 Replacing the Drive Carrier Module ................................................................................. 31
4.8 Replacing the DEM ................................................................................................................... 32
4.9 Spare Parts and Ancillary Items ................................................................................................ 33
4.10 Bezel Installation ....................................................................................................................... 34
Appendix B. Rack-Mounting the IBM DCS9900 3S1 Storage Expansion Unit System . . . . . . . . . . . . . . . . B-1
2 IBM DCS9900 3S1 Storage Expansion Unit Installation, Service, and User Guide
Preface
This guide gives you step-by-step instructions on how to install, configure, and connect this product to
your IBM DCS9900. In addition, it provides instructions on how to operate and service this product.
This guide assumes that you have a working knowledge of the SAS environment into which you are
attaching the product. If you do not have these skills, or are not confident with the instructions in this
guide, do not proceed with the installation.
NOTE : Not all information contained in the following sections will pertain directly to your particular
product model.
If you need help, service, or technical assistance or just want more information about IBM products, you
will find a wide variety of sources available from IBM to assist you. This section contains information
about where to go for additional information about IBM and IBM products, what to do if you experience
a problem with your IBM System Storage DCS9900 product, and whom to call for service, if it is
necessary.
Support information
For online support information for your IBM System Storage DCS9900 product, visit the following web
site:
www.ibm.com/support
For telephone support information, in the United States, contact IBM at 1-800-IBM-SERV (426-7378).
In other countries, visit the following web site for support telephone numbers:
www.ibm.com/planetwide/
Before you call, make sure that you have taken these steps to try to solve the problem yourself:
• Check all cables on your hardware to make sure that they are connected properly.
• Check the power switches to make sure that the system is turned on.
• Use the troubleshooting information in your system documentation and use the diagnostic tools that
come with your system.
Information about the DCS9900 product is available on a documentation CD that comes with your
product. You can also access documents using the IBM Publications Center:
http://www.ibm.com/shop/publications/order
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 1
International Standards
This product complies with the applicable Information Technology (IT) standards set forth by EMC and
product safety for world wide shipment.
Qualified Personnel
The personnel qualified to use this device are referred to within this document as follows:
• Service Person: Someone with the appropriate and necessary technical training and experience to be
aware of hazards to which they may be exposed in performing a task and of measures to minimize the
risks to that person or other persons.
• User/Operator: Any person authorized to handle/operate the product other than a Service Person.
Rack Relocation
Observe the following precautions when you need to relocate your rack:
• Before you add or remove drawers, always lower the leveling feet and install the anti-tip plates, or have
the rack bolted to the floor.
• When relocating the DCS9900 rack with 1269-3S1 draws installed, the hard drives installed in the
drawers must be removed to avoid a side-to-side tip-over hazard.
Safe Handling
Do not try to lift the enclosure by yourself. An enclosure can weigh from 9 kg (19.8 lb) to 37 kg (77.6 lb).
Before removing an enclosure from a rack cabinet, always first remove all modules and drives from the
enclosure to minimize weight.
2 IIBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Figure P-5 2 Man Lift Safety Label
Do not try to lift the enclosure by the handles on the PSU/Cooling module. The handles are not
designed to support the weight of the populated enclosure.
Safety Guidelines
Caution ! If this product is used in a manner not specified by the manufacturer, the protection provided
by the product may be impaired.
• The product can weigh up to 35 kg (77 lb). Do not try to lift it by yourself.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 3
!
Warning
The enclosure MUST be grounded before applying power.
Caution ! Plug-in modules are part of the fire enclosure and must only be removed when a replacement can
be immediately added. The system must not be run without all units in place. Operate the system
with the enclosure top cover closed and blanking plates fitted where modules are missing.
• To comply with applicable safety, emission, and thermal requirements, keep all enclosure covers securely
fitted and keep all bays fitted with plug-in modules.
• Enclosures must be only operated from a power supply input voltage range of 100 V AC to 240 V
AC.When a redundant power input module is fitted, it must be operated from a reduced input voltage
range of 200 V AC to 240 V AC.
• The plug on the power supply cord is used as the main disconnect device. Ensure that the socket outlets
are located near the product and are easily accessible.
• The product is intended to operate with three (3) working PSUs. Before the removal or replacement of
any module, disconnect all supply power for complete isolation.
4 IIBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Figure P-9 PSU/Cooling Module Caution Label: Do not operate with modules missing.
• A faulty power supply/cooling module must be replaced with a fully operational module within 24
hours.
• Do not remove a faulty power supply/cooling module unless you have a correct replacement product
ready for insertion.
• Always disconnect power to the product prior to removal of the power supply/cooling module from
the product chassis.
• When powered by multiple AC sources, disconnect all supply power for complete isolation.
• Provide a safe electrical earth (ground) connection for the power cord. Check the grounding of the
enclosure before applying power.
• Provide a suitable power source with electrical overload protection to meet the requirements detailed
in the product’s technical specifications.
!
Warning
Danger of electric shock inside. Return the damaged PSU to
your supplier for repair.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 5
Figure P-11 PSU Safety Label (Electric Shock Hazard Inside)
Figure P-12 Redundant Power Input Switch Module Label (Hazardous Voltage)
Figure P-13 I/O Module Caution Label (Do not operate with modules missing)
Figure P-14 Drive Carrier Module Caution Label (Drive Spin down time 30 seconds)
6 IIBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Class 1 Laser Product
When the product is supplied with optical modules, it contains a laser that complies with Laser Class 1,
US 21 QFR (J) & EN 60825-1, UL (NRTL) and TUV.
Caution ! If optical modules are to be provided and fitted by the end user, the modules must be a UL (or
other North American NRTL) RECOGNISED COMPONENT, must be approved by TUV (or
other European Product safety test house), and the laser in the module must comply with
Laser Class 1, US 21 QFR (J) & EN 60825-1.
Important ! Observe all applicable safety precautions (for example, weight restrictions, handling
batteries and lasers etc.) detailed in the preceding paragraphs when dismantling and
disposing of this product or its components.
European Regulations
This equipment complies with European Regulations EN 55022 Class A: Limits and Methods of
Measurement of Radio Disturbance Characteristics of Information Technology Equipments and
EN50082-1: Generic Immunity.
There are no special tools required, but in order to complete the assembly of some configurations, you
may need the following (not supplied):
• Security keys (one of these should be included with your IBM System Storage DCS9900 3S2
Storage Expansion Unit for use with the drive locks).
The following safety requirements must be considered when the product is mounted in a rack:
• The rack design should incorporate stabilizing features suitable to prevent the rack from tipping or
being pushed over during installation or in normal use.
• When loading a rack with the units, fill the rack from the bottom up and empty from the top down.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 7
• System must be operated with low pressure rear exhaust installation. (Back pressure created by rack
doors and obstacles should not exceed 5 pascals [0.5mm Water gauge].)
• The rack design should take into consideration the maximum operating ambient temperature for the unit,
which is 32°C.
• The rack should have a safe electrical distribution system. It must provide overcurrent protection for the
unit and must not be overloaded by the total number of units installed in the rack. Consideration of the
electrical power consumption rating shown on the nameplate should be used when addressing these
concerns.
• The electrical distribution system must provide a reliable earth grounding for each unit and the rack.
• Each power supply in each unit has an earth leakage current of 1.8mA. The design of the electrical
distribution system must take into consideration the total earth leakage current from all the power
supplies in all the units. The rack will require labelling with “HIGH LEAKAGE CURRENT. Earth
connection essential before connecting supply”.
• The rack when configured with the units must meet the safety requirements of UL 60950 and IEC 60950.
Do not slide more than one product enclosure chassis out of the
!
Warning
rack at a time, to avoid the rack from toppling over.
ESD Precautions
Caution ! It is recommended that you wear a working (examine before wearing) anti-static wrist or ankle
strap and observe all conventional ESD precautions when handling Chassis slug-in modules and
components. Avoid contact with backplane components, module connectors, etc.
Data Security
• Before beginning product installation, power down your DCS9900 and all attached peripheral devices.
• Disk drives are fragile. Handle them with care, and keep them away from strong magnetic fields.
• All the supplied plug-in modules and blanking plates must be in place for the air to flow correctly around
the enclosure and to complete the internal circuitry.
• If the subsystem is used with modules or blanking plates missing for more than a few minutes, the
enclosure can overheat, causing power failure and data loss.
• If you remove a drive module, replace it immediately. Replace it with a drive module of the same type
and capacity
8 IIBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Introduction
Chapter 1
Introduction
Figure 1–1 The IBM DCS9900 3S1 Storage Expansion Unit System - front open view
Figure 1–2 The IBM DCS9900 3S1 Storage Expansion Unit System - rear isometric and rear views
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 1
30 Drive Bays I/O-B
PCMs
8 DEMs
I/O-A
30 Drive Bays
Figure 1–3 IBM DCS9900 3S1 Storage Expansion Unit Module Locations
• Enclosure Chassis with integral Front Panel Drive Status Indicator (Figure 1–10).
• Two (2) 1865W Power Cooling (PCM) plug-in modules (Figure 1–4).
• A midplane separates the front and back of the chassis and provides the interconnect system
between the PCMs, I/O modules, and the baseboard.
• Heterogenous and homogenous configuration of SAS and/or SATA drives (Table 1–1) are
supported in the 1269-3S1. See SAS/SATA Intermix flyer PN 49Y4164 for SAS/SATA intermix
guidelines. This is also included in Appendix D of this document.
2 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Introduction
The IBM DCS9900 3S1 Storage Expansion Unit must always be operated with two (2) Power Cooling
Modules fitted (PCMs). Module replacement should only take a few minutes to perform but must be
completed within 10 minutes from removal of the failed module. Four (4) LEDs mounted on the PCM
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 3
(Table 1–2) indicate the status of the PCM and the fans. PCM voltage operating ranges are nominally
200V to 240V AC.
PCM LEDs
The plug-in I/O modules have been designed for integration into an IBM DCS9900 3S1 Storage
Expansion Unit storage subsystem, providing external SAS cable interfacing with up to 60 SAS or SATA
disk drives.
4 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Introduction
Table 1–3 defines the LED indicators incorporated on the I/O module.
Host Port 1 SAS Link Green ON-a valid SAS link established on at least 1 of the 4
Expansion Port 1 SAS links of the 4-wide SAS port
Host Port 2 OFF-no SAS links
Expansion Port 2
Host Port 1 SAS Link Fault Amber ON-a detectable fault on at least 1 of the 4 SAS links
Expansion Port 1 of the 4-wide SAS port
Host Port 2 OFF-no detectable faults
Expansion Port 2
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 5
1.3.3 Drive Carrier Module and Status Indicator
The Drive Carrier Module comprises a hard disk mounted in a carrier (Figure 1–7). Each drive bay can
house a single Low Profile 1.0 inch high, 3.5 inch form factor disk drive in its carrier. A fully loaded
enclosure contains 60 drive carrier modules.
Note The homogenous enclosure system design allows for drive bays to be left empty without the need for
fitting dummy drive carriers. When intermixing SAS and SATA drives, a drive filler is required. See SAS/
SATA Intermix flyer PN49Y4164 for SAS/SATA intermix drive filler usage. This is also included in
Appendix D of this document.
LED
6 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Introduction
Locking Mechanism
Each DEM connects to a single port of the HDD based on the location within the enclosure within which
it is installed (Figure 1–9). Each provides power control signals to each drive slot. It controls HDD identify/
service LEDs and monitors the status from partner DEM. Each pair of DEMs supports 15 drives; there
are 8 DEMs in a fully configured system.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 7
1.4 Front Panel Indicators
Note The Front Panel is an integral part of the enclosure chassis assembly and is not field replaceable.
The Front Panel Indicators show the aggregated status of all the modules and drive activity. This panel
and its associated LEDs are shown in Figure 1–10. The Front Panel LEDs are defined in Table 1–5.
System Fault AMBER Enclosure Fault ON-one or more components within enclosure have
failed. A service action is required. Exact failed
component has its own amber fault LED lit.
OFF-no detectable faults
Cover Open AMBER Enclosure cover is open OFF-both cover pieces securely closed and latched
in place.
ON-either of the cover pieces is NOT securely closed
and latched in place
Note: The baseplane incorporates an Audible Alarm. This alarm is used to indicate a “cover open” condition. To silence alarm,
close the cover.
8 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Introduction
1.5 Environment
The enclosure and all of its sub-components are compliant to the European Union RoHS (Restriction of
Hazardous Substances) Directive (Directive 2002/95/EC) with no exceptions or exemptions.
1.6.2 Weight
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 9
1.6.3 AC INPUT PCM
Note Power cord is not included in the standard IBM DCS9900 3S1 Storage Expansion Unit enclosure
package.
1.6.6 Temperature
Temperature/Temperature Range (operating): 5 to 32 degrees C (41 to 89.6 degrees F
Operational Derating: Derate ambient temperature by 1 degree C for
every 1000 feet (304.8 meters) increase above
sea level
Relative Humidity: 20% to 80%
Capacity of Exhaust: 200 cfm
Cooling (typical/peak) without any drives installed 717/6367 BTU/hour
Cooling (typical/peak) with 60 drives installed 4100/6367 BTU/hour
10 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Introduction
For detailed measurement data, refer to the DCS9900 Noise Declaration document included
in the RPQ package for DCS9900 configurations that utilize the 3S1 Storage Expansion Unit.
The DCS9900 Noise Declaration document is also available by visiting http://
www.datadirectnet.com/dcs9900/
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 11
This page is intentionally blank.
12 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Getting Started
Chapter 2
Getting Started
Caution When connecting up the IBM DCS9900 3S1 Storage Expansion Unit subsystem, use only the cables
supplied.
Module Location
Power Cooling Modules (PCM) Two (2) PCMs must be fitted. Full power and cooling redundancy is
provided while a faulty module is replaced. Install the PCMs in lower
rear bays A and B.
Note: Rear bays are numbered from A and B starting from the
left when viewed from the back.
I/O Module One or two I/O modules should be Installed in the upper rear bays
A & B.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 13
Bay B
I/O
Bay A
I/O
The IBM DCS9900 3S1 Storage Expansion Unit subsystem is housed in a 60-drive bay enclosure,
arranged in four (4) groups. Each group comprises two banks of 15 bays, that is, (as viewed from the
front): 12 bays across the enclosure by 5 bays deep.
The drive bays are numbered in accordance with the tables shown in Figure 2–2, Figure 2–3, and Figure
2–4 when viewed from above.
14 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Getting Started
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 15
Figure 2–4 4x15 Drive Numbering Table
The IBM DCS9900 3S1 Storage Expansion Unit enclosure is in compliance with EIA-310-D “Cabinets,
Racks, Panels, and Associated Equipment”. The enclosure is designed to fit within a 4U rack space. A
typical rack mounting installation in shown in Figure 2–5
16 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Getting Started
2.4 DEM
The IBM DCS9900 3S1 Storage Expansion Unit enclosure contains eight (8) top-loadable, hot swappable
DEMs. The DEMs provide the SAS connectivity between the I/O module and the HDDs located within the
enclosure. Each DEM connects to a single port of the HDD based on the location within the enclosure in
which it is installed. Each of the eight DEMS installed in the enclosure has a unique I2C and SAS address
based on a proprietary SAS address generation scheme.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 17
2.6 Grounding Checks
The product must only be connected to a power source that has a safety electrical earth connection.
Warning If more than one product is fitted in a rack, the earth connection to the rack is even more
important, because the rack will then have a high “EARTH LEAKAGE CURRENT” (“TOUCH
CURRENT”).
The earth connection to the rack must be checked before switching on, by an electrical engineer who is
qualified to the appropriate local and National standards to perform the check.
18 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Operation
Chapter 3
Operation
All LEDs on the I/O Panel should be lit (Green) when the enclosure power is activated (and the disk drive
motors should start).
Important If AC power is lost for any reason, on restoration of power the enclosure will re-start
automatically.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 19
3.2.2 I/O Panel LEDs
The I/O Panel LEDs fault and status conditions are shown in Figure 3–1.
I Table 3–1 defines the LED indicators incorporated on the I/O module.
20 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Troubleshooting
Chapter 4
Troubleshooting and
Problem Solving
4.1 Overview
The IBM System Storage DCS9900 3S1 Storage Expansion Unit includes an Enclosure Services
Processor and associated monitoring and control logic to enable it to diagnose problems within the
enclosure’s power, cooling, and drive systems.
The sensors for power and cooling conditions are housed within the PCMs. Each unit is independently
monitored.
Important Please wear safety goggles/eyewear when installing, checking, or performing maintenance on
system equipment hardware and cables.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 21
4.2.4 DCS9900 Doesn’t Recognize the 3S1 Subsystem
1 Check that the SAS interface cables from the 3S1enclosure to the DCS9900, or I/O controller, are fitted
correctly.
2 Check that all drive carrier modules have been correctly installed.
3 Check that there is a valid SAS signal present at the I/O connector. If there is no signal present, ensure
the cable has been properly inserted.
4.3 LEDs
Green LEDs are always used for good or positive indication. Amber LEDs indicate there is a critical fault
present within the module. See specific LED tables for further information.
• Under Normal conditions, the LEDs should all be illuminated constant GREEN
• If a problem is detected, the color of the relevant LED will change to AMBER.
Enclosure front Amber Enclosure fault This LED is ON if enclosure has a fault.
Enclosure front Amber Drive fault This LED is ON if a drive has a fault.
22 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Troubleshooting
• Under Normal conditions, the LEDs should all be illuminated constant GREEN
• If a problem is detected, the color of the relevant LED will change to AMBER.
FRONT Enclosure Amber Enclosure fault This LED is ON with a PCM fault.
REAR Enclosure Amber PCM fault This LED is ON with an AC input, DC output,
PCM
fan or other PCM fault.
• Under Normal conditions, the LEDs should all be illuminated constant GREEN
• If a problem is detected, the color of the relevant LED will change to AMBER.
Internal (DEM) Green Expander MIPS ON when the expander internal processor
Enclosure
ready is booted and operating correctly.
OFF when the expander internal
processor is NOT booted or ready.
Internal (DEM) BLUE DEM identify ON indicates that this DEM is being sent
Enclosure
an identify command by the SEP.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 23
4.3.4 I/O Module
The I/O fault LEDs are explained in Table 4–4.
• Under Normal conditions, the LEDs should all be illuminated constant GREEN
• If a problem is detected, the color of the relevant LED will change to AMBER.
REAR Enclosure Green I/O OK OFF when an I/O module detectable fault
is present.
INDEPENDENT of SAS link fault condition
and stays lit during a SAS link fault.
REAR Enclosure Green SAS Link ON when a valid link is present on any of
Activity the 4 links of the 4-wide port.
OFF when none of the 4 links of the 4-
wide port have a valid connection.
REAR Enclosure Amber SAS Link Fault ON when a fault is present on any of the 4
links of the 4-wide port.
OFF when none of the 4 links of the 4-
wide port have a fault.
24 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Troubleshooting
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 25
4.4 Troubleshooting
The following sections describe common problems, with possible solutions, which can occur with your
IBM System Storage DCS9900 3S1 Storage Expansion Unit.
If the ambient air is cool The first stage in the thermal 1 Check the installation for any airflow
(below 25 °C) and the fans control process is for the fans restrictions at either the front or rear
are observed to increase in to automatically increase in of the enclosure. A minimum gap of
speed, then some restriction speed when a thermal 25mm at the front and 50mm at the
on airflow may be causing threshold is reached. This rear is recommended.
additional internal may be caused by higher
temperature rise. ambient temperatures in the 2 Check for restrictions due to dust
local environment and may build-up; clean as appropriate.
Note: This is not a fault be perfectly normal.
condition. 3 Check for excessive re-circulation of
Note: This threshold heated air from rear to the front. Use
changes according to the in a fully enclosed rack installation is
number of drives and PCMs not recommended.
fitted.
4 Check that all Blank modules are in
place.
26 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Troubleshooting
• Display Panel PCM/ If the internal temperature 1 Check local ambient environment
Cooling Fault LED. measured in the airflow through temperature is below the upper 40°C
the enclosure exceeds a pre- specification.
• An AMBER LED on set threshold, a thermal alarm
one or more PCMs. will sound. 2 Check the installation for any airflow
restrictions at either the front or rear
• Audible Alarm of the enclosure. A minimum gap of
Sounding. 25mm at the front and 50mm at the
rear is recommended.
• Air temperature
exiting PCM above 3 Check for restrictions due to dust
35°C. build-up. Clean as appropriate.
Warning If the IBM System Storage DCS9900 3S1 Storage Expansion Unit is powered up and you remove any
module, replace it immediately. If the subsystem is used with modules or module blanks missing
for more than a few minutes, the Enclosure can overheat, causing power failure and data loss.
Such use will invalidate the warranty.
• Replace a faulty drive with a drive of the same type and equal or greater capacity.
• All the supplied plug-in PCMs, electronics modules, and blank modules must be in place for the air
to flow correctly around the cabinet.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 27
4.6 Continuous Operation During
Replacement
Depending on how the subsystem is set up, if a disk unit fails, it can normally be replaced without
interrupting the use of the system.
Please refer to Chapter 2 , ”Getting Started” for information on the initial installation of the plug-in modules
in the IBM System Storage DCS9900 3S1 Storage Expansion Unit.
Warning Observe all conventional ESD precautions when handling IBM System Storage DCS9900 3S1
Storage Expansion Unit modules and components. Avoid contact with Backplane components
and module connectors, etc.
If a power supply unit or its fan is faulty, you must replace the whole PCM. You must not take any longer
than 5 minutes to replace this unit to prevent the enclosure from over-heating.
As there should always be two (2) PCMs installed, you can continue working while replacing the faulty
module.
Warning Do not remove the faulty PCM/Cooling module unless you have a replacement unit of the correct
type ready for insertion.
If a power supply unit or its fan is faulty, you must replace the whole PCM/Cooling module.
As there should always be two PCMs installed, you can continue working while replacing the faulty
module.
1 Make sure you identify the faulty PCM correctly from the two modules installed.
28 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Troubleshooting
4 Lift the PCM handle to the open position to cam the PCM out of the enclosure.
Warning Do not remove the faulty PCM unless you have a replacement unit of the correct type ready for
insertion.
If a power supply unit or its fan is faulty, you must replace the whole PCM.
As there should always be two PCMs installed, you can continue working while replacing the faulty
module.
1 Make sure you identify the faulty PCM correctly from the two modules installed.
4 Remove the two thumbscrews on the right and left sides of the unit.
5 Firmly grip the handle on the bottom of the unit and withdraw the PCM.
Caution Handle the module carefully and avoid damaging the connector pins. Do not install the module if any pins
appear to be bent.
7 With the PCM handle in the open position, slide the module into the enclosure.
8 Cam the module home by manually closing the PCM handle. A click should be heard as the handle
latches engage.
9 Connect the power supply cord to the power source, secure the latch over the cord, and switch the power
supply ON.
Note The alarm will sound until the new PCM is operating correctly.
Caution Handle the module carefully and avoid damaging the connector pins. Do not install the module if any pins
appear to be bent.
2 Slide the module into the enclosure and push unit you hear a click as the latch is engaged.
3 Secure the two thumbscrews on the left and right sides of the unit.
4 Connect the power supply cord to the power source; secure latch, and switch the power supply ON.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 29
Note The alarm will sound until the new PCM is operating correctly.
1 Release the two latches on the bottom of the unit by simply pulling each latch out and away from unit.
2 Pull the latches forward to cam the module out of the enclosure.
4 With the latches in the open position, slide the EBOD module into the enclosure until the latch engages
automatically.
5 Cam the module home by manually closing the latches. A click should be heard as the latch engages.
30 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Troubleshooting
Instructions are also clearly labeled on the inside cover of the enclosures.
3 Slide the drive carrier, gently, all the way into the enclosure.
4 Cam the drive carrier home. The camming foot on the base of the carrier will engage into a slot in
the enclosure.
5 When the carrier is fully home, close the handle. You should hear a click as the latch engages and
holds the handle closed.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 31
4.8 Replacing the DEM
Important The DEM card should only be replaced by trained personnel. The handle rib will light up BLUE for
service.
Warning Observe all conventional ESD precautions when handling Storage Scaler 6000 modules and
components. Avoid contact with backplane components and module connectors, etc.
Instructions are also clearly labeled on the inside cover of the enclosures (Figure 4–3).
1 Grip the top latch, rotate it until you reach the limit of rotation, and then pull up to remove the DEM.
32 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Troubleshooting
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 33
4.10 Bezel Installation
1 Unpack the 1269-3S1 bezel and locate the bag containing four (4) screws (Figure 4–4)
2 Align the bezel to the 3S1 enclosure front panel (Figure 4–5). The chassis’ four (4) metal pins align
into the matching sockets in the bezel.
34 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Troubleshooting
3 Use a phillips (+) screwdriver to fasten the four (4) screws in the four (4) corners of the bezel as
shown in Figure 4–6.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide 35
36 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Drive Addressing
A
Drive Enclosure Addressing
A.1 Background
This sections explains the drive enclosure addressing of the disk enclosures for the IBM DCS9900 3S1 Storage
Expansion Unit Drive Enclosure. There are two drive numbering options:
• 1 x 60 (one set of drives 1 through 60); (Figure A–1, Figure A–4, and Figure A–5).
• 2 x 30 (two sets of drives 1 through 30); (Figure A–2 and Figure A–6).
• 4 X 15 (four sets of drives 1 through 15); (Figure A–3 and Figure A–7).
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide A-1
Drive Addressing Mapping
A-2 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Drive Addressing
Figure A–4 IBM DCS9900 3S1 Storage Expansion Unit - 1x60 Configuration
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide A-3
Drive Addressing Mapping
Figure A–5 IBM DCS9900 3S1 Storage Expansion Unit - Daisy Chain Configuration for 2 Rack 20 Drawer
A-4 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Drive Addressing
Figure A–6 IBM DCS9900 3S1 Storage Expansion Unit - 2x30 Configuration
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide A-5
Drive Addressing Mapping
A-6 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Rack Mounting
B
Rack-Mounting the IBM DCS9900 3S1 Storage Expansion Unit System
The IBM DCS9900 3S1 Storage Expansion Unit System is designed to fit within a 4U rack space. Follow these
steps to mount the system in your rack:
1. Using eight (8) 32 0.188" Phillips panhead screws for each slider, attach the four (4) inner sliders to the
chassis as shown in Figure B-1. below.
2.Loosen the nine (9) screws on the rail kit and set the length to fit the depth of your rack
Figure B-2.. Tighten all the screws once the rail kit is set to the desired length. Repeat for
the other rail kit.
3.Attach the two (2) rail kits to your rack as shown in Figure B-2.. Make sure you leave
enough space for the unit—bottom of screw plate aligns to bottom of IBM DCS9900 3S1
Storage Expansion Unit System chassis. At the front, use one (1) screw plate, one (1)
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide B- 1
shelf locking bracket (installed from behind), and six (6) #10 screws. For the rear end,
use one (1) screw plate and four (4) #10 screws.
4.If the depth of your rack is more than 25.5inches (647mm), attach the two (2) Cable
Management Arm (CMA) brackets to the rear end of the rail kits Figure B-2..
Front of Rack
5.Using two (2) 10-32 0.50” (100d) Phillips flathead screws for each CMA, attach the CMA
to the CMA brackets Figure B-3.. If the depth of your rack is 25.5inches (647mm) or less,
attach the CMA directly to the rack, above the rail kits. For square-hole rack, add 100d
#10 shoulder washers.
B-2 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Rack Mounting
6.With the help of a partner, hold the chassis close to the rail kits. Align the rear flanges on
chassis with the rail kit flanges Figure B-3. and slide the chassis into rack until the sliders
are engaged (slide in about 12 inches until stopped). Then slide the chassis out until
locked. Depress the slider locks and proceed to slide the chassis all the way in.
7.Using two (2) 8-32 0.25” Phillips panhead screws, secure the two CMA to rear of chassis.
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide B- 3
B-4 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Migration
C
4x15 to 2x30 to 1x60 Migration
C.1 Introduction
This section provides instructions to convert a 3-box configuration to a 5-box configuration or a 5-box
configuration to a 10-box configuration for the DCS9900 1269-3S1.
3. Adjust the dip switch configuration on the enclosures. The dip switch is located on the lower right side
of the LED board on the front of the enclosure. Switch 3 which is in the raised position will need to be
pushed to the down position (<Reference>Figure C–1).
4. Install the 2 additional enclosures in the rack. <Reference>Figure C–2 shows 3-box enclosure
configuration.
6. Label the physical drives at this time so that you know into which tier/channel they should be re-
installed.
NOTE : INCORRECT DRIVE PLACEMENT CAN RESULT IN DATA LOSS OR DATA CORRUPTION
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide C-1
Migration
9. Change tier mapping from SAS-4X to SAS-2X. If possible, do this before the controller finishes booting.
12. Verify the health of both systems before returning to normal production executing the following CLI
commands:
• DISK
• TIER
• FAULTS
• SES SHOW DEVICES
• LUN VERIFY=ON
2. Install the 5 additional enclosures in the rack. The DCS9900s will need to be in the middle with 5
enclosures above (new) and 5 enclosures below (existing).
3. Re-cable as shown in <Reference>Figure C–4. Assume the 5 new enclosures go above the 5 existing
enclosures.
4. Label the physical drives at this time so that you know into which tier/channel they should be re-
installed.
NOTE : INCORRECT DRIVE PLACEMENT CAN RESULT IN DATA LOSS OR DATA CORRUPTION
7. Change tier mapping from SAS-2X to SAS-1X. If possible, do this before the controller finishes booting.
10. Verify the health of both systems before returning to normal production executing the following CLI
commands:
• DISK
• TIER
• FAULTS
• SES SHOW DEVICES
• LUN VERIFY=ON
C-2 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Migration
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide C-3
Migration
C-4 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
Migration
Figure C–4 IBM DCS9900 3S1 Storage Expansion Unit - 1x60 Configuration
IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide C-5
Migration
C-6 IBM System Storage DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
D DCS9900 SAS and SATA Drive Placement
Table of Contents
Best practice for mixing SAS and SATA drives in the DCS9900 1269 – 3S1 ..................................3
1.0 Introduction ...........................................................................................................................3
2.0 Related documents ...............................................................................................................3
3.0 Terminology ..........................................................................................................................3
4.0 Disk drive placement rules and considerations .....................................................................6
4.1 Sample drive population scenarios….………………………………………….…………………7
5.0 MES disk drive population rules............................................................................................8
6.0 Enclosure bay numbering convention ...................................................................................8
Best practice for mixing SAS and SATA drives in the DCS9900 1269 – 3S1
1 Introduction
This document provides information and guidelines for SAS and SATA drive placement in the IBM® DCS9900 1269 -
3S1 enclosure. It also addresses some concerns about performance expectations and Rotational Vibration
Interference (RVI) in mixed SAS and SATA environments.
2 Related documents
• DCS9900 1269-CP2 Installation, Service, and User Guide
• DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User Guide
3 Terminology
Bay:
A bay is a compartment in the enclosure drawer
that contains either a drive or a blank carrier.
Row:
An enclosure drawer row consists of 12 bays
across.
Column:
An enclosure drawer column consists of 5 bays
from front to rear.
Section:
An enclosure drawer section consists of 6
contiguous bays on either the left or right side of
the middle divider.
Note: When SAS and SATA drives are randomly mixed in one enclosure, up to a 15%
reduction in performance of the SATA drives can occur. Follow the rules and
considerations in this document to help reduce the effects of RVI as much as possible,
which is typically up to 1%.
• For the DCS9900 1269 - 3S1 in 1X Mode, you can populate one section with SAS drives and the adjoining
section with SATA drives (see Figure 6).
• To maintain proper air flow, each bay in the enclosure must contain a drive or a blank carrier (see Figure 7).
• Plan the initial population of the enclosure for future intermix expansion, as follows:
Minimum number of drives per enclosure is 15
Initial quantity of SAS drives is 6 or more
Initial quantity of SATA drives is 6 or more
Maximum quantity of SAS drives is 54
Maximum quantity of SATA drives is 54
Do not intermix SAS and SATA drives in the same six-drive section
Install SAS drives from front to back (filling each six-drive section)
Install SATA drives from back to front (filling each six-drive section)
Fill all empty bays with blank carriers
• After the initial population, you can add only drives in full sections of the same type or blank carriers.
Note: If you add just one drive at a time, be sure to fill all remaining bays with blank carriers.
Figure 5. DCS9900 1269 - 3S1 SAS and SATA drive Figure 6. DCS9900 1269 - 3S1 with a mixed-load
load (top view) configuration of 6 SAS tiers and 54 SATA tiers (top view)
IBM® may not offer the products, services, or features discussed in this document in
other countries. Consult your local IBM representative for information on the
products and services currently available in your area. Any reference to an IBM
product, program, or service is not intended to state or imply that only that IBM
product, program, or service may be used. Any functionally equivalent product,
program, or service that does not infringe any IBM intellectual property right may be
used instead. However, it is the user’s responsibility to evaluate and verify the
operation of any non-IBM product, program, or service.
IBM may have patents or pending patent applications covering subject matter
described in this document. The furnishing of this document does not give you any
license to these patents. You can send license inquiries, in writing, to:
IBM Director of Licensing
IBM Corporation
North Castle Drive
Armonk, NY 10504-1785
U.S.A.
Any references in this information to non-IBM Web sites are provided for
convenience only and do not in any manner serve as an endorsement of those
Web sites. The materials at those Web sites are not part of the materials for this
IBM product, and use of those Web sites is at your own risk.
IBM may use or distribute any of the information you supply in any way it believes
appropriate without incurring any obligation to you.
Trademarks
IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of
International Business Machines Corporation in the United States, other countries,
or both. If these and other IBM trademarked terms are marked on their first
occurrence in this information with a trademark symbol (® or ™), these symbols
indicate U.S. registered or common law trademarks owned by IBM at the time this
information was published. Such trademarks may also be registered or common law
trademarks in other countries. A current list of IBM trademarks is available on the
Web at “Copyright and trademark information” at http://www.ibm.com/legal/
copytrade.shtml.
© Copyright IBM Corp. 2009 E-1
Adobe and PostScript are either registered trademarks or trademarks of Adobe
Systems Incorporated in the United States and/or other countries.
Intel, Intel Xeon, Itanium, and Pentium are trademarks or registered trademarks of
Intel Corporation or its subsidiaries in the United States and other countries.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc., in
the United States, other countries, or both.
UNIX is a registered trademark of The Open Group in the United States and other
countries.
Important notes
Processor speed indicates the internal clock speed of the microprocessor; other
factors also affect application performance.
CD or DVD drive speed is the variable read rate. Actual speeds vary and are often
less than the possible maximum.
When referring to processor storage, real and virtual storage, or channel volume,
KB stands for 1024 bytes, MB stands for 1 048 576 bytes, and GB stands for
1 073 741 824 bytes.
Maximum internal hard disk drive capacities assume the replacement of any
standard hard disk drives and population of all hard disk drive bays with the largest
currently supported drives that are available from IBM.
Some software might differ from its retail version (if available) and might not include
user manuals or all program functionality.
E-2 IBM System Storage™: DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User's Guide
Electronic emission notices
Properly shielded and grounded cables and connectors must be used in order to
meet FCC emission limits. IBM is not responsible for any radio or television
interference caused by using other than recommended cables and connectors or by
unauthorized changes or modifications to this equipment. Unauthorized changes or
modifications could void the user’s authority to operate the equipment.
This device complies with Part 15 of the FCC Rules. Operation is subject to the
following two conditions: (1) this device may not cause harmful interference, and (2)
this device must accept any interference received, including interference that may
cause undesired operation.
This product has been tested and found to comply with the limits for Class A
Information Technology Equipment according to CISPR 22/European Standard EN
55022. The limits for Class A equipment were derived for commercial and industrial
environments to provide reasonable protection against interference with licensed
communication equipment.
E Notices E-3
European Community contact:
IBM Technical Regulations
Pascalstr. 100, Stuttgart, Germany 70569
Telephone: 0049 (0)711 785 1176
Fax: 0049 (0)711 785 1283
E-mail: tjahn@de.ibm.com
E-4 IBM System Storage™: DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User's Guide
Zulassungsbescheinigung laut dem Deutschen Gesetz über die
elektromagnetische Verträglichkeit von Geräten (EMVG) (bzw. der
EMC EG Richtlinie 2004/108/EG) für Geräte der Klasse A
Dieses Gerät ist berechtigt, in Übereinstimmung mit dem Deutschen EMVG das
EG-Konformitätszeichen - CE - zu führen. Verantwortlich für die
Konformitätserklärung des EMVG ist die IBM Deutschland GmbH, 70548 Stuttgart.
Generelle Informationen:
E Notices E-5
IBM Taiwan product service
E-6 IBM System Storage™: DCS9900 1269-3S1 Storage Expansion Unit Installation, Service, and User's Guide
Printed in USA
GA32-0612-02