Module 4 Install Trouble Shooting Rev - 1.1

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.
V-Max Series Installation Troubleshooting
V-Max Series Installation Troubleshooting
2009 EMC Corporation. All rights reserved.
Welcome to Installation Troubleshooting module.
Module 4 - Installation Troubleshooting
-1
Module Objectives
Upon successful completion of this module, students should be able to:
Identify common installation failures Resolve issues to ensure completion of installation and power-up of machine Document customer power connections Document installation issues.
Module 4: Installation Troubleshooting - 2
After successfully completing this module, you should be able to: Identify common installation failures Resolve issues to ensure completion of installation and power-up of machine Document customer power connections Document installation issues.
-2
Common Installation Failures

Area of Failure Potential Issue
Drives External Power SPS Monitoring Virtual Matrix Inconsistent physical locations when compared with bin file Hardware not installed properly System Bay Storage Bay Storage Bays must be powered up before System Bay
Cabling
Hardware Layout
Hardware Failures
Power Sequence
Many failures occur during installation. Some of these failures are caused by: Incorrect Cabling Incorrect Hardware Layout Hardware Failures Incorrect power-up sequence Many of these issues can be easily fixed and the machine can be installed, powered up, and brought online. The following slides will attempt to help you determine if there is an issue preventing complete installation of a V-Max, and how to fix the problem to complete your installation.
-3
Cabling: Loop Issues

Prior to cabling verification, DA Link verification is performed.
Prior to cabling verification, a DA Link Verification is performed. If the links are not active, the script can not continue. Link errors must be fixed before the script can continue and the cable verification can begin.
-4
Cabling: Back End Cable Verification

Backend Cabling Verification script
Included in Configure and Install New Symmetrix script Steps through a light sequence for valid connections from DA Ports to DAEs cables may be moved Separate Backend Cabling Verification script available for data center relocations, moves, etc. cables must NOT be moved
The Backend Cabling Verification script (available as a standalone script and also included in the Configure and Install New Symmetrix script) will check for Backend cabling errors, and an error report will detail the errors. Running the Backend Cabling Verification script as a standalone is available for data center relocations, machine moves, etc. Do not attempt to move or disconnect cables during this light test when live data is involved; contact PSE Lab for assistance. The standalone script can be found in SymmWin under Procedures Procedure Wizard System Initialization Tools Backend Cabling Verification.
-5
Cabling: Error Log

If backend cabling errors, script halts + display Cabling.log with errors Errors must be fixed before script can continue
If errors occur, the script will halt and display a log file listing the errors. All errors must be fixed before the script can continue. Do no disconnect or move cables during the test when live data is involved; please contact the PSE lab for assistance for any issues concerning backend cabling with live data.
-6
Cabling: V-Max Power Connections

Installation Manual Worksheet
Document customers PDU and circuit breaker numbers for every bay in the system Use this info to populate the PDU label
* See Installation Manual for Power Configuration Worksheets

2009 EMC Corporation. All rights reserved. Module 4: Installation Troubleshooting - 7
Each bay in the V-Max has two power zones, A & B. Each power zone needs to be connected to different PDUs at the customer site. Not having proper power connections leaves the Symmetrix in a vulnerable state, and will cause the machine to vault and go to an offline state and remain that way until sufficient power can be restored to the unit. The Power Connection Worksheet for the V-Max System is shown above, and can be found in the Installation Manual. Complete this Worksheet to document the customers power setup for each installed V-Max.
-7
Cabling: V-Max SE Power Connections
Installation Manual Worksheet

Document customers PDU and PDU Circuit Breaker numbers for every bay in the system
* See Installation Manual for Power Configuration Worksheets
Each bay in the V-Max has two power zones, A & B. Each power zone needs to be connected to different PDUs at the customer site. Not having proper power connections leaves the Symmetrix in a vulnerable state, and will cause the machine to vault and go to an offline state and remain that way until sufficient power can be restored to the unit. The Power Connection Worksheet for the V-Max Model SE System is shown above, and can be found in the Installation Manual. Complete this Worksheet to document the customers power setup for each installed V-Max.
-8
Cabling: Storage Bay Power Connections

Visually inspect internal connections to verify proper connections.
Zone A cables are Gray Zone B cables are Black System Bay
PDU Zone A to A SPSs PDU Zone B to B SPSs SPS Zones A & B to MIBE SPS Zones A & B to V-Max Engines SPS Zones A & B to UPS UPS to KVM, Server and Modem if used
Storage Bay
PDU Zone A to A SPSs PDU Zone B to B SPSs SPS A to DAE A PSs SPS B to DAE B PSs
Storage Bay Rear View Power Connections

Visually inspect all internal power connections for both Zones. Internal (PDU to SPS; SPS to PS, etc.) Power Zone A cables are Gray, Power Zone B cables are Black. Zone A components should be powered by the Zone A SPSs; Zone B components should be powered by the Zone B SPSs. The MIBE, UPS and V-Max Engines are powered by both Zones for redundancy.
-9
Cabling: Power Cable Verification

Power Cabling Verification Script
Included in Configure and Install New Symmetrix script Steps through a sequence of Powering on and off Zone-specific PDP Switches for all existing bays to verify proper power distribution Separate Power Cabling Verification script available for relocation, moves, etc.
Within the Configure and Install New Symmetrix script, there is a power check sequence which must be run for all new installs to verify internal power connections are correct and valid. There is also a standalone Power Cabling Verification script available for data center relocations, machine moves, etc. Should an error condition exist, the script will halt, and the issue must be resolved before continuing.
- 10
Cabling: SPS Monitoring System Bay

System Bay V-Max Engine 4
Management Module to SPS Management Module to UPS
All other System Bay V-Max Engines

Management Module to SPS
SymmWin Environmental Screen

Run Health Check to verify proper connection to all FRUs for reporting purposes.
System Bay: Engine 4 Rear View
Environmental cabling must be verified for monitoring SPSs and UPS. Visual inspection of cabling in addition to using the SymmWin Environmentals Health Check must be done before the system can be brought online to hosts.
- 11
Cabling: SPS Monitoring Storage Bay

D C
SPS 4B
A
L C C-B
Storage Bay
LCC to SPS cables
1
DA E 1 3
L C C-A
DA E 1 6
DA E 15
DA E 14
S PS 4A
SymmWin Environmental Screen

Run Health Check to verify proper connection to all FRUs for reporting purposes.
SPS 3B
L C C -B
0
DA E 1 2 DA E 1 1 DA E 1 0
LC C -A LCC -B
SPS 2B
DA E 9
S PS 3A
1
LC C -A
DA E 6
DA E 8
DA E 7
SPS 1B
LC C-B
DA E 5
S PS 2A
0
L C C -A
DA E 4
Storage Bay: Rear View

Environmental cabling must be verified for SPSs. Visual inspection of cabling in addition to using the SymmWin Environmentals Health Check must be done before the system can be brought online to hosts.
DA E 1
DA E 3
DA E 2
S PS 1A
- 12
DMX-3&4 Series Installation Troubleshooting
DMX-3&4 Series Installation Troubleshooting
Welcome to Installation Troubleshooting module.
- 13
DMX-3 & 4 Cable Diagnostics

Upon completion of this lesson, you will be able to: Run the diagnostic software Follow the diagnostic sequence Verify the physical location using the light sequence Use the Cable Verification Report
The objectives for this lesson are shown here. Please take a moment to review them.
- 14
Location of Cable Diagnostic Script
Cable Verification Script
The Cable Diagnostic script is under the Procedure Wizard, DAE Maintenance Utilities. Cable Diagnostics are also included in Config and Install New Symmetrix script. The cable verification script can be used on both DMX-3 & 4 24-slot and 6-slot models.
- 15
Cabling Verification Tool
The Cabling Verification Tool checks the connections between the DAs and DAEs and can be used at any time. Configuration source is selected during the procedure.
Note: Cables should never be disconnected on a live System.
- 16
. can Step S
The scan step issues commands to the Link CPU directly and looks for actual connections to DAEs. Look at the configuration just for verification of # of DAEs per Port.
- 17
Cabling Light Sequence
Confirm Single Step: Y/N
The Light Sequence is the only way we have to verify physical location. Turns columns then rows in each bay. Columns are turned on by lower directors. Rows are turned on by the Dual Initiator directors. Single Step or not
- 18
Bay Sequence
Light Sequence order for existing bays is: Side A 2A, 1A Side B 1B, 2B
Side A
Side B
The light sequence completes Side A (to the left of the system from the front) and continues to the B side (left of the system from the front). In the case of a 10 storage bay system the light sequence order would be 5A-1A then 1B-5B.
- 19
Light Sequence Bay Progression
Column
For each bay starting with 1A, the columns connected correctly display a light.
- 20
Light Sequence Bay Progression - Row
Row
Starting on the bottom and working toward the top, you have the same choices to repeat or to continue to the next row.
- 21
Light Sequence Bay Progression - Next Bay
Column
Bay 2A
In this example, a fully configured DMX-3 & 4 2500 is shown. The script runs first on the A side (Bay 1A), as this is the first Mohawk cabinet installed. It then goes to the next bay on the A side if connected (Bay 2A), if not, it would jump over to the first Mohawk on the B side (Bay 1B).
- 22
Accessing Cabling.Log file
Cable verification log only appears if there is an issue. To view the report, in Symwin: Under Tools, choose View logfiles and select cabling.log in the log browser. Log files can also be found at 0:\EMC\<Symmetrix Serial Number>\logs\symmwin.
- 23
Cable Verification Report
In the header of the Cable Verification Report, system information is displayed. If errors are present, a list displays. This report also shows the set of DAEs connected to paired director ports.
- 24
DMX-3 & 4 6-Slot Cable Verification

Within SymmWin Environmentals tab, Cable check for DMX950 (Caracal)
Cable verification for the DMX-3 & 4 950 is run through the Environmentals screen in SymmWin.
- 25
Lesson 5: Error Example

Upon completion of this lesson, you will be able to identify, understand and respond to errors during the cable diagnostics.
- 26
Error Example - Gray or No LED
DAE 4 LED off
In this slide, SymmWin indicates that there is no logical connection to DAE 4.
- 27
Error Example - Error Indication
Error Indications
This screen indicates an error with DA 1d, port 0. (See next slide for additional info)
- 28
Error Indications (continued)
Error Indications
After scrolling to the bottom of the report, we can see that Director 16d port 0 has a valid connection, but Director 1d port 0 does not (shown with an X in the primary column and Disconnected! in the display).
- 29
DA Loop, Cabling and Drive Check steps

If there is a loop issue the script will loop from step 30 back to 2D until the loop issues are fixed. Once the loops are active and alive then the cabling check will start. The Config and install cabling check is exactly the same as the Online cabling check script. The script will not continue until the CE agrees that the light sequence was correct. The next check just before the VTOC, Verify_Drives_Are_Ok checks to see if we have any bad (NR) or missing drives before we start to VTOC.
These are the steps for DA Loop, cabling and drive checks in the Config and Install New Symmetrix script.
- 30
Drive Check Step (Failed)
After fixing the cable problem, the script re-IMLs to initialize the loops again (all DAs FF again). This time, the loops are all good and the script moves on to verify that all the configured disk drives are ready and inserted into the correct DAE disk slots. In this example, we removed Disks C0,C1,C2,C3 to simulate multiple disk failures.
- 31
Verify Drives are OK Step
To aid the CE in locating any bad or missing drives, the step Verify_Drives_Are_Ok turns on the bad or missing drives hot replace (amber) LED. If the drive was missing from the DAE drive slot, the hot replace LED will turn on when a drive is inserted. This is an indication that the CE has found the correct DAE drive slot. Once the drives have been replaced, the script will IML again and re-run the step.
If after the IML the drives are all good, the script now moves on and VTOC all drives. If any drives are still not ready on the loop, the script shows the user what drives are bad and it loops through the drive check until the issue has been resolved.
- 32
Drive Enclosure LCC: Rear View DMX-4 shown

4Gb/s PRI and EXP ports Loop ID LCC-A / LCC-B Enclosure ID
Link Control Card A, referred to as LCC-A, connects to the odd Director of a V-Max Engine, while LCC-B connects to the even Director of that same V-Max Engine. The Drive Enclosure has a RJ-11 type connector for a cable that is connected to the SPS modules for monitoring purposes. That way, the LCC can communicate with the SPS through the cable that connects them. Commands and read status are send from the SPS modules that supplies power for the Drive Enclosure , using the RJ-11 RX/TX differential data lines, to the director. Per 4 Drive Enclosures there is 1 SPS tray. That means a total of 8 LCC boards and 2 SPS units. To monitor the SPS modules, only 2 LCCs are needed. Six grey-colored RJ-11 cables are therefore missing and those LCCs do not monitor any SPS, yet depend on the two LCC ports with the grey cables, one for SPS/Zone A and one for SPS/Zone B, to do all the communication. Both the LCC primary (PRI) ports that connect directly to the back-end (DA) ports, and the expansion (EXP) ports, that daisy chain Drive Enclosures, are High Speed Serial Data Connectors (HSSDC).
RJ-11
- 33
LCC LED Settings Symmetrix V-Max: Rear View

16 15 14 13 Storage Bays 2A, 2B, 2C, and 2D 16 15 14 13 Storage Bays 1A, 1B, 1C, and 1D
0 7 0 5 0 3 0 1 1 7 1 5 1 3 1 1
16 15 14 13
2 7 2 5 2 3 2 1
D1 C1 B1 A1
LCC A and B
12 11 10 9
0 6 0 4 0 2 0 0
1 6
1 4
1 2
1 0
Storage Bays 3C and 3D
D1 C1 B1 A1
12 11 10 9
D1 C1 B1 A1
12 11 10 9
2 6 2 4 2 2 2 0
D0 C0 B0 A0
D0 C0 B0 A0
8
1 7
7
1 5
6
1 3
5
1 1
D0 C0 B0 A0
8 7
0 7 0 5
6
0 3
5
0 1
8 7
2 7 2 5
6
2 3
5
2 1
D1 C1 B1 A1
D1 C1 B1 A1
4
1 6
3
1 4
2
1 2
1
1 0
D1 C1 B1 A1
4
0 6
3
0 4
2
0 2
1
0 0
4
2 6
3
2 4
2
2 2
1
2 0
= Port Number = Loop ID = Enclosure ID

D0 C0 B0 A0
D0 C0 B0 A0
D0 C0 B0 A0
The Symmetrix V-Max Storage Bays green and blue LED numbering is shown here. The LED layout shows the system as seen from the rear. Both green and blue LEDs are positioned on the LCCs, of which there are two (2) on each Drive Enclosure (LCC-A and LCC-B). The green LED is set by the system. The blue LED is the Enclosure ID setting and has a recessed push-button switch located between the three clock-wise rotating arrows. In order to read the new switch setting, you must reset the LCC by reseating the LCC card, or power cycling the whole bay. The numbers that are not within a colored circle are indicating the Drive Enclosure number.
- 34
LCC LED Settings Symmetrix V-Max SE: Rear View

8
LCC A and B
0 0 0 0 0 0 0 0 7 6 5 4 3 2 1 0
16 15 14 13
2 7 2 6 2 5 2 4
7 B A
System Bay
6 5 4 3 2 1
Expansion Bay 1A
12 11 10 9
1 7 1 6 1 5 1 4
8 7
2 3 2 2
6
2 1
5
2 0
= Loop ID = Enclosure ID
4
1 3
3
1 2
2
1 1
1
1 0
The numbering of the green and blue LEDs for both the System Bay and the Storage Bay for a Symmetrix V-Max Model SE are shown. The Enclosure ID for the direct-connect Drive Enclosures in the System Bay are always 0, while the Enclosure ID in the Storage Bay for the first loop expansion is 1, and the second loop expansion 2. The LED lay-out shows the system as seen from the rear. The numbers that are not within a colored circle are indicating the Drive Enclosure number. Enclosure IDs can be changed manually, using the recessed push-button switch located between the three clock-wise rotating arrows. In order to activate the new switch setting after you make changes, reset the LCC by reseating the LCC card, or power cycling the whole V-Max Engine or bay. The green marker LED is fixed (cannot be altered manually) and is determined by the position of the Drive Enclosure in the bay.
- 35
LCC LED Settings Symmetrix DMX-950: Rear View

8
LCC A and B
0 0 0 0 0 0 0 0 7 5 3 1 6 4 2 0
16 15 14 13
2 7 2 5 2 3 2 1
7 B A
System Bay
6 5 4 3 2 1
Expansion Bay 1A
12 11 10 9
1 7 1 5 1 3 1 1
8 7
2 6 2 4
6
2 2
5
2 0
= Loop ID = Enclosure ID
4
1 6
3
1 4
2
1 2
1
1 0
The numbering of the green and blue LEDs for both the 6 slot System Bay and the Storage Bay is shown. The direct-connect DAEs in the System Bay are always loop number 0, followed by an optional first loop expansion 1 and a second loop expansion 2 in the Storage Bay. The LED layout shows the system as seen from the rear. The order in which the DAE are stacked in the System are different in DMX-950 and V-Max SE. Loop ID is a function of the Director slice/port.
- 36
Closing Slide
- 37

Module 4 Install Trouble Shooting Rev - 1.1

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Module 4 Install Trouble Shooting Rev - 1.1

Uploaded by

Copyright:

Available Formats

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.

V-Max Series Installation Troubleshooting

V-Max Series Installation Troubleshooting

2009 EMC Corporation. All rights reserved.

Welcome to Installation Troubleshooting module.

Module 4 - Installation Troubleshooting

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.

2009 EMC Corporation. All rights reserved.

Module 4: Installation Troubleshooting - 2

Module 4 - Installation Troubleshooting

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.

Common Installation Failures

Module 4 - Installation Troubleshooting

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.

Cabling: Loop Issues

2009 EMC Corporation. All rights reserved.

Module 4: Installation Troubleshooting - 4

Module 4 - Installation Troubleshooting

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.

Cabling: Back End Cable Verification

2009 EMC Corporation. All rights reserved.

Module 4: Installation Troubleshooting - 5

Module 4 - Installation Troubleshooting

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.

Cabling: Error Log

2009 EMC Corporation. All rights reserved.

Module 4: Installation Troubleshooting - 6

Module 4 - Installation Troubleshooting

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.

Cabling: V-Max Power Connections

* See Installation Manual for Power Configuration Worksheets

Module 4 - Installation Troubleshooting

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.

Cabling: V-Max SE Power Connections

Installation Manual Worksheet

* See Installation Manual for Power Configuration Worksheets

2009 EMC Corporation. All rights reserved.

Module 4: Installation Troubleshooting - 8

Module 4 - Installation Troubleshooting

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.

Cabling: Storage Bay Power Connections

Storage Bay Rear View Power Connections

Module 4 - Installation Troubleshooting

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.

Cabling: Power Cable Verification

2009 EMC Corporation. All rights reserved.

Module 4: Installation Troubleshooting - 10

Module 4 - Installation Troubleshooting

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.

Cabling: SPS Monitoring System Bay

All other System Bay V-Max Engines

SymmWin Environmental Screen

System Bay: Engine 4 Rear View

2009 EMC Corporation. All rights reserved.

Module 4: Installation Troubleshooting - 11

Module 4 - Installation Troubleshooting

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.

Cabling: SPS Monitoring Storage Bay

SymmWin Environmental Screen

Storage Bay: Rear View

Module 4 - Installation Troubleshooting

Copyright 2009 EMC Corporation. Do not Copy - All Rights Reserved.