Professional Documents
Culture Documents
SAN Administration on
Data ONTAP 7.3
Exercise Guide
NETAPP UNIVERSITY
E-1
SAN Administration on Data ONTAP 7.3: Exercise & Answer Table of Contents
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
ATTENTION
The information contained in this guide is intended for training use only. This guide contains information
and activities that, while beneficial for the purposes of training in a closed, non-production environment,
can result in downtime or other severe consequences and therefore are not intended as a reference
guide. This guide is not a technical reference and should not, under any circumstances, be used in
production environments. To obtain reference materials, please refer to the NetApp product
documentation located at www.now.com for product information.
COPYRIGHT
2008 NetApp. All rights reserved. Printed in the U.S.A. Specifications subject to change
without notice.
No part of this book covered by copyright may be reproduced in any form or by any meansgraphic,
electronic, or mechanical, including photocopying, recording, taping, or storage in an electronic retrieval
systemwithout prior written permission of the copyright owner.
NetApp reserves the right to change any products described herein at any time and without notice.
NetApp assumes no responsibility or liability arising from the use of products or materials described
herein, except as expressly agreed to in writing by NetApp. The use or purchase of this product or
materials does not convey a license under any patent rights, trademark rights, or any other intellectual
property rights of NetApp.
The product described in this manual may be protected by one or more U.S. patents, foreign patents,
or pending applications.
TRADEMARK INFORMATION
NetApp, the NetApp logo, and Go further, faster, FAServer, NearStore, NetCache, WAFL, DataFabric,
FilerView, SecureShare, SnapManager, SnapMirror, SnapRestore, SnapVault, Spinnaker Networks,
the Spinnaker Networks logo, SpinAccess, SpinCluster, SpinFS, SpinHA, SpinMove, SpinServer, and
SpinStor are registered trademarks of Network Appliance, Inc. in the United States and other countries.
Network Appliance, Data ONTAP, ApplianceWatch, BareMetal, Center-to-Edge, ContentDirector, gFiler,
MultiStore, SecureAdmin, Smart SAN, SnapCache, SnapDrive, SnapMover, Snapshot, vFiler, Web
Filer, SpinAV, SpinManager, SpinMirror, and SpinShot are trademarks of NetApp, Inc. in the United
States and/or other countries.
Apple is a registered trademark and QuickTime is a trademark of Apple Computer, Inc. in the United
States and/or other countries.
Microsoft is a registered trademark and Windows Media is a trademark of Microsoft Corporation in the
United States and/or other countries.
RealAudio, RealNetworks, RealPlayer, RealSystem, RealText, and RealVideo are registered
trademarks and RealMedia, RealProxy, and SureStream are trademarks of RealNetworks, Inc. in the
United States and/or other countries.
All other brands or products are trademarks or registered trademarks of their respective holders and
should be treated as such.
NetApp is a licensee of the CompactFlash and CF Logo trademarks.
E-2
SAN Administration on Data ONTAP 7.3: Exercise & Answer Table of Contents
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
E-3
SAN Administration on Data ONTAP 7.3: Exercise & Answer Table of Contents
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Introduction
Introduction
MODULE 1: INTRODUCTION
Exercise
Module 1: Introduction, Exploring
the Exercise Environment
Estimated Time: 15 minutes
The goal of this exercise is to give you an opportunity to explore the current exercise
environment with the instructors assistance.
OBJECTIVES
TIME ESTIMATE
15 min.
E1-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
E1-2
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
31
START OF EXERCISE
ACTION
1.
With the assistance of your instructor, identify the following essential equipment
and record the values on the Master Configuration Worksheet found in Appendix B:
LOCAL (CLASSROOM) WINDOWS WORKSTATION
User name
Password
Name
Console IP address
IP address
Local
Administrator
Password
Domain
Administrator
Password
E1-3
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
UNIX WORKSTATION
Name
Console IP address
IP address
Root
Password
STORAGE SYSTEM #1
Name
Type
Internal
IP address
Console
IP address
Root
Password
E1-4
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
STORAGE SYSTEM #2
Name
Type
Internal
IP address
Console
IP address
Root
Password
2.
With the SAN environment, we have two switches: 1 FC and 1 IP. We will not
administer the IP switch but we will do some simple exploration on the Fibre
Channel switch.
Console IP address
User name
Password
3.
Task complete.
END OF EXERCISE
E1-5
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
FC FC
Connectivity
Connectivity
MODULE 2: FC CONNECTIVITY
Exercise
Module 2: FC Connectivity
Estimated Time: 60 minutes
EXERCISE: FC CONNECTIVITY
OVERVIEW
OBJECTIVES
By the end of this exercise, you should understand the exercise environment and be able to
verify Fibre Channel connectivity on your assigned UNIX machine and Windows machine.
TIME ESTIMATE
60 min.
E2-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
E2-2
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
55
START OF EXERCISE
In this task, you will log into a Brocade switch and verify its initial state.
STEP
ACTION
1.
On your local Windows machine, you will log in to the remote Windows machine
through the Remote Desktop Connection tool. Click the Remote Desktop
Connection link on your desktop. If this link is not available, then ask your
instructor where to find the tool.
Type your IP address into the Computer combo box and click the Connect button.
You might be asked to authenticate. If so, provide the user name and password
given to you by your instructor.
You should see the desktop of the remote machine. All other tasks for this entire
course will be completed from this remote machine.
2.
Task complete.
3.
In this task, you will log into a Brocade switch and verify its initial state.
STEP
ACTION
1.
Use PuTTY to log on to a FC switch that has been assigned to you by your
instructor. NOTE: if you are sharing hardware with others students, only one
Telnet session to the FC switch is possible at any one time. It is possible, however,
to log in into the Telnet port and console port separately if available.
Double-click on the link to PuTTY on your Windows desktop.
Enter the IP address to your assigned FC switch and select the Telnet radio button.
E2-3
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
You might want to save this configuration for future use. Type a name into the
Saved Sessions text box and click the Save button.
To open a session with your FC switch, click the Open button.
2.
At the login prompt, authenticate with the FC switch that was provided by your
instructor at the beginning of the course.
3.
Enter the following command at the FC switch prompt to view the current nodes
connected to the switch as well as other FC switch parameters:
switch> switchshow
E2-4
switchName:
switch
switchType:
16.2
switchState:
Online
switchMode:
Native
switchRole:
Principal
switchDomain:
switchId:
fffc01
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
switchWwn:
10:00:00:60:69:c0:0b:e4
switchBeacon:
OFF
Zoning:
OFF
port
0: id N2 No_Light
port
1: id N2 No_Light
port
2: id N2 No_Light
port
3: id N2 No_Light
port
4: id N2 No_Light
port
5: id N2 No_Light
port
6: id N2 No_Light
port
7: id N2 No_Light
switch>
Notice that within this 8-port switch there is no connectivity. Ports 0-7 may show a
status of No_Light (or equivalent no action status) .
This FC switch is not zoned. (Zoning: OFF).
Record the Switch name (switchName) and the Fabric address (switchWwn) setting
on the Master Configuration Worksheet.
4.
Task complete.
5.
In this task, you will enable an FC HBA adapter on the remote Windows machine.
STEP
ACTION
1.
2.
If the SCSI and RAID controllers group is not expanded, expand it by clicking on the
plus sign next to the group.
NOTE: The Windows machine has at least one Emulex adapter and one QLogic
adapter. All should be disabled. There might be also an unknown device. Ignore
this device. We will now enable one of the FC HBA.
E2-5
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
4.
Within the tree pane, select the HBA adapter under your assigned Windows
machine:
Record the Windows WWNN and HBA 1s WWPN on the Master Configuration
Worksheet.
E2-6
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
5.
Now that one of your FC HBA adapters is enabled on the Windows machine, lets
investigate what effect this has on the FC switch. Return to your FC switch PuTTY
Telnet window and at the prompt type the following:
switch> switchshow
switchName:
switch
switchType:
16.2
switchState:
Online
switchMode:
Native
switchRole:
Principal
switchDomain:
switchId:
fffc01
switchWwn:
10:00:00:60:69:c0:0b:e4
switchBeacon:
OFF
Zoning:
OFF
port
0: id N2 No_Light
port
1: id N2 No_Light
port
2: id N2 No_Light
port
3: id N2 No_Light
port
4: id N2 No_Light
port
5: id N2 No_Light
port 6: id N2 Online
10:00:00:00:c9:2d:9f:76
port
F-Port
7: id N2 No_Light
NOTE: To reuse prior commands, press the ESC key and use the K or J key to
move up or down respectively in the command history.
Record the WWPN for port 6 on the Master Configuration Worksheet. Notice that
port 6 has is now online. Compare the F-Port WWPN of Port 6 to the HBAs
WWPN on your Windows machine. Are they the same? _________________
6.
Task complete.
7.
E2-7
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned Windows machine and install the Host Utilities
Kit.
NOTE: if you are working on a Windows machine that is shared with another user, only one
user will need to install the FCP Host Utilities Kit for the machine.
STEP
ACTION
1.
2.
3.
Under the Support for Multipathing step, choose No, I do not want to enable
support for Multipath I/O, and click Next.
4.
5.
Click the Install button to execute the install. After the install is complete, click
Yes to automatically reboot the Windows machine.
6.
Wait about two minutes and attempt to reconnect to your assigned remote Windows
machine. Open a command prompt window by clicking the shortcut on your
desktop. Navigate to:
C:\> cd
Task complete.
8.
E2-8
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned UNIX machine and install the FCP Host Utilities
Kit for Solaris.
STEP
ACTION
1.
Use PuTTY to log on to your assigned UNIX machine. Leaving your FC switch
PuTTY window, double-click on the link to PuTTY on your Windows desktop.
Enter the IP address to your assigned UNIX machine and select the Telnet radio
button.
You might want to save this configuration for future use. Type a name into the
Saved Sessions text box and click the Save button.
To open a session with your UNIX machine, click the Open button.
2.
At the login prompt, authenticate with the UNIX machine using the user name and
password provided by your instructor.
3.
To install the FCP Host Utilities Kit, you would need to identify your machines
platform. Enter the following command:
# uname -a
SunOS sun117 5.10 Generic_127127-11 sun4u sparc
SUNW,Sun-Blade-100
E2-9
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
All Rights
Install the FCP Host Utilities Kit for Solaris. Make a working directory:
# mkdir /_work
Copy the file into the _work directory.
# cp /_files/SANAdmin/santoolkit_solaris_sparc_3.4.tar.Z
/_work
Navigate to that directory.
# cd /_work
To uncompress the file, enter the following command:
# uncompress santoolkit_solaris_sparc_3.4.tar.Z
Enter the following command to extract the package file:
# tar xvf santoolkit_solaris_sparc_3.4.tar
5.
E2-10
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
6.
Observe the components that the Host Utilities Kit installed by entering the
following command:
# ls /opt/NTAP/SANToolkit/bin
Notice some of the available commands.
brocade_info: gathers information to troubleshoot the configuration on a
Brocade switch
cisco_info: gathers information to troubleshoot the configuration on a Cisco
switch
filer_info: gathers information about the configuration on a storage system
solaris_info: gathers information about the configuration of the UNIX machine
7.
You should now be at the end of the PATH line and in append mode. Type the
following:
:/opt/NTAP/SANToolkit/bin
Exit out of append mode, by pressing ESC
Next, save the file and quit vi by entering the following commands:
:wq!
Finally, make sure the new PATH is in working memory:
# source /etc/profile
8.
9.
Task complete.
10.
E2-11
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned UNIX machine and enable an HBA adapter.
STEP
ACTION
1.
Within your UNIX PuTTY Telnet window, investigate whether your UNIX
machine has FC HBAs. Enter the following command:
# prtdiag | grep fibre-channel
pci
33
+tem-board/PCI3
okay
pci
33
/pci@1f,0/pci@5/fibre-channel
+tem-board/PCI2
okay
fibre-channel
fibre-channel
/pci@1f,0/pci@5/fibre-channel
This UNIX machine has at least one Emulex HBA and one QLogic HBA.
NOTE: your specific hardware specification may vary.
2.
3.
Type the line number you recorded above and a capital G. For example, 348G.
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
4.
Lets make sure that the FC HBA is enabled. Enter the following command:
# fcinfo hba-port
HBA Port WWN: 10000000c92da063
OS Device Name: /dev/cfg/c1
Manufacturer: Emulex
Model: LP9002L
Firmware Version: 3.93a0
FCode/BIOS Version: none
Type: N-port
State: online
Supported Speeds: 1Gb 2Gb
Current Speed: 2Gb
Node WWN: 20000000c92da063
Record the UNIX machines WWNN (Node WWN) on the Master Configuration
Worksheet under UNIX WWNN.
Record the adapters WWPN (HBA Port WWN) and OS Device Name on the
Master Configuration Worksheet under UNIX Adapter 1.
5.
Now that we have verified the Emulex FC HBA adapter is enabled on the UNIX
machine, lets investigate what effect this has on the FC switch. Open a PuTTY
Telnet session to your FC switch and at the prompt type the following:
switch> switchshow
E2-13
switchName:
switch
switchType:
16.2
switchState:
Online
switchMode:
Native
switchRole:
Principal
switchDomain:
switchId:
fffc01
switchWwn:
10:00:00:60:69:c0:0b:e4
switchBeacon:
OFF
Zoning:
OFF
port
0: id N2 No_Light
port
1: id N2 No_Light
port
2: id N2 No_Light
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
port
3: id N2 No_Light
port 4: id N2 Online
10:00:00:00:c9:2d:a0:63
port
5: id N2 No_Light
port 6: id N2 Online
10:00:00:00:c9:2d:9f:76
port
F-Port
F-Port
7: id N2 No_Light
Task complete.
7.
In this task, you will log into your assigned UNIX machine and configure UNIX for a
NetApp LUN.
STEP
ACTION
1.
In an earlier task, the FCP Host Utilities Kit was installed. You will now use one of
the tools to configure UNIX for a NetApp LUN.
Verify the current contents of the ssd.conf file:
# cat /kernel/drv/ssd.conf
NOTE: There are no references to NetApp in the default ssd.conf file. You will
configure UNIX for a NetApp LUN, which will modify the ssd.conf file.
# basic_config -ssd_set
W A R N I N G
This script will modify /kernel/drv/ssd.conf
to add settings required for your storage system.
Do you wish to continue (y/n)?--->
Enter y for yes.
NOTE: the script asks you to reboot. You will reboot in a couple of steps.
This script added a new entry in the ssd.conf file. Verify the new ssd.conf file:
# cat /kernel/drv/ssd.conf
E2-14
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
2.
You will investigate multiple paths using Fibre Channel in Module 8. For now,
verify that MPxIO (the native multipathing services) are turned off:
# stmsboot -d
WARNING: This operation will require a reboot.
Do you want to continue ? [y/n] (default: y) y
The changes will come into effect after rebooting the
system.
Reboot the system now ? [y/n] (default: y) y
The UNIX machine should reboot. If the system doesnt prompt you to reboot as
shown above, reboot using the following command:
# reboot -- -r
3.
Task complete.
4.
In this task, you will log into your assigned storage system 1 machine and enable an FC HBA
adapter.
STEP
ACTION
1.
Use PuTTY to log on to your assigned storage system 1. Without closing your
other PuTTY windows, double-click on the link to PuTTY on your Windows
desktop.
Enter the IP address to your assigned storage system 1 and select the Telnet radio
button.
You might want to save this configuration for future use. Type a name into the
Saved Sessions text box and click the Save button.
To open a session with your storage system 1, click the Open button.
2.
At the login prompt, authenticate with storage system 1 using the user name and
password provided by your instructor.
3.
Investigate whether your storage system has the required target HBAs. Enter the
following command:
system> sysconfig
NetApp Release 7.3RC1: Wed Mar
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
System Rev: C0
slot 0: System Board
Processors:
Memory Size:
3072 MB
00:a0:98:03:28:8e (auto-1000t-fd-up)
00:a0:98:03:28:8f (auto-unknown-
00:a0:98:03:28:8c (auto-unknown-
00:a0:98:03:28:8d (auto-unknown-
952.0GB
476.0GB
Target FC HBA
Target FC HBA
245MB
slot 3: NVRAM
Memory Size:
512 MB
It looks like the storage system has two target HBA adapters, named 0c and 0d.
4.
Enter the following command to determine whether the Fibre Channel Protocol
service is running.
system> fcp status
If the FCP service is not license, license the FCP service on the storage system.
system> license add XXXXXX
Now, lets start the FCP services by entering the following command:
system> fcp start
The FCP services should now be started.
5.
fcp nodename
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
6.
0c
Description:
Fibre Channel Target Adapter 0c
(Dual-channel, QLogic 2322 (2362) rev. 3)
Adapter Type:
Local
Status:
OFFLINED BY USER/SYSTEM
FC Nodename:
(500a098086f7c786)
50:0a:09:80:86:f7:c7:86
FC Portname:
(500a098196f7c786)
50:0a:09:81:96:f7:c7:86
Standby:
No
Slot:
0d
Description:
Fibre Channel Target Adapter 0d
(Dual-channel, QLogic 2322 (2362) rev. 3)
Adapter Type:
Local
Status:
OFFLINED BY USER/SYSTEM
FC Nodename:
(500a098086f7c786)
50:0a:09:80:86:f7:c7:86
FC Portname:
(500a098296f7c786)
50:0a:09:82:96:f7:c7:86
Standby:
No
NOTE: Both adapters are disabled. Record both adapters name and WWPNs on
the Master Configuration Worksheet.
7.
0c
Description:
Fibre Channel Target Adapter 0c
(Dual-channel, QLogic 2322 (2362) rev. 3)
E2-17
Adapter Type:
Local
Status:
ONLINE
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
FC Nodename:
(500a098086f7c786)
50:0a:09:80:86:f7:c7:86
FC Portname:
(500a098196f7c786)
50:0a:09:81:96:f7:c7:86
Standby:
No
Slot:
0d
Description:
Fibre Channel Target Adapter 0d
(Dual-channel, QLogic 2322 (2362) rev. 3)
8.
Adapter Type:
Local
Status:
OFFLINED BY USER/SYSTEM
FC Nodename:
(500a098086f7c786)
50:0a:09:80:86:f7:c7:86
FC Portname:
(500a098296f7c786)
50:0a:09:82:96:f7:c7:86
Standby:
No
Now that one of your HBA adapters is enabled on storage system 1, lets
investigate what effect this has on the FC switch. Switch to your FC switch PuTTY
Telnet window and at the prompt type the following:
switch> switchshow
switchName:
switch
switchType:
16.2
switchState:
Online
switchMode:
Native
switchRole:
Principal
switchDomain:
switchId:
fffc01
switchWwn:
10:00:00:60:69:c0:0b:e4
switchBeacon:
OFF
Zoning:
OFF
port 0: id N2 Online
50:0a:09:81:96:f7:c7:86
port
1: id N2 No_Light
port
2: id N2 No_Light
port
3: id N2 No_Light
port 4: id N2 Online
10:00:00:00:c9:2d:a0:63
E2-18
F-Port
F-Port
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
port
5: id N2 No_Light
port 6: id N2 Online
10:00:00:00:c9:2d:9f:76
port
F-Port
7: id N2 No_Light
Switch back to the PuTTY Telnet window that is connected to storage system 1.
Enter the following command:
system> fcp show initiators
Initiators connected on adapter 0c:
Portname
Group
--------
-----
10:00:00:00:c9:2d:9f:76
10:00:00:00:c9:2d:a0:63
Initiators connected on adapter 0d:
None connected.
Validate which WWPN is the Windows Emulex HBA and which WWPN is the
Solaris Emulex HBA with the Master Configuration Worksheet.
10.
Now, for convenience, lets alias the initiators WWPN on the storage system. To
alias the UNIX machines WWPN, type:
system> fcp wwpn-alias set UNIX1-FC
10:00:00:00:c9:2d:a0:63
To alias the Windows machines WWPN, type:
system> fcp wwpn-alias set Win1-FC
10:00:00:00:c9:2d:9f:76
Verify:
system>
WWPN
Alias
----
----
10:00:00:00:c9:2d:a0:63
E2-19
UNIX1-FC
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
10:00:00:00:c9:2d:9f:76
Win1-FC
Group
--------
-----
10:00:00:00:c9:2d:9f:76
WWPN Alias(es): Win1-FC
10:00:00:00:c9:2d:9f:8a
10:00:00:00:c9:2d:a0:63
WWPN Alias(es): UNIX1-FC
Initiators connected on adapter 0d:
None connected.
11.
Task complete.
END OF EXERCISE
E2-20
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
iSCSI
iSCSI
Connectivity
Connectivity
Exercise
Module 3: iSCSI Connectivity
Estimated Time: 60 minutes
OBJECTIVES
By the end of this exercise, you should be able to verify iSCSI connectivity on your assigned
UNIX machine and Windows machine.
TIME ESTIMATE
60 min.
E3-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
E3-2
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
55
START OF EXERCISE
In this task, you will log into your assigned storage system 1 and configure iSCSI.
STEP
ACTION
1.
Within your assigned storage system 1 PuTTY Telnet window, enter the following
command to investigate whether the iSCSI service is running:
system>
iscsi status
In order to communicate with the iSCSI protocol, we will need to have a properly
functioning interface.
Enter the following command to investigate storage system 1s IP interfaces:
system> ifconfig -a
e0a:
flags=948043<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM>
mtu 1500 inet 10.254.134.35 netmask 0xfffffc00 broadcast
10.254.135.255 ether 00:a0:98:03:28:8e (auto-1000t-fdup) flowcontrol full
e0b: flags=108042<BROADCAST,RUNNING,MULTICAST,TCPCKSUM>
mtu 1500 ether 00:a0:98:03:28:8f (auto-unknown-cfg_down)
flowcontrol full
e0c: flags=108042<BROADCAST,RUNNING,MULTICAST,TCPCKSUM>
mtu 1500 ether 00:a0:98:03:28:8c (auto-unknown-cfg_down)
flowcontrol full
e0d: flags=108042<BROADCAST,RUNNING,MULTICAST,TCPCKSUM>
mtu 1500 ether 00:a0:98:03:28:8d (auto-unknown-cfg_down)
flowcontrol full
E3-3
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
lo:
flags=1948049<UP,LOOPBACK,RUNNING,MULTICAST,TCPCKSUM>
mtu 8160 inet 127.0.0.1 netmask 0xff000000 broadcast
127.0.0.1 ether 00:00:00:00:00:00 (VIA Provider)
In a production environment, you should assign one or more dedicated interfaces to
interface. However, in this exercise environment we will use the single configured
interface e0a.
Record the interface name and IP address on the Master Configuration Worksheet.
Verify whether iSCSI service has been enabled for the e0a interface:
3.
4.
system>
iscsi nodename
Task complete.
6.
In this task, you will log into your assigned storage system 2 and configure iSCSI.
STEP
ACTION
1.
Use PuTTY to log on to your assigned storage system 2. Without closing your
other PuTTY windows, double-click on the link to PuTTY on your Windows
desktop.
Enter the IP address to your assigned storage system 2 and select the Telnet radio
button.
You might want to save this configuration for future use. Type a name into the
Saved Sessions text box and click the Save button.
To open a session with your storage system 2, click the Open button.
2.
Within your assigned storage system 2 PuTTY Telnet window, enter the following
command to investigate whether the iSCSI service is running:
system2>
iscsi status
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
In order to communicate with the iSCSI protocol, we will need to have a properly
functioning interface.
Enter the following command to investigate storage system 2s IP interfaces:
system2> ifconfig -a
e0a:
flags=948043<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM>
mtu 1500 inet 10.254.134.36 netmask 0xfffffc00 broadcast
10.254.135.255 ether 00:a0:98:03:28:8e (auto-1000t-fdup) flowcontrol full
e0b: flags=108042<BROADCAST,RUNNING,MULTICAST,TCPCKSUM>
mtu 1500 ether 00:a0:98:03:28:8f (auto-unknown-cfg_down)
flowcontrol full
...
In a production environment, you should assign one or more dedicated interfaces to
interface. However, in this exercise environment, we will use the single configured
interface e0a.
Record the interface name and IP address on the Master Configuration Worksheet.
4.
Verify whether iSCSI service has been enabled for the e0a interface:
system2> iscsi interface show
If it is not enabled, enable e0a to work with the iSCSI service by entering the
following command:
system2> iscsi interface enable e0a
5.
iscsi nodename
Task complete.
7.
E3-5
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned Windows machine and install the Microsoft
software initiator..
STEP
ACTION
1.
On your assigned remote Windows machine, open Internet Explorer and navigate
to C:\_files\SANAdmin. A shortcut should be on your desktop that navigates you
to the appropriate location.
Double-click on Initiator-2.06-build3497-x86fre.exe. If prompted with a security
warning, confirm and continue.
2.
3.
When the installation options appear, check all checkboxes and click the Next
button.
4.
Agree to the license agreement and click the Next button. The initiator should
install.
5.
The installation has completed. Click Finish to reboot the Windows machine.
When it is done rebooting, log back in.
6.
Task complete.
7.
In this task, you will log into your assigned Windows machine and install the Host Utilities
Kit..
STEP
ACTION
1.
On your assigned remote Windows machine, open Internet Explorer and navigate to
C:\_files\SANAdmin.
Double-click on netapp_iscsi_windows_host_utilities_4.1_x86.msi. If prompted
with a security warning, confirm and continue.
2.
3.
4.
Click the Install button to execute the install. After the install is complete, click
Yes to automatically reboot the Windows machine.
5.
Wait about two minutes and attempt to log back into your assigned Windows
machine.
Open a command prompt window by clicking on the link on your desktop.
Navigate to C:\Program Files\NetApp\iSCSI Host Utilities.
C:\Program Files\NetApp\iSCSI Host Utilities> dir
6.
Task complete.
7.
E3-6
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned Windows machine and configure iSCSI on
Windows.
STEP
ACTION
1.
On your assigned remote Windows machine, open Device Manager by rightclicking on the link to the Windows machine and selecting Manage. The System
dialog box should appear. Select the Hardware tab.
On the right, select Device Manager link. The Device Manager should appear.
2.
In Windows Server 2008, if the Storage controllers group is not expanded, expand
it by clicking the plus sign next to it.
In Windows Server 2003, if the SCSI and RAID Controllers group is not expanded,
expand it clicking the plus sign next to it.
Verify that Microsoft iSCSI Software Initiator is enabled.
If it is not enabled, right-click on the device and choose Enable from the drop-down
menu.
3.
4.
If this is first time launching this dialog box, you will be prompted with a question
about whether you want to automatically run the iSCSI service every time the
machine launches. Click the Yes button.
Next you might be prompted with a question about whether you want to unblock
the iSCSI service so it can communicate with your network. This will enable an
exception in the default Windows firewall for the iSCSI service and allow
communication through.
Click the Yes button.
The iSCSI Initiator Properties dialog box should open.
5.
Under the General tab of the iSCSI Initiator Properties dialog box, the current
WWN is printed.
Record the Windows machines WWN in the Master Configuration Worksheet.
6.
7.
E3-7
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
OK. Back in the iSCSI Initiator Properties dialog box it should now report the
status as Connected.
You have now successfully established connectivity between the Windows initiator
and the targets on storage system 1.
8.
Task complete.
9.
In this task, you will log into your assigned storage system 1 and configure iSCSI.
STEP
ACTION
1.
Within your assigned storage system 1 PuTTY Telnet window, enter the following
command to investigate the current iSCSI sessions:
system>
Task complete.
3.
In this task, you will log into your assigned UNIX machine and configure iSCSI for a native
interface.
STEP
ACTION
1.
Within your UNIX PuTTY Telnet window, verify that the iSCSI software packages
are installed:
#
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
2.
Investigate which interface we have available for iSCSI. Enter the following
command:
# ifconfig -a
lo0:
flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,
VIRTUAL> mtu 8232 index 1 inet 127.0.0.1 netmask
ff000000
eri0: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4>
mtu 1500 index 2 inet 10.254.134.38 netmask fffffc00
broadcast 10.254.135.255 ether 0:3:ba:d:d0:9e
It looks like the UNIX machine has only one interface eri0.
Record the interface name and IP address on the Master Configuration Worksheet.
3.
4.
5.
Verify that both storage systems addresses are now in your discovery list:
#
6.
E3-9
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Discovery:
Static: disabled
Send Targets: disabled
iSNS: disabled
Enable iSCSI send target discovery:
# iscisadm modify discovery --sendtargets enable
NOTE: We are using the send-targets method, instead of the static or iSNS method.
To verify the discovery method:
# iscsiadm list discovery
Discovery:
Static: disabled
Send Targets: enabled
iSNS: disabled
7.
Task complete.
8.
In this task, you will log into your assigned storage system 2 and confirm an iSCSI session
was established by UNIX.
STEP
ACTION
1.
Within your assigned storage system 2 PuTTY Telnet window, enter the following
command to investigate the current iSCSI sessions:
system2>
Task complete.
END OF EXERCISE
E3-10
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
LUN
LUN
Access
Access
Exercise
Module 4: LUN Access
Estimated Time: 60 minutes
OBJECTIVES
By the end of this exercise, you should be able to configure LUN access within an FC SAN
for Windows and Solaris. You should also be able to configure LUN access within an IP
SAN for Windows and Solaris.
TIME ESTIMATE
60 min.
E4-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
E4-2
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
51
START OF EXERCISE
In this task, you will log into your assigned storage system 1 and create a LUN for the UNIX
machine to connect by way of FCP.
STEP
ACTION
1.
With your assigned storage system 1 PuTTY Telnet window, enter the following
command to determine current storage:
system> aggr status
Aggr State
aggr0 online
Status
Options
raid_dp, aggr
root
Create a new aggregate for the volumes that will contained your future LUNs:
system> aggr create aggr_SAN 7
If you have nonzeroed disks, this might take a while.
Verify that the aggregate creation is successful with:
system> aggr status -r
The aggregate is successfully created when its state is online.
2.
Create a 10 GB flexible volume called vol_SAN0 for the LUNs by entering the
following command:
system> vol create vol_SAN0 aggr_SAN 10g
3.
Create a new LUN for the UNIX machine that will be accessed by way of FCP by
entering the following command:
# lun setup
This setup will take you through the steps
needed to create LUNs and to make them accessible by
initiators. You can type ^C (Control-C) at any time to
abort the setup and no unconfirmed changes will be made
to the system.
Do you want to create a LUN? [y]: y
Multiprotocol type of LUN
(solaris/windows/hpux/aix/linux/netware/vmware/
windows_gpt/windows_lhs)[linux]: solaris
A LUN path must be absolute. A LUN can only reside in a
volume or qtree root. For example, to create a LUN with
name "lun0" in the qtree root /vol/vol1/q0, specify the
path as "/vol/vol1/q0/lun0".
E4-3
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Group
10:00:00:00:c9:2d:9f:76
10:00:00:00:c9:2d:a0:63
Initiators connected on adapter 0d:
None connected.
Enter comma separated portnames: 10:00:00:00:c9:2d:a0:63
Enter comma separated portnames: <CR>
E4-4
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
: /vol/vol_SAN0/lun0
OS Type
: solaris
Size
: 2g (2147483648)
Comment
Initiator Group
: iUNIX_fcp
: FCP
: 0
4.
Mapped to
LUN ID
---------------------------------------------------------/vol/vol_SAN0/lun0
5.
Task complete.
6.
E4-5
iUNIX_fcp
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
FCP
In this task, you will log into your assigned UNIX machine and access a LUN by way of
FCP.
STEP
ACTION
1.
With your assigned UNIX PuTTY Telnet window, verify that the UNIX machine
can see that there is a disk attached to a target by entering the following command:
# cfgadm -al
Ap_Id
Type
c0
scsi-bus connected
configured unknown
c0::dsk/c0t0d0
disk
connected
configured unknown
c0::dsk/c0t1d0
CD-ROM
connected
configured unknown
fc-fabric connected
configured unknown
c1
Receptacle Occupant
Condition
connected
configured unknown
usb0/1
unknown
empty
unconfigured ok
usb0/2
unknown
empty
unconfigured ok
usb0/3
unknown
empty
unconfigured ok
usb0/4
unknown
empty
unconfigured ok
c1 device now has a disk connected to the WWPN of your storage system 1. Note
that it is already configured and is ready to use.
2.
Have UNIX scan the SCSI bus looking for new LUNs by entering the following
command:
# devfsadm
3.
Verify the LUN is visible by using the Host Utilities Kits sanlun tool:
# sanlun lun show
filer: lun-pathname device filename adapter protocol
lun size lun state
system: /vol/vol_SAN0/lun0
/dev/rdsk/c1t500A098196F7C786d0s2
2g (2147483648)
GOOD
emlxs0
FCP
E4-6
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Logical Path:/dev/rdsk/c1t500A098196F7C786d0s2
Record your logical path to the LUN:
___________________________________________________________________
NOTE: the LUN ID number provide in the previous task corresponds to the
numeric value following the d near the end of the logical path.
4.
Format, label, and examine the partition table of the LUN by entering the following
command (NOTE: choose the device that you recorded in the previous step):
# format
Searching for disks...done
c1t500A098196F7C786d0: configured with capacity of
2.00GB
Label it now? y
FORMAT MENU:
E4-7
disk
- select a disk
type
partition
current
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
format
repair
label
analyze
- surface analysis
defect
backup
verify
save
inquiry
volname
!<cmd>
quit
format> partition
PARTITION MENU:
0
label
disk
!<cmd> - execute <cmd>, then return
quit
partition> print
Current partition table (default):
Total disk cylinders available: 2046 + 2 (reserved
cylinders)
E4-8
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Part
Tag
Flag
Cylinders
Size
0
root
131072
wm
0 -
63
64.00MB
1
swap
262144
wu
64 -
191
128.00MB
2
backup wu
4190208
0 - 2045
Blocks
(64/0/0)
(128/0/0)
2.00GB
(2046/0/0)
3 unassigned wm
(0/0/0)
4 unassigned wm
(0/0/0)
5 unassigned wm
(0/0/0)
1.81GB
(1854/0/0)
(0/0/0)
0
0
0
6 usr
3796992
wm
7 unassigned wm
192 - 2045
0
0
partition> quit
format> quit
5.
Install a UNIX file system (UFS) into the LUN by entering the following command
(NOTE: the path of the device is the same path as is in the output of the luxadm
probe or sanlun lun show command - see step 3 above):
# newfs /dev/rdsk/c1t500A098196F7C786d0s2
newfs: construct a new file system
/dev/rdsk/c1t500A098196F7C786d0s2: (y/n)? y
/dev/rdsk/c1t500A098196F7C786d0s2: 4190208 sectors in
2046 cylinders of 16 tracks, 128 sectors
2046.0MB in 64 cyl groups (32 c/g, 32.00MB/g, 7936
i/g)
super-block backups (for fsck -F ufs -o b=#) at:
32, 65696, 131360, 197024, 262688, 328352, 394016,
459680, 525344, 591008, 3539744, 3605408, 3671072,
3736736, 3802400, 3868064, 3933728, 3999392,4065056,
4130720
6.
E4-9
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
# mkdir /mnt/lun0
# ls
Mount the filesystem in the LUN on the path that you just created . NOTE: the
path to the device is the dsk or block device path:
# mount /dev/dsk/c1t500A098196F7C786d0s2 /mnt/lun0
Navigate to that directory.
# cd /mnt/lun0
# ls
lost+found
Touch the LUN to verify accessibility:
# touch foo
# ls
foo
lost+found
7.
Task complete.
8.
In this task, you will log into your assigned storage system 1 and create a LUN for the
Windows machine to connect by way of iSCSI.
STEP
ACTION
1.
2.
Within your assigned storage system 1 PuTTY Telnet window, enter the following
command to create an igroup:
system> igroup create -i -t windows iWIN_iscsi iqn.199105.com.microsoft:dev-san20wn.development.netappu.com
system> igroup show
iWIN_iscsi (iSCSI) (ostype: windows):
iqn.1991-05.com.microsoft:devsan20wn.development.
netappu.com (logged in on:
e0a)
E4-10
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
3.
2.0g (2155023360)
Verify:
system> lun show
4.
/vol/vol_SAN0/lun0
(r/w, online, mapped)
2g (2147483648)
/vol/vol_SAN1/lun1
(r/w, online)
2.0g (2155023360)
5.
Mapped to
LUN ID
---------------------------------------------------------/vol/vol_SAN0/lun0
iUNIX_fcp
FCP
/vol/vol_SAN1/lun1
iWIN_iscsi
iSCSI
6.
Task complete.
7.
E4-11
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned Windows machine and access the lun1 by way of
iSCSI from storage system 1.
STEP
ACTION
1.
On your assigned remote Windows machine, open the Disk Management tool by:
Right-clicking on The Local Computer icon on the desktop and select Manage.
Expand the Storage node from the tree pane. Disk Management should be visible.
Select the Disk Management icon within the tree.
2.
If one or more LUNs are not visible, right-click on the Disk Management icon
within the tree and select Rescan Disks from the menu.
After a while, one or more LUNs should appear.
3.
Select the iSCSI LUN and make it online by right-clicking the Disk # and select
Online.
4.
Next, we will initialize the LUN. Right-click on the Disk # and select Initialize.
In Windows Server 2008, choose an MBR partition style and click OK.
NOTE: In Windows Server 2003, partition style choice is not available.
5.
Now is the time to provision the LUN. We will use the New Simple Volume
method, which is available for Windows Server 2008 or the Create Partition Wizard
available in Windows Server 2003. This task will analyze the New Simple Volume
method but the Create Partition Wizard method should parallel it.
Right-click on the new unallocated disk and select New Simple Volume from the
menu. The new Simple Volume Wizard should begin.
6.
Click Next from the title page of the wizard. Within the Specify Volume Size page,
choose to make the LUN as large as it can be and click Next.
7.
8.
9.
On the Completing the New Simple Volume Wizard page, review the values and
Click Finish if all entries are correct.
E4-12
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
10.
After a moment, the LUN should now be available. Navigate to the drive letter of
the LUN and write a test file to the LUN to verify it is working correctly.
11.
Task complete.
12.
In this task, you will log into your assigned storage system 2 and create a LUN for the UNIX
machine to connect by way of iSCSI.
STEP
ACTION
1.
2.
Create an aggregate for the LUNs to be placed by expanding the Aggregates menu
item and clicking Add. The Aggregate Wizard should launch.
Walk through the wizard entering the following information:
Aggregate Name: aggr_SAN
Double Parity: checked
RAID Group Size: 16
Disk Selection: Automatic
Disk Type: Any Type
Disk Size: Any Size
Number of Disks: 7
Commit the creation of the aggregate.
Verify the aggregate is created by selecting the Manage item under the Aggregates
menu item.
3.
Create a flexible volume for the LUNs by expanding the Volume menu item and
clicking Add. The Volume Wizard should launch.
Walk through the wizard entering the following information:
Volume Type: Flexible
Volume Name: vol_SAN2
Language: POSIX
UTF-8: unchecked
Containing Aggregate: aggr_SAN
Space Guarantee: volume
Volume Size Type: Total Size
Volume Size: 10 GB
Snapshot Reserve: 20%
Commit the creation of the volume.
Verify the volume is created by selecting the Manage item under the Volumes
menu item.
E4-13
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
4.
Create a LUN with the FilerView LUN Wizard by expanding the LUNs menu item
and clicking Wizard.
Walk through the wizard entering the following information:
Path: /vol/vol_SAN2/lun2
Size: 2 GB
LUN Protocol Type: Solaris
Space Reserved: checked
Description: UNIX LUN by way of iSCSI
Click the Add group button.
Create a new iGroup:
Name: iUNIX_iscsi
Type: iSCSI
Operating System: Solaris
Click the Add Initiator button.
Select known iSCSI node name: selected
Choose the IQN WWNN for your assigned UNIX machine as recorded on the
Master Configuration Worksheet.
Verify that the WWNN was added to the igroup and select Next.
Verify the igroup and select Next.
LUN ID: 2
Commit the creation of the LUN, igroup, and mapping.
Close the LUN Wizard window.
5.
Verify the LUN and mapping by selecting Manage item under the LUNs menu
item.
6.
Task complete.
7.
In this task, you will log into your assigned UNIX machine and access the lun2 by way of
iSCSI from storage system 2.
STEP
ACTION
1.
Within your UNIX PuTTY Telnet window, create an iSCSI device link for the local
system by entering the following command:
# devfsadm -i iscsi
2.
Verify that you have a connection to the storage system 2 by entering the following
command:
#
Target: iqn.1992-08.com.netapp:sn.101173126
Alias: E4-14
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
TPGT: 1000
ISID: 4000002a0000
Connections: 1
Target: iqn.1992-08.com.netapp:sn.101169724
Alias: TPGT: 1000
ISID: 4000002a0000
Connections: 1
The number of connections should be greater than 0.
3.
Next discover the OS Device name for lun2 by entering the following command:
# iscsiadm list target -S
Target: iqn.1992-08.com.netapp:sn.101173126
Alias: TPGT: 1000
ISID: 4000002a0000
Connections: 1
LUN: 2
Vendor:
NETAPP
Product: LUN
OS Device Name: /dev/rdsk/c3t2d0s2
Target: iqn.1992-08.com.netapp:sn.101169724
Alias: TPGT: 1000
ISID: 4000002a0000
Connections: 1
We can also do this with the Host Utilities Kits sanlun command:
# sanlun lun show
filer:
lun-pathname
device filename
lun size
devslu20-f1:
E4-15
adapter protocol
lun state
/vol/vol_SAN0/lun0
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
/dev/rdsk/c1t500A098196F7C786d0s2
2g (2147483648)
GOOD
DEVSLU20-F2:
emlxs0
FCP
iscsi0
iSCSI
/vol/vol_SAN2/lun2
/dev/rdsk/c3t2d0s2
2g (2147483648)
GOOD
Note the second LUN is the from storage system 2 with the iSCSI lun2.
Record the OS device name: _________________________________________
4.
Format, label, and examine the partition table of the LUN by entering the following
command (NOTE: choose the device that you recorded in the previous step):
# format
Searching for disks...done
c1t500A098186F7C786d0: configured with capacity of
2.00GB
c1t500A098196F7C786d0: configured with capacity of
2.00GB
c3t2d0: configured with capacity of 1022.00MB
AVAILABLE DISK SELECTIONS:
0. c0t0d0 <ST320011A cyl 38790 alt 2 hd 16 sec 63>
/pci@1f,0/ide@d/dad@0,0
1. c0t2d0 <ST320011A cyl 38790 alt 2 hd 16 sec 63>
/pci@1f,0/ide@d/dad@2,0
2. c1t500A098196F7C786d0 <NETAPP-LUN-0.2 cyl 1022 alt
2 hd 16 sec 128> /pci@1f,0/pci@5/fibrechannel@0/fp@0,0/ssd@w500a098196f7c786,0
3. c3t2d0 <NETAPP-LUN-0.2 cyl 1022 alt 2 hd 16 sec
128> /iscsi/disk@0000iqn.199208.com.netapp%3Asn.10117312603E8,2
Specify disk (enter its number): 3
selecting c3t2d0
[disk formatted]
Disk not labeled.
Label it now? y
FORMAT MENU:
E4-16
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
disk
- select a disk
type
partition
current
format
repair
label
analyze
- surface analysis
defect
backup
verify
save
inquiry
volname
!<cmd>
quit
format> partition
PARTITION MENU:
0
label
disk
!<cmd> - execute <cmd>, then return
quit
E4-17
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
partition> print
Current partition table (default):
Total disk cylinders available: 2046 + 2 (reserved
cylinders)
Part
Tag
Flag
Cylinders
Size
0
root
131072
wm
0 -
63
64.00MB
1
swap
262144
wu
64 -
191
128.00MB
2
backup wu
4190208
0 - 2045
Blocks
(64/0/0)
(128/0/0)
2.00GB
(2046/0/0)
3 unassigned wm
(0/0/0)
4 unassigned wm
(0/0/0)
5 unassigned wm
(0/0/0)
1.81GB
(1854/0/0)
(0/0/0)
0
0
0
6 usr
3796992
wm
7 unassigned wm
192 - 2045
0
0
partition> quit
format> quit
5.
Add the UNIX file system (UFS) to the LUN by entering the following command
(NOTE: the OS device is the device listed in the iscsiadm list target -S
output - see step 3 above):
# newfs /dev/rdsk/c3t2d0s2
newfs: construct a new file system /dev/rdsk/c3t2d0s2:
(y/n)?
y
/dev/rdsk/c3t2d0s2: 4190208 sectors in 2046 cylinders of
16 tracks, 128 sectors
2046.0MB in 64 cyl groups (32 c/g, 32.00MB/g, 7936
i/g)
super-block backups (for fsck -F ufs -o b=#) at:
32, 65696, 131360, 197024, 262688, 328352, 394016,
E4-18
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
6.
# mkdir /mnt/lun2
Mount the LUN on the path that you just created (NOTE: the path to the device is
the dsk or block device path):
# mount /dev/dsk/c3t2d0s2 /mnt/lun2
Navigate to that directory.
# cd /mnt/lun2
Touch the LUN to verify accessibility:
# touch foo
# ls
foo
lost+found
7.
Task complete.
8.
TASK 7: CREATE AN IGROUP AND LUN, AND MAP AN IGROUP AND LUN WITH
FILERVIEW
In this task, you will log in to your assigned storage system 1 and create a LUN for the UNIX
machine to connect by way of FCP.
STEP
ACTION
1.
2.
Create a flexible volume for the LUNs by expanding the Volume menu item and
clicking Add. The Volume Wizard should launch.
Walk through the wizard entering the following information:
Volume Type: Flexible
Volume Name: vol_SAN3
Language: POSIX
UTF-8: unchecked
Containing Aggregate: aggr_SAN
Space Guarantee: volume
Volume Size Type: Total Size
Volume Size: 10 GB
Snapshot Reserve: 20%
Commit the creation of the volume.
E4-19
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Verify the volume is created by selecting the Manage item under the Volumes
menu item.
3.
4.
5.
6.
Verify the LUN and mapping by selecting Manage item under the LUNs menu
item.
7.
Task complete.
8.
E4-20
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned Windows machine and access lun3 by way of
FCP from storage system 2.
STEP
ACTION
1.
On your assigned remote Windows machine, open the Disk Management tool
again.
2.
If an offline LUN is not visible, right-click on the Disk Management icon within the
tree and select Rescan Disks from the menu.
After a while, the LUN should appear.
3.
Select the FCP LUN and make it online by right-clicking the Disk # and select
Online.
4.
Next, we will initialize the LUN. Right-click on the Disk # and select Initialize.
In Windows Server 2008, choose an MBR partition style and click OK.
In Windows Server 2003, simply click OK.
5.
Now is the time to provision the LUN. We will use the New Simple Volume
method, which is available for Windows Server 2008 or the Create Partition Wizard
available in Windows Server 2003. This task will analyze the New Simple Volume
method but the Create Partition Wizard method should parallel it.
Right-click on the new unallocated disk and select New Simple Volume from the
menu. The new Simple Volume Wizard should begin.
6.
Click Next from the title page of the wizard. Within the Specify Volume Size page,
choose to make the LUN as large as it can be and click Next.
7.
8.
9.
On the Completing the New Simple Volume Wizard page, review the values and
Click Finish if all entries are correct.
10.
After a moment, the LUN should now be available. Navigate to the drive letter of
the LUN and write a test file to the LUN to verify it is working correctly.
11.
Task complete.
END OF EXERCISE
E4-21
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
LUN
LUN
Provisioning
Provisioning
Exercise
Module 5: LUN Provisioning
Estimated Time: 45 minutes
OBJECTIVES
By the end of this exercise, you should understand the impact of Snapshot copies with LUN0.
TIME ESTIMATE
45 minutes
E5-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
E5-2
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
42
START OF EXERCISE
In this task, you will log into your assigned storage system 1 and create a Snapshot copy of
vol_SAN0 which contains lun0.
STEP
ACTION
1.
2.
3.
E5-3
%/total
date
name
----------
----------
------------
--------
0% ( 0%)
0% ( 0%)
May 20 09:36
s1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
4.
Task complete.
6.
In this task, you will log into your assigned UNIX machine and completely fill lun0. You
will then take another Snapshot copy of the volume that contains lun0 and observe the effect.
STEP
ACTION
1.
Open a Telnet session with your assigned UNIX machine. Write 100% to lun0 by
entering the following command:
# dd if=/dev/zero of=foo bs=1k conv=notrunc
Verify the current disk usage:
# df -h
How much space is being used by lun0 on the UNIX
machine?___________________
2.
Open a Telnet session with storage system 1. Verify the current disk usage:
system> df -r vol_SAN0
How much space is being used by lun0 (contained in vol_SAN0) on the storage
system and how much space is reserved?
___________________________________________________________________
How much space is being used by Snapshot reserve on the storage system?
____________________________________________________________________
E5-4
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
5.
Task complete.
6.
In this task, you will log into your assigned UNIX machine and delete all data from lun0.
You will then observe the effect.
STEP
ACTION
1.
Open a Telnet session with your assigned UNIX machine. Delete all data from
lun0:
# rm foo
Verify the current disk usage:
2.
# df -h
How much space is being used by lun0 on the UNIX machine and how much
remains available?
____________________________________________________________________
Open a Telnet session with storage system 1. Verify the current disk usage:
3.
Task complete.
5.
In this task, you will log into your assigned UNIX machine and completely fill lun0 again.
You will then repeat this task until the vol_SAN1 volume is completely full and the Snapshot
fails.
STEP
ACTION
1.
Open a Telnet session with your assigned UNIX machine. Write 100% to lun0 by
entering the following command:
# dd if=/dev/zero of=foo bs=1k conv=notrunc
Verify the current disk usage:
# df -h
How much space is being used by lun0 on the UNIX
machine?____________________
E5-5
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
2.
Open a Telnet session with storage system 1. Verify the current disk usage:
To
KB changed
Time
Rate
--------------------------------------------------------s3
132
23s
20660.869
s2
s3
2035944
0d 00:13 9372632.225
s1
s2
2035832
0d 02:15
904144.485
Summary...
From Snapshot
(KB/hour)
To
KB changed
Time
Rate
--------------------------------------------------------s1
4071908
0d 02:28 1645030.726
NOTE: the deltas of S1 and S2 are roughly equal to the size of the lun0.
4.
E5-6
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
5.
From your Telnet session with your assigned UNIX machine, delete all the data
within the lun0 by entering the following command:
# rm foo
Repeat steps 1-5, incrementing the Snapshot name (that is, s4, s5...) until the
Snapshot command fails in step 3.
6.
Task complete.
8.
In this task, you will log into your assigned storage system 1 and change Snapshot Autodelete
Policy. You will then observe the effect.
STEP
ACTION
1.
Open a Telnet session with your assigned storage system 1. Note that when a
volume is full and the system can no longer create a Snapshot copy, you can either
delete Snapshot copies to free up disk space or grow the volume. We will explore
the Snapshot autodelete policy. Check out the current Snapshot autodelete policy
options :
system> snap autodelete vol_SAN0
Record the current options:
commitment:
_________________________________________________________
trigger:
______________________________________________________________
target_free_space:
______________________________________________________
E5-7
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
delete_order:
__________________________________________________________
defer_delete:
__________________________________________________________
prefix:
_______________________________________________________________
2.
3.
system> df -rh
4.
Open a Telnet session with your assigned UNIX machine. Write 100% to lun0 by
entering the following command:
# dd if=/dev/zero of=foo bs=1k conv=notrunc
5.
system> df -rh
7.
Task complete.
END OF EXERCISE
E5-8
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
SAN
SAN
Management
Management
Exercise
Module 6: SAN Management
Estimated Time: 45 minutes
OBJECTIVES
By the end of this exercise, you should be able to clone and remove a LUN for your assigned
UNIX and Windows machine.
TIME ESTIMATE
45 minutes
E6-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
E6-2
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
38
START OF EXERCISE
In this task, you will log into your assigned storage system 1 and clone lun0 and mount it on
your assigned UNIX machine.
STEP
ACTION
1.
You are going to clone lun0 in this task. However, the clone will appear within the
same volume as the original LUN. To ensure that vol_SAN0 has enough space, we
will delete all Snapshot copies within vol_SAN0:
system> snap delete -a vol_SAN0
2.
3.
4.
Now create a writable Snapshot of that LUN. In our example the command to do
this would be:
%/total
date
name
----------
----------
------------
--------
0% ( 0%)
0% ( 0%)
May 20 14:48
mysnap
(busy,LUNs)
NOTE: mysnap is busy because it is being used as the backing for a LUN
clone.
Next, execute the following command to verify the status of the LUN clone:
NOTE: the backing Snapshot is displayed.
system0> lun show -v /vol/vol_SAN0/lun0_clone
/vol/vol_SAN0/lun0_clone 2g (2147483648) (r/w, online)
Comment: "Unix LUN accessed via FCP"
Serial#: C4b-K4IQ2C4s
Backed by: /vol/vol_SAN0/.snapshot/mysnap/lun0
E6-3
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Share: none
Space Reservation: enabled
Multiprotocol Type: solaris
6.
With your assigned UNIX PuTTY Telnet window, verify that the UNIX machine
can see lun0_clone by entering the following command:
# devfsadm
Verify that the UNIX machine identified with the Host Utilities Kit:
# sanlun lun show
Identify your new disk by referring to the disk name and locating the LUN ID. If
the disk name is c2t500A098196F7C786d99, then the LUN ID is after the d,
which, in this example, is 99.
Select the disk by entering its corresponding number.
Next, label it by entering y.
Finally, exit the format command by entering quit.
Mount the LUN on the path that you just created.
# mount /dev/dsk/lun0_clone /mnt/lun0_clone
E6-4
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
9.
The final step is to make a stand-alone clone of the writeable Snapshot. In our
example you would use the following command:
system> lun clone split start /vol/vol_SAN0/lun0_clone
While the LUN is being split, get the status of the process:
10.
11.
Verify:
system> lun show -v /vol/vol_SAN0/lun0_clone
/vol/vol_SAN0/lun0_clone 2g (2147483648) (r/w, online)
Comment: "Unix LUN accessed via FCP"
Serial#: C4b-K4IQ2CAv
Share: none
Space Reservation: enabled
Multiprotocol Type: solaris
12.
Task complete.
14.
In this task, you will log into your assigned storage system 1 and clone lun3 and mount it on
your assigned Windows machine.
STEP
1.
ACTION
2.
E6-5
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
3.
4.
Now create a writable Snapshot of that LUN. In our example the command to do
this would be:
6.
On your assigned remote Windows machine, open the Disk Management tool
again.
If an offline LUN is not visible, right-click on the Disk Management icon within the
tree and select Rescan Disks from the menu.
After a while, the LUN should appear.
Select the new LUN and make it online by right-clicking the Disk # and select
Online.
7.
Next, we will initialize the LUN. Right-click on the Disk # and select Initialize.
Choice an MBR partition style and click OK.
8.
Now is the time to provision the LUN. We will use the New Simple Volume
method, which is available for both Windows Server 2003 and Windows Server
2008.
Right-click on the new unallocated disk and select New Simple Volume from the
menu. The New Simple Volume Wizard should begin. Provision it so you will be
able to access it.
9.
After a moment, the LUN should be available. Navigate to the mount location of
the LUN and write a test file to the LUN to verify it is working correctly.
10.
The final step is to make a stand-alone clone of the writeable Snapshot. In our
example you would use the following command:
system> lun clone split start /vol/vol_SAN3/lun3_clone
11.
While the LUN is being split, get the status of the process:
system> lun clone split status /vol/vol_SAN3/lun3_clone
13.
When the cloning process is complete, delete the original Snapshot you created.
system> snap delete vol_SAN3 mysnap
14.
Task complete.
15.
E6-6
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned storage system 1 and remove the cloned LUN so
your assigned UNIX machine will no longer have access to it.
STEP
ACTION
1.
Log in to a Telnet session for your assigned UNIX machine. If you have any
applications accessing the LUN mountpoint, you would stop those programs. Next
we will take the LUN offline. Use luxadm probe to identify the device path.
# luxadm probe
No Network Array enclosures found in /dev/es
Found Fibre Channel device(s):
Node WWN:500a0980869832e4
Logical Path:/dev/rdsk/c2t500A0981869832E4d0s2
Next we will unconfigure the disk. Use cfgadm -al to identify the OS Device
Name:
# cfgadm -al -o show_SCSI_LUN
Ap_Id
Condition
Type
Receptacle
Occupant
c0
unknown
scsi-bus
connected
configured
c1
unknown
fc-fabric connected
configured
c1::10000000c92d9f8a
unknown
unknown
connected
unconfigured
c1::10000000c92da0c4
unknown
unknown
connected
unconfigured
c1::10000000c92db0c1
unknown
unknown
connected
unconfigured
connected
configured
...
c1::500a098186f7c786,0 disk
unusable
c2
unknown
fc-fabric connected
unconfigured
...
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
3.
The LUN is now inaccessible by the UNIX machine. Log in to storage system 1s
Telnet session and take the LUN offline:
4.
5.
6.
Task complete.
8.
In this task, you will log into your assigned storage system 2 and remove the cloned LUN so
your assigned Windows machine will no longer have access to it.
STEP
ACTION
1.
On your assigned remote Windows machine, open the Disk Management tool
again.
2.
If you have any applications accessing the LUN mountpoint, you would stop those
programs. Next we will take the LUN offline.
Identify the lun3_clone disk with the Disk Management tool. Right-click on the
Disk # and select Offline.
3.
The LUN is now inaccessible from the Windows machine. Log in to storage
system 2s Telnet session and take the LUN offline:
system2> lun offline /vol/vol_SAN3/lun3_clone
4.
5.
Task complete.
END OF EXERCISE
E6-8
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
SnapDrive
SnapDrive
MODULE 7: SNAPDRIVE
Exercise
Module 7: SnapDrive
Estimated Time: 60 minutes
EXERCISE: SNAPDRIVE
OVERVIEW
OBJECTIVES
By the end of this exercise, you should be able to install and implement basic functionality
with SnapDrive 4.0 for UNIX and SnapDrive 6.0 for Windows.
TIME ESTIMATE
60 minutes
E7-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
E7-2
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
43
START OF EXERCISE
In this task, you will log into your assigned Windows machine and set up an account for ftp
authentication in the SnapDrive 6.0 for Windows service.
STEP
ACTION
1.
On your assigned remote Windows machine, open Computer Management by rightclicking the Local Computer icon and selecting Manage from the menu.
The Computer Management MMC should appear.
2.
Under the System Tools node, select Local Users and Groups node. Then click the
Groups folder from the main content pane.
3.
The domain controller should already have a user set up called SDService. This
user will be used to authenticate the SnapDrive service, so we need to add this as a
local user.
Double-click on the Administrators group.
Click the Add button to add a new user to the local administrators group.
4.
Type SDService within the object name and validate the name by clicking the
Check Name button.
If it is properly resolved, click the OK button.
Verify that the SDService was added to the local administrators group.
5.
7.
Task complete.
8.
In this task, you will log into your assigned Windows machine and install SnapDrive 6.0 for
Windows.
STEP
ACTION
1.
On the title slide, select Next. Agree to the ELUA and then click Next.
3.
Add the license key as provided by the instructor and click Next.
4.
5.
6.
Within the SnapDrive Service Credentials dialog, enter the SDService account
name and password you configured in the last task.
E7-3
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
8.
Select the Transport Protocol Default Setting by enabling RPC and click Next.
9.
10.
11.
12.
Task complete.
13.
In this task, you will log into your assigned Windows machine and access the newly installed
SnapDrive for Windows.
STEP
ACTION
1.
On your assigned remote Windows machine, launch Server Manager by rightclicking on the Windows Computer icon and selecting Manage from the drop-down
list.
2.
Expand the Storage node and select the SnapDrive icon. SnapDrive should launch
within the MMC. You should see that your assigned Windows machine is in the
SnapDrive Instances Managed list and has a status of Connected.
3.
Expand the SnapDrive node and select Storage System Management. No storage
system will be listed.
Right-click on the Storage System Management icon and select Add Storage
System.
Type in either your assigned storage system 2s host name or IP address and click
Add.
4.
Expand the Storage System Management node and select the node of your storage
system. Provide roots user name and password if prompted. Note that FilerView
will launch within MMC.
5.
Under the SnapDrive node, select the node of your local Windows machine. You
can see the SnapDrive for Windows version along with the various configuration
information of your Windows machine.
6.
Expand the local Windows machine node and select Disk. The system will
enumerate through your disks and display all attached LUNs.
7.
Right-click on the Disks icon and select Create Disk from the drop-down menu.
The Create Disk Wizard should begin.
8.
Select Next at the Welcome page of the wizard. At the Storage System Name dropdown list, pick your storage system 2.
Select vol_SAN2. It should be populated in the LUN Path drop-down list.
Type in lun4 in the LUN Name textbox.
E7-4
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Choose Dedicated from the Select a LUN Type wizard page and click Next.
10.
11.
On the Important Properties of the Storage System Volume wizard page, accept the
default setting and click Next.
12.
Within the select Initiators wizard page, select one of initiators (either Fibre
Channel or iSCSI).
We have not installed Device Specific Module (DSM) 3.2 on the Windows machine
yet, so select only one initiator.
13.
14.
Within the Completing the Create Disk Wizard page, verify your configuration and
select Finish if correct.
15.
The LUN should now be created and mounted as a T drive on your Windows
machine.
Open with Windows Explorer and click the T drive.
Create a Notepad file called test.txt to verify the LUN is working.
16.
Task complete.
17.
In this task, you will create a Snapshot, delete a file, and restore the file with SnapDrive for
Windows.
STEP
ACTION
1.
Within the SnapDrive MMC, expand Disks and select the newly created LUN.
Right-click and select Create Snapshot.
2.
3.
4.
Next you will restore the file from the LUNs Snapshot. We need to license
SnapRestore. Open a Telnet session to your assigned storage system 2.
Check to see if SnapRestore is licensed by typing:
system1> license
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
code.
system1> license add XXXXXX
Within the SnapDrive MMC, expand the newly created LUN node and select
Snapshot Copies. A list of the Snapshot copies should appear. Find and select the
Snapshot you created in step 2 of this task named SDWTest.
5.
Navigate to the T drive and verify that the file Test.txt has been restored.
7.
Task complete.
8.
In this task, you will log into your assigned UNIX machine and install SnapDrive for UNIX.
STEP
ACTION
1.
With your assigned UNIX PuTTY Telnet window, copy the SnapDrive file to the
_Work directory:
# cd /_files/SANAdmin
# cp NTAPsnapdrive_sun_4.0.tar.Z /_work
2.
Navigate to the /_work directory and uncompress the SnapDrive install. Then exact
the resulting file.
# cd /_work
# uncompress NTAPsnapdrive_sun_4.0.tar.Z
# tar -xvf NTAPsnapdrive_sun_4.0.tar
3.
Install SnapDrive:
# cd NTAPsnapdrive_sun_4.0
# ./install
4.
E7-6
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
# ls
bin
diag
docs
snapdrive.conf
SnapDrive 4.0 for UNIX defaults to use HTTPS. We will need to configure SSL on
a storage system to communicate over HTTPS.
5.
Task complete.
6.
In this task, you will log into your assigned storage system 1 and configure SSL.
STEP
ACTION
1.
2.
Navigate to the SSL configuration page and generate a certificate performing the
following tasks:
Main Menu -> Secure Admin -> SSL
Select: Configure
Generate a certificate by clicking Generate Certificates
Leave the all the default settings and click the Generate Certificates button.
Confirm by clicking the OK button.
Verify it was successful by the following return response:
Certificate Signing Request (CSR) and self-signed
server certificate are successfully generated.
3.
Select: Enable/Disable
It should already be enabled.
4.
Task complete.
5.
E7-7
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned storage system 1 and create a new igroup.
STEP
ACTION
1.
2.
Navigate to the SSL configuration page and generate a certificate performing the
following tasks:
Main Menu -> LUNs -> Initiator Groups
Select Add
Create an igroup with the following information:
Name: my_ig
Type: FCP
Operating System: Solaris
Initiators: Type in the WWPN of the active Solaris 10s HBA.
Click Add button.
Verify the igroup was created successfully:
3.
4.
Task complete.
5.
In this task, you will log into your assigned UNIX machine and edit the /etc/hosts file.
STEP
ACTION
1.
SnapDrive for UNIX requires a reverse DNS look-up. To insure proper name
resolution, you will edit the /etc/hosts file with VI: At the command line of your
assigned UNIX Telnet PuTTY window, enter the following:
# vi /etc/hosts
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Type the IP address and then the host name of your assigned storage system 1.
Click the ESC button to go into command mode. Type : and then wq! to save the
file and exit.
Verify the change you made:
2.
# cat /etc/hosts
3.
Task complete.
4.
In this task, you will log into your assigned Windows machine and set up an account for ftp
authentication in the SnapDrive 6.0 for Windows service.
STEP
ACTION
1.
Navigate to the SnapDrive location bin directory and start the daemon:
# cd /opt/NTAPsnapdrive/bin
# snapdrived start
2.
# snapdrived status
Snapdrive Daemon Version
Apr 22 01:09:49 PDT 2008)
: 4.0
: 0
Job Status:
No command in execution
3.
Task complete.
4.
In this task, you will create a LUN with SnapDrive for UNIX.
STEP
ACTION
1.
The Solaris operating system requires some preparation before creating new LUNs
using the snapdrive config command.
First, determine what permissions are allowed on the Solaris host for storage system
1.
# snapdrive config access list storage_system_1_IP
This host has the following access permissions to filer,
E7-9
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
storage_system_1_IP
ALL ACCESS
Commands allowed:
snap create
snap restore
snap delete
snap rename
storage create
storage resize
snap connect
storage connect
storage delete
snap disconnect
storage disconnect
2.
Hit the <CR> twice to enter an empty password for root (if root does not have a
password). Otherwise, enter roots password.
3.
where system is your assigned storage system 1s IP address and my_ig is the
igroup you created in a previous task of this module.
4.
lost+found
5.
Task complete.
6.
E7-10
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will create a Snapshot, delete a file, and restore the file with SnapDrive for
UNIX.
STEP
ACTION
1.
Next create a Snapshot named my_snap of the LUN by entering the following
command:
# snapdrive snap create -fs /mnt/lun5 -snapname my_snap
Now we will delete the foo file that was created earlier. Verify that you are still in
the LUN mountpoint:
# pwd
/mnt/lun5
Now, restore the file. First, navigate out the directory by entering the following
command:
# cd ..
5.
Task complete.
END OF EXERCISE
E7-11
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Multipathing
Multipathing
In FC
In
FC
MODULE 8: MULTIPATHING IN FC
Exercise
Module 8: Multipathing in FC
Estimated Time: 60 minutes
EXERCISE: MULTIPATHING IN FC
OVERVIEW
OBJECTIVES
By the end of this exercise, you should be able to configure a multipath FC environment for
UNIX and Windows.
TIME ESTIMATE
60 minutes
E8-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
E8-2
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
59
START OF EXERCISE
Up to this point, you have only used storage system 1 for FC SAN. In this task, you will log
into your assigned storage system 2 and enable an FC HBA adapter.
STEP
ACTION
1.
Investigate whether your storage system has the required HBAs. Within your
assigned storage system 2 PuTTY Telnet window, enter the following command:
system2>
sysconfig
Memory Size:
3072 MB
00:a0:98:03:28:4a (auto-1000t-fd-up)
00:a0:98:03:28:4b (auto-unknown-cfg_down)
00:a0:98:03:28:48 (auto-unknown-cfg_down)
00:a0:98:03:28:49 (auto-unknown-cfg_down)
476.0GB
952.0GB
245MB
slot 3: NVRAM
Memory Size:
512 MB
It looks like the storage system has two HBA adapters named 0c and 0d.
E8-3
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
2.
Enter the following command to verify whether the Fibre Channel Protocol service
is running.
system2> fcp status
Find fcp and verify it is licensed. If not, enter the license code as provided by your
instructor.
system2> license XXXXXX
Now, lets start the FCP services by entering the following command:
system2> fcp start
Slot:
0c
Description:
Fibre Channel Target Adapter 0c (Dualchannel, QLogic 2322 (2362) rev. 3)
Adapter Type:
Local
Status:
OFFLINED BY USER/SYSTEM
FC Nodename:
(500a098086f7c786)
50:0a:09:80:86:f7:c7:86
FC Portname:
(500a098186f7c786)
50:0a:09:81:86:f7:c7:86
Standby:
No
Slot:
0d
Description:
Fibre Channel Target Adapter 0d (Dualchannel, QLogic 2322 (2362) rev. 3)
E8-4
Adapter Type:
Local
Status:
OFFLINED BY USER/SYSTEM
FC Nodename:
(500a098086f7c786)
50:0a:09:80:86:f7:c7:86
FC Portname:
(500a098286f7c786)
50:0a:09:82:86:f7:c7:86
Standby:
No
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Slot:
0c
Description:
Fibre Channel Target Adapter 0c (Dualchannel, QLogic 2322 (2362) rev. 3)
Adapter Type:
Local
Status:
ONLINE
FC Nodename:
(500a098086f7c786)
50:0a:09:80:86:f7:c7:86
FC Portname:
(500a098186f7c786)
50:0a:09:81:86:f7:c7:86
Standby:
No
Slot:
0d
Description:
Fibre Channel Target Adapter 0d (Dualchannel, QLogic 2322 (2362) rev. 3)
6.
Adapter Type:
Local
Status:
OFFLINED BY USER/SYSTEM
FC Nodename:
(500a098086f7c786)
50:0a:09:80:86:f7:c7:86
FC Portname:
(500a098286f7c786)
50:0a:09:82:86:f7:c7:86
Standby:
No
Now that one of your HBA adapters is enabled on storage system 1, lets
investigate what effect this has on the FC switch. Switch to your FC switch PuTTY
Telnet window and at the prompt type the following:
switch> switchshow
switchName:
E8-5
switch
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
switchType:
16.2
switchState:
Online
switchMode:
Native
switchRole:
Principal
switchDomain:
switchId:
fffc01
switchWwn:
10:00:00:60:69:c0:0b:e4
switchBeacon:
OFF
Zoning:
OFF
port
0: id N2 Online
port
1: id N2 No_Light
port
2: id N2 Online
port
3: id N2 No_Light
port
4: id N2 Online
port
5: id N2 No_Light
port
6: id N2 Online
port
7: id N2 No_Light
F-Port 50:0a:09:81:96:f7:c7:86
F-Port 50:0a:09:81:86:f7:c7:86
F-Port 10:00:00:00:c9:2d:a0:63
F-Port 10:00:00:00:c9:2d:9f:76
Now, for convenience, lets alias the initiators WWPN on the storage system.
Switch back to the PuTTY Telnet window that is connected to storage system 2.
Enter the following command:
system2> fcp show initiators
Group
--------
-----
10:00:00:00:c9:2d:9f:76
10:00:00:00:c9:2d:a0:63
E8-6
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
8.
Verify:
system2> fcp wwpn-alias show
WWPN
Alias
----
----
10:00:00:00:c9:2d:a0:63
UNIX1-FC
10:00:00:00:c9:2d:9f:76
Win1-FC
Group
--------
-----
10:00:00:00:c9:2d:9f:76
WWPN Alias(es): Win1-FC
10:00:00:00:c9:2d:9f:8a
10:00:00:00:c9:2d:a0:63
WWPN Alias(es): UNIX1-FC
9.
Task complete.
10.
E8-7
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned storage systems and enable the second interface.
STEP
ACTION
1.
With your assigned storage system 1 PuTTY Telnet window, determine what
interfaces are currently enabled:
system> fcp config
With your assigned storage system 2 PuTTY Telnet window, determine what
interfaces are currently enabled:
system2> fcp config
Verify that on your assigned Fibre Channel switch that ports 1 and 3 are now online
by entering the following command at the switch:
switch> switchshow
6.
Task complete.
7.
E8-8
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned storage systems and set them for an active-active
configuration.
STEP
ACTION
1.
Is it enabled? ____________________________________
2.
Is it single_image? _________________________________________________
If it is not single_image, place the storage system into single_image cfmode by
entering the following command:
system> fcp set cfmode single_image
Verify:
system> fcp show cfmode
4.
Is it enabled? ____________________________________
6.
E8-9
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
7.
Is it single_image? _________________________________________________
If it is not single_image, place the storage system into single_image cfmode by
entering the following command:
system> fcp set cfmode single_image
Verify:
system> fcp show cfmode
8.
system> cf enable
Task complete.
10.
In this task, you will log into your assigned UNIX machine and enable the second HBA
adapter.
STEP
ACTION
1.
Within your UNIX PuTTY Telnet window, investigate whether your UNIX
machine has attached FC HBAs. Enter the following command:
# prtdiag | grep fibre-channel
pci
33 +tem-board/PCI3
okay
pci
33 +tem-board/PCI2
okay
fibre-channel-pci1077,2312
/pci@1f,0/pci@5/fibre-channel@0
fibre-channel-pci10df,f900 LP9002L
/pci@1f,0/pci@5/fibre-channel@1
We have already enabled the Emulex. We will now enable the QLogic HBA.
2.
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
3.
Type the line number you recorded above and a capital G. For example:
451G
After a few minutes, log back into the UNIX Telnet sessions using the techniques
discussed earlier.
4.
Lets make sure that the HBA is running. Enter the following command:
# fcinfo hba-port
...
HBA Port WWN: 210000e08b09e4a1
OS Device Name: /dev/cfg/c2
Manufacturer: QLogic Corp.
Model: QLA2342
Firmware Version: 3.3.117
FCode/BIOS Version: No Fcode found
Type: N-port
State: online
Supported Speeds: 1Gb 2Gb
Current Speed: 2Gb
Node WWN: 200000e08b09e4a1
E8-11
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Record the adapters WWPN (HBA Port WWN) and OS Device Name on the
Master Configuration Worksheet under UNIX Adapter 2.
Now that we have verified the QLogic HBA adapter is enabled on the UNIX
machine, switch to your FC switch PuTTY Telnet window and at the prompt type
the following:
5.
switch> switchshow
Task complete.
7.
In this task, you will log into your assigned UNIX machine and access the FCP lun0 from
storage system 1 by way of multiple paths.
STEP
ACTION
1.
To verify that the UNIX machine is not using a non-ALUA multipathing method,
run the following command from the Host Utilities Kit:
# mpxio_set -d
2.
Normally, we would also run the basic_config -ssd_set command but we have
already done that. Verify:
# cat /kernel/drv/ssd.conf
#
# Copyright 2003 Sun Microsystems, Inc.
"@(#)ssd.conf
1.14
03/10/07 SMI"
LUN", "netapp-ssd-config";
netapp-ssdconfig=1,0x9007,64,300,30,0,0,0,0,0,0,0,0,0,30,0,0,8,0,0;
#
#
E8-12
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
3.
Wait until the UNIX machine returns from the reboot before continuing on to the
next step.
5.
Verify connectivity with switch by entering the following command on the UNIX
machine:
# luxadm -e port
Verify:
system> igroup show v
8.
Verify:
system> igroup show -v
What interfaces are logged into the WWPNs within this igroup?
___________________________________________________________________
Verify igroup-to-LUN mapping:
system> lun show -m
E8-13
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
LUN path
Mapped to
LUN ID
Protocol
-----------------------------------------------------------
9.
/vol/vol_SAN0/lun0
iUNIX_fcp
FCP
/vol/vol_SAN1/lun1
iWIN_iscsi
iSCSI
Determine whether UNIX can view the LUN by entering the following command:
# cfgadm -al -o show_SCSI_LUN
To determine which WWPN C1 and C2 refer to, see the Master Configuration
Worksheet.
What LUN ID do you see within the output? ______________________________
Do both UNIX interfaces see all 4 WWPNs on the active-active pair?
_____________
10.
Determine how many devices UNIX has assigned to the lun0 by entering the
following command:
# luxadm probe
Examine the paths available to the character device by entering the following
command:
#luxadm display character_device_logical_path
You should have 4 entries for the UNIX HBA #1 and 4 entries for the UNIX
HBA#2.
Are 2 of the paths primary for HBA#1 and 2 of the paths secondary?
______________
12.
13.
E8-14
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
14.
Task complete.
15.
In this task, you will log into your assigned Windows machine and install DSM 3.2 for
Windows.
STEP
ACTION
1.
Even though you havent enabled a second HBA yet (that is coming in the next
task), you have configured the storage systems with multiple paths. If you open up
Disk Management and/or the Device Manager and expand the Disk node, you
should see several new disks available.
NOTE: We havent created any new LUNs. The operating system now sees these
new paths to the same LUN and misinterprets them as new LUNs. In this task, you
will install NetApp DSM 3.2 for Windows to correct this problem.
2.
After a while the DSM Wizard will appear with the title page; click Next to
continue.
Agree to the EULA and click Next.
4.
5.
In the Data ONTAP DSM Management Service Credentials wizard page, add the
administrators login and password as provided by your instructor and click Next to
continue.
6.
In the Protocol Support wizard page, accept both Fibre Channel and iSCSI LUNs to
be managed and click Next.
7.
8.
Accept the default destination folder by clicking Next. Finally, click the Install
button to continue.
9.
After the install, click the Finish button and answer Yes at the prompt to reboot.
10.
Task complete.
11.
E8-15
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned Windows machine and access the FCP lun3 from
storage system 2 by way of multiple paths.
STEP
ACTION
1.
2.
Within Windows Server 2008, expand the Storage Management node and locate the
QLogic Fibre Channel Adapter by right-clicking on it and selecting Enable from the
drop-down menu.
3.
Verify that on your assigned Fibre Channel switch that port 8 is now online by
entering the following command at the switch:
switch> switchshow
Task complete.
5.
In this task, you will log into your assigned Windows machine and access the FCP lun3 from
storage system 2 by way of multiple paths.
STEP
ACTION
1.
On your assigned storage system 2, you need to add the new HBAs WWPN to the
iWIN_fcp. Check the current members of the iWIN_fcp group by entering the
following command:
system2> igroup show
2.
Now, for convenience, alias the initiators WWPN on the storage system.
Switch back to the PuTTY Telnet window that is connect to storage system 2. Enter
the following command:
system2> fcp show initiators
Verify that storage system 2 can see the Windows QLogic HBAs WWPN.
To alias the UNIX machines WWPN, type:
system2> fcp wwpn-alias set Win2-FC Windows_QLogic_WWPN
3.
Verify:
system2> igroup show
E8-16
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
4.
Launch Storage Manager and expand the storage node. The Data ONTAP DSM
Management snap-in should be available. Expand the Data ONTAP DSM
Management node and the virtual disks should be viewable.
Select Disk 1. This should be your lun3. NOTE: the disk number will be the same
as the disk number of your LUN within the Disk Management tool.
5.
Within the tree menu item, right-click the Disk 1 under Virtual Disks and set the
Load Balance Policy to Least Queue Depth.
The load should be spread across your QLogic and Emulex HBA.
Experiment with the different load-balancing policies.
6.
Task complete.
END OF EXERCISE
E8-17
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Multipathing
Multipathing
In iSCSI
In
iSCSI
Exercise
Module 9: Multipathing in iSCSI
Estimated Time: 60 minutes
OBJECTIVES
By the end of this exercise, you should be able to configure a multipath iSCSI environment
for UNIX and Windows.
TIME ESTIMATE
60 minutes
E9-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
E9-2
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
53
START OF EXERCISE
In this task, you will log into your assigned UNIX machine and verify that MPxIO is enabled.
If you correctly configured your assigned UNIX machine for FC multipathing, then this task
has already been completed.
STEP
ACTION
1.
The UNIX machines in this exercise environment do not have multiple network
interfaces. Therefore, we are unable to implement link aggregation called IP
Multipath (IPMP). We will instead use the MPxIO technique through Multiple
Target Portal IDs.
2.
We have already run the basic_config -ssd_set command. Verify by analyzing the
ssd.conf file:
# cat /kernel/drv/ssd.conf
#
# Copyright 2003 Sun Microsystems, Inc.
"@(#)ssd.conf
1.14
03/10/07 SMI"
LUN", "netapp-ssd-config";
netapp-ssdconfig=1,0x9007,64,300,30,0,0,0,0,0,0,0,0,0,30,0,0,8,0,0;
#
3.
4.
The last step would be reboot. If you completed the FC multipathing exercise, this
has already been done. If not, then execute the following command:
# reboot -- -r
5.
Task complete.
6.
E9-3
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned storage system 2 and enable a second network
interface to use the iSCSI protocol..
STEP
ACTION
1.
Verify which paths are being currently used by the UNIX machine by entering the
following command:
system2> igroup show -v
iUNIX_iscsi (iSCSI):
OS Type: solaris
Member: iqn.1986-03.com.sun:01:0003ba0dd09e.47c88ebc
(logged in on: e0a)
Enable the e0b on the storage system 2 by entering the following command:
system2> ifconfig e0b ip_address up
NOTE: Normally, all interfaces are enabled for the iSCSI Service. This exercise
environment is configured with e0b disabled initially to prevent any multi-path
functionality.
4.
Verify the target portal groups on storage system2 by entering the following:
system2> iscsi tpgroup show
Task complete.
6.
E9-4
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned UNIX machine and connect to the eb0 interface
on storage system 2.
STEP
ACTION
1.
Configure your assigned UNIX machine to discover the second interface on storage
system 2 by entering the following:
# iscsiadm add discovery-address ip_address:3260
Verify that your assigned UNIX machine can see the new target portal group for
storage system 2 by entering the following:
# iscsiadm list target
Target: iqn.1992-08.com.netapp:sn.101173126
Alias: TPGT: 1001
ISID: 4000002a0000
Connections: 1
Target: iqn.1992-08.com.netapp:sn.101173126
Alias: TPGT: 1000
ISID: 4000002a0000
Connections: 1
Verify that the UNIX machine is logged into both storage system 2s interfaces:
system2> igroup show -v
iUNIX_iscsi (iSCSI):
OS Type: solaris
Member: iqn.1986-03.com.sun:01:0003ba0dd09e.47c88ebc
(logged in on: e0a, e0b)
ALUA: Yes
Note that the igroup records that the UNIX machine has logged into e0a and e0b
interfaces.
E9-5
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
4.
Task complete.
5.
In this task, you will log into your assigned storage system 2 and enable ALUA on an igroup
on storage system 2.
STEP
ACTION
1.
Verify which paths are being currently used by the UNIX machine by entering the
following command:
system2> igroup show -v
iUNIX_iscsi (iSCSI):
OS Type: solaris
Member: iqn.1986-03.com.sun:01:0003ba0dd09e.47c88ebc
(logged in on: e0a)
Enable the ALUA for the iUNIX_iscsi igroup on the storage system 2 by entering
the following command:
system2> igroup set iUNIX_iscsi alua yes
3.
Verify:
system2> igroup show -v
iUNIX_iscsi (iSCSI):
OS Type: solaris
Member: iqn.1986-03.com.sun:01:0003ba0dd09e.47c88ebc
(logged in on: e0a, e0b)
ALUA: Yes
NOTE: The igroup records that the UNIX machine has logged into e0a and e0b
interfaces.
4.
E9-6
Verify the iSCSI sessions and connections by entering the following commands:
system2>
system2>
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
5.
Task complete.
6.
In this task, you will log into your assigned storage system 2 and verify iSCSI multipath
connectivity.
STEP
ACTION
1.
How many sessions does storage system 2 have with your assigned UNIX machine?
2.
system2>
How many connections does each session have with your assigned UNIX machine?
3.
Task complete.
4.
In this task, you will log into your assigned UNIX machine and verify iSCSI multipath
connectivity.
STEP
ACTION
1.
Verify the iSCSI multipath connectivity to the LUN through the Host Utilities Kits
sanlun tool:
# sanlun lun show all p
E9-7
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
2.
Normally, if this was a new LUN we would have to format, label it, create a new
file system on it and mount it. These steps have already been done for this LUN.
The LUN should be ready to use at its mountpoint. If one of the interfaces fails on
storage system 2, then we will still have connectivity to the LUN. For resiliency,
we should have two or more interfaces on the UNIX machine.
4.
Task complete.
5.
In this task, you will log into your assigned storage system 1 and enable a second network
interface to use the iSCSI protocol.
STEP
ACTION
1.
Enable the e0b on the storage system 1 by entering the following command:
system> ifconfig e0b ip_address up
NOTE: Normally, all interfaces are enabled for the iSCSI Service. This exercise
environment is configured with e0b disabled initially to prevent any multipath
functionality.
E9-8
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
4.
Verify the target portal groups on storage system2 by entering the following:
system> iscsi tpgroup show
Task complete.
6.
In this task, you will log into your assigned Windows machine and configure a second iSCSI
session on Windows.
STEP
ACTION
1.
On your assigned remote Windows machine, open the iSCSI Initiator dialog.
2.
3.
You should already have a session with storage system 1. Under the Targets tab,
the Target should have a status of Connected.
Select the target and click the Details button.
Verify that there is only one session with the Target Properties dialog.
Here, in this example, there is only one session. The session is connected to Target
portal group 1000.
E9-9
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Which target portal on storage system 1 does this number relate to?
We will now create another session to the other target portal. Close the Target
Properties dialog.
4.
E9-10
From the Targets tab on the iSCSI Initiator Properties dialog, select the Target to
storage system 1 and click the Log on button.
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
The Log on to Target dialog should appear. Click the Enable multi-path checkbox.
To properly have a multiple path implementation, you need to tell Windows to use
the second network interface.
Click the Advanced button. The Advanced Setting dialog should appear.
Click the Local adapter and choose Microsoft iSCSI Initiator.
Click the Source IP and choose the Windows second IP address.
Click the Target portal and choose the second interface on storage system 1.
Click OK to close the Advanced Settings dialog.
Click OK to close the Log On to Target dialog.
NOTE: If you get an error stating, The target has already been logged in via an
iSCSI session, you either forgot to add the second IP address for storage system 1
to the discovery tab or you already have two sessions.
5.
6.
E9-11
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
7.
In this task, you will log into your assigned Windows machine and disable all iSCSI sessions
to the lun1 on storage system 1.
STEP
ACTION
1.
On your assigned remote Windows machine, open the iSCSI Initiator dialog.
Click the Targets tab.
Select the target to storage system 1 and click the Details button.
2.
With the Target Properties dialog, select the first sessions checkbox and click the
Log off button.
Select the second sessions checkbox and click the Log off button.
All session should be terminated now.
Close the Target Properties dialog by clicking the OK button.
3.
Task complete.
4.
E9-12
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned storage system 1 and reconfigure the target portal
groups so that e0a and e0b are in the same target portal group.
STEP
ACTION
1.
Verify the current configuration of the target portal groups by entering the
following command:
system>
Are e0a and e0b together in the same target portal group?
______________________
Execute the following command to place e0a and e0b into the same target portal
group called mytp:
2.
system2>
Verify:
system>
Task complete.
4.
In this task, you will log into your assigned Windows machine and access the iSCSI lun1
from storage system 1.
STEP
ACTION
1.
On your assigned remote Windows machine, open the iSCSI Initiator dialog.
Click on the Discovery tab.
Confirm that both IP addresses of storage system 1 are still set to be discovered as
target portals.
2.
E9-13
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
E9-14
Confirm that the session and first connection where created by selecting Details on
the target and looking at the Target Properties.
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Task complete.
5.
E9-15
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned storage system 1 and verify iSCSI multipath
connectivity.
STEP
ACTION
1.
How many sessions does storage system 1 have with your assigned Windows
machine?
________________
Verify the iSCSI connections by entering the following commands:
2.
system>
How many connections does the session have with your assigned Windows
machine?
________________
3.
Task complete.
4.
In this task, you will log into your assigned Windows machine and create the second
connection to storage system 1 using a multiconnection session.
STEP
ACTION
1.
On your assigned remote Windows machine, open the iSCSI Initiator dialog.
2.
3.
You will change the load-balance policy by selecting the drop-down list and choose
the Least Queue Depth. This is not essential. However, the Least Queue Depth is
one of the preferred load-balancing policies. The choice of policy will be
determined by your business and IT policy. Note: some load-balancing policies
will only use the connection if other connections have failed.
Select the Add and the Add Connection dialog will appear.
Click Advanced to open the Advanced Settings dialog.
To ensure proper multipathing, select a different Source IP and Target portal than
the first connection.
E9-16
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Task complete.
5.
In this task, you will log into your assigned storage system 1 and verify iSCSI multipath
connectivity.
STEP
ACTION
1.
How many sessions does storage system 1 have with your assigned Windows
machine?
__________________
Verify the iSCSI connections by entering the following commands:
2.
system>
How many connections does the session have with your assigned Windows
machine?
__________________
Task complete.
3.
TASK 15: OPTIONAL: ACCESS A LUN USING FCP AND iSCSI WITH DSM 3.2
In this optional task, you will log into your assigned Windows machine and access the FCP
lun3 from storage system 2 using iSCSI.
STEP
ACTION
1.
In the previous module, you created multiple FC paths to lun3. We will now an
iSCSI path to that LUN. This is a newly support feature with NetApp DSM 3.2.
On your assigned remote Windows machine, verify that the lun3 is still connected
by way of FCP.
2.
E9-17
Next, create a new igroup called iWIN_iscsi on storage system 2 that contains the
WWNN for your assigned Windows machine.
Exercises: SAN Administration on Data ONTAP 7.3: Multipathing in iSCSI
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
3.
4.
From your assigned Windows machine, open the iSCSI Initiator Properties dialog
box and add the storage system 2s IP address as a target to discover.
5.
Click the Targets tab and connect to the storage system 2s inactive target. Note:
enable multipath to the connection.
6.
Open the DSM 3.2 snap-in and identify the virtual disk that is associated with lun3.
The iSCSI path should appear in the list of possible paths along with the FC paths.
NOTE: if the iSCSI path reports a passive state, you might have to take all the FC
HBAs offline. Right-click on the iSCSI path and choose Set Active and then make
the FC HBAs available again.
Both the FC and iSCSI paths should now be active.
7.
Task complete.
END OF EXERCISE
E9-18
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
SAN
SAN
Troubleshooting
Troubleshooting
Exercise
Module 10: SAN Troubleshooting
Estimated Time: None
EXERCISE
There is no exercise for this module
E10-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Appendix
Appendix A A
A-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
MODULE 1: INTRODUCTION
Answers
Module 1: Introduction
A-2
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
33
A-3
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
MODULE 2: FC CONNECTIVITY
Answers
Module 2: FC Connectivity
A-4
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
57
EXERCISE: FC CONNECTIVITY
TASK 3: ENABLE AN FC HBA ON WINDOWS
In this task, you will enable an FC HBA adapter on the remote Windows machine.
STEP
2.
ACTION
Now that one of your FC HBA adapters is enabled on the Windows machine,
lets investigate what effect this has on the FC switch. Return to your FC switch
PuTTY Telnet window and at the prompt type the following:
switch> switchshow
switchName:
switch
switchType:
16.2
switchState:
Online
switchMode:
Native
switchRole:
Principal
switchDomain:
switchId:
fffc01
switchWwn:
10:00:00:60:69:c0:0b:e4
switchBeacon:
OFF
Zoning:
OFF
port
0: id N2 No_Light
port
1: id N2 No_Light
port
2: id N2 No_Light
port
3: id N2 No_Light
port
4: id N2 No_Light
port
5: id N2 No_Light
port 6: id N2 Online
10:00:00:00:c9:2d:9f:76
port
F-Port
7: id N2 No_Light
NOTE: To reuse prior commands, press the ESC key and use the K or J key to
move up or down respectively in the command history.
Record the WWPN for port 6 on the Master Configuration Worksheet. Notice
that port 6 has is now online. Compare the F-Port WWPN of Port 6 to the HBAs
WWPN on your Windows machine.
Are they the same? Yes.
A-5
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned UNIX machine and enable an HBA adapter.
STEP
2.
ACTION
5.
Now that we have verified the Emulex HBA adapter is enabled on the UNIX
machine, lets investigate what effect this has on the FC switch. Switch to your
FC switch PuTTY Telnet window and at the prompt type the following:
switch> switchshow
switchName:
switch
switchType:
16.2
switchState:
Online
switchMode:
Native
switchRole:
Principal
switchDomain:
switchId:
fffc01
switchWwn:
10:00:00:60:69:c0:0b:e4
switchBeacon:
OFF
Zoning:
OFF
port
0: id N2 No_Light
port
1: id N2 No_Light
port
2: id N2 No_Light
port
3: id N2 No_Light
port 4: id N2 Online
10:00:00:00:c9:2d:a0:63
port
5: id N2 No_Light
port
6: id N2 No_Light
port
7: id N2 No_Light
F-Port
A-6
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Answers
Module 3: iSCSI Connectivity
A-7
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
57
In this task, you will log into your assigned storage system 1 and configure iSCSI.
STEP
ACTION
1.
Within your assigned storage system 1 PuTTY Telnet window, enter the following
command to investigate the current iSCSI sessions:
system>
In this task, you will log into your assigned storage system 2 and confirm an iSCSI session
was established by UNIX.
STEP
ACTION
1.
Within your assigned storage system 2 PuTTY Telnet window, enter the following
command to investigate the current iSCSI sessions:
system2>
A-8
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Answers
Module 4: LUN Access
A-9
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
53
A-10
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Answers
Module 5: LUN Provisioning
A-11
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
44
In this task, you will log into your assigned storage system 1 and create a Snapshot copy of
vol_SAN0 which contains lun0.
STEP
ACTION
1.
2.
In this task, you will log into your assigned UNIX machine and completely fill lun0. You
will then take another Snapshot copy of the volume that contains lun0 and observe the effect.
STEP
ACTION
1.
Open a Telnet session with your assigned UNIX machine. Write 100% to lun0 by
entering the following command:
# dd if=/dev/zero of=foo bs=1k conv=notrunc
Verify the current disk usage:
# df -h
How much space is being used by lun0 on the UNIX machine? 2 GB
A-12
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
2.
Open a Telnet session with storage system 1. Verify the current disk usage:
system> df -r vol_SAN0
How much space is being used by lun0 (contained in vol_SAN0) on the storage
system and how much space is reserved?
4 GB are being used (2 GB for the LUN plus 2 GB of reserve)
How much space is being used by Snapshot reserve on the storage system?
Only a minimal amount. No real usage.
In this task, you will log into your assigned UNIX machine and delete all data from lun0.
You will then observe the effect.
STEP
ACTION
2.
3.
Open a Telnet session with storage system 1. Verify the current disk usage:
A-13
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned UNIX machine and completely fill lun0 again.
You will then repeat this task until the vol_SAN1 volume is completely full and the Snapshot
fails.
STEP
ACTION
1.
Open a Telnet session with your assigned UNIX machine. Write 100% to lun0 by
entering the following command:
# dd if=/dev/zero of=foo bs=1k conv=notrunc
Verify the current disk usage:
# df -h
How much space is being used by lun0 on the UNIX machine? 2 GB
2.
Open a Telnet session with storage system 1. Verify the current disk usage:
Repeat steps 1-5, incrementing the Snapshot name (that is, s4, s5...) until the
Snapshot command fails in step 3.
What is the name of the Snapshot copy that fails? s6
What is the error message? Snapshot operation failed: No space left on device.
Why does the Snapshot process fail? The Snapshot process fails because there is
no more room to successfully delete and write (overwrite) lun0s current data.
The volume is full. Note that fractional reserves are being used.
A-14
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned storage system 1 and change Snapshot Autodelete
Policy. You will then observe the effect.
STEP
ACTION
1.
Open a Telnet session with your assigned storage system 1. Note that when a
volume is full and the system can no longer create a Snapshot copy, you can either
delete Snapshot copies to free up disk space or grow the volume. We will explore
the Snapshot autodelete policy. Check out the current Snapshot autodelete policy
options :
system> snap autodelete vol_SAN0
Record the current options:
commitment: Answers will vary for all options.
trigger:
target_free_space:
delete_order:
defer_delete:
prefix:
2.
3.
How many Snapshot copies are there now? Zero or one, depending on your system.
Observe the effect:
system> df -rh
A-15
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Answers
Module 6: SAN Management
A-16
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
40
A-17
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
MODULE 7: SNAPDRIVE
Answers
Module 7: SnapDrive
A-18
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
45
EXERCISE: SNAPDRIVE
Verification exercise only.
A-19
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
MODULE 8: MULTIPATHING IN FC
Answers
Module 8: Multipathing in FC
A-20
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
61
EXERCISE: MULTIPATHING IN FC
TASK 1: ENABLE AN FC HBA ON STORAGE SYSTEM 2
Up to this point, you have only used storage system 1 for FC SAN. In this task, you will log
into your assigned storage system 2 and enable an FC HBA adapter.
STEP
ACTION
6.
Now that one of your HBA adapters is enabled on storage system 1, lets
investigate what effect this has on the FC switch. Switch to your FC switch PuTTY
Telnet window and at the prompt type the following:
switch> switchshow
switchName:
switch
switchType:
16.2
switchState:
Online
switchMode:
Native
switchRole:
Principal
switchDomain:
switchId:
fffc01
switchWwn:
10:00:00:60:69:c0:0b:e4
switchBeacon:
OFF
Zoning:
OFF
port
0: id N2 Online
port
1: id N2 No_Light
port
2: id N2 Online
port
3: id N2 No_Light
port
4: id N2 Online
port
5: id N2 No_Light
port
6: id N2 Online
port
7: id N2 No_Light
F-Port 50:0a:09:81:96:f7:c7:86
F-Port 50:0a:09:81:86:f7:c7:86
F-Port 10:00:00:00:c9:2d:a0:63
F-Port 10:00:00:00:c9:2d:9f:76
A-21
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned storage systems and enable the second interface.
STEP
ACTION
1.
With your assigned storage system 1 PuTTY Telnet window, determine what
interfaces are currently enabled:
system> fcp config
With your assigned storage system 2 PuTTY Telnet window, determine what
interfaces are currently enabled:
system2> fcp config
In this task, you will log into your assigned storage systems and set them for an active-active
configuration.
STEP
ACTION
1.
Is it enabled? No
3.
Is it single_image? Yes
If it is not single_image, place the storage system into single_image cfmode by
entering the following command:
system> fcp set cfmode single_image
Verify:
system> fcp show cfmode
5.
Is it enabled? No
7.
Is it single_image? Yes
If it is not single_image, place the storage system into single_image cfmode by
entering the following command:
A-22
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Verify:
system> fcp show cfmode
In this task, you will log into your assigned UNIX machine and enable the second HBA
adapter.
STEP
ACTION
2.
Type the line number you recorded above and a capital G. For example:
451G
After a few minutes, log back into the UNIX Telnet sessions using the techniques
discussed earlier.
A-23
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned UNIX machine and access the FCP lun0 from
storage system 1 by way of multiple paths.
STEP
ACTION
5.
Verify connectivity with switch by entering the following command on the UNIX
machine:
# luxadm -e port
7.
Verify:
system> igroup show v
8.
Verify:
system> igroup show -v
Mapped to
LUN ID
Protocol
-----------------------------------------------------------
9.
/vol/vol_SAN0/lun0
iUNIX_fcp
FCP
/vol/vol_SAN1/lun1
iWIN_iscsi
iSCSI
Determine whether UNIX can view the LUN by entering the following command:
# cfgadm -al -o show_SCSI_LUN
To determine which WWPN C1 and C2 refer to, see the Master Configuration
Worksheet.
What LUN ID do you see within the output? 0
Do both UNIX interfaces see all 4 WWPNs on the active-active pair? Yes
A-24
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
10.
Determine how many devices UNIX has assigned to the lun0 by entering the
following command:
# luxadm probe
How many devices are listed? One; otherwise MPxIO is not properly configured.
Record the character devices logical path of lun0 below:
Answers will vary.
11.
Examine the paths available to the character device by entering the following
command:
#luxadm display character_device_logical_path
You should have 4 entries for the UNIX HBA #1 and 4 entries for the UNIX
HBA#2.
Are 2 of the paths primary for HBA#1 and 2 of the paths secondary? Yes
13.
A-25
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Answers
Module 9: Multipathing in iSCSI
A-26
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
55
In this task, you will log into your assigned UNIX machine and connect to the eb0 interface
on storage system 2.
STEP
ACTION
2.
Verify that your assigned UNIX machine can see the new target portal group for
storage system 2 by entering the following:
# iscsiadm list target
Target: iqn.1992-08.com.netapp:sn.101173126
Alias: TPGT: 1001
ISID: 4000002a0000
Connections: 1
Target: iqn.1992-08.com.netapp:sn.101173126
Alias: TPGT: 1000
ISID: 4000002a0000
Connections: 1
In this task, you will log into your assigned storage system 2 and verify iSCSI multipath
connectivity.
STEP
ACTION
How many sessions does storage system 2 have with your assigned UNIX machine?
2
Verify the iSCSI connections by entering the following commands:
system2>
How many connections does each session have with your assigned UNIX machine?
1
A-27
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned UNIX machine and verify iSCSI multipath
connectivity.
STEP
ACTION
1.
Verify the iSCSI multipath connectivity to the LUN through the Host Utilities Kits
sanlun tool:
# sanlun lun show all -p
In this task, you will log into your assigned Windows machine and configure a second iSCSI
session on Windows.
STEP
ACTION
3.
You should already have a session with storage system 1. Under the Targets tab,
the Target should have a status of Connected.
Select the target and click the Details button.
Verify that there is only one session with the Target Properties dialog.
A-28
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Here, in this example, there is only one session. The session is connected to Target
portal group 1000.
Record your sessions target portal group: Answers will vary.
Which target portal on storage system 1 does this number relate to?
the e0a_default target portal
We will now create another session to the other target portal. Close the Target
Properties dialog.
In this task, you will log into your assigned storage system 1 and reconfigure the target portal
groups so that e0a and e0b are in the same target portal group.
STEP
ACTION
1.
Verify the current configuration of the target portal groups by entering the
following command:
system>
A-29
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
Are e0a and e0b together in the same target portal group? No. You will now place
them in the same target portal group.
Execute the following command to place e0a and e0b into the same target portal
group called mytp:
2.
system2>
Verify:
system>
In this task, you will log into your assigned Windows machine and access the iSCSI lun1
from storage system 1.
STEP
ACTION
3.
Confirm that the session and first connection where created by selecting Details on
the target and looking at the Target Properties.
A-30
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
STEP
ACTION
A-31
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
In this task, you will log into your assigned storage system 1 and verify iSCSI multipath
connectivity.
STEP
ACTION
1.
How many sessions does storage system 1 have with your assigned Windows
machine?
1
Verify the iSCSI connections by entering the following commands:
2.
system>
How many connections does the session have with your assigned Windows
machine?
1
TASK 14: VERIFY iSCSI MULTIPATH CONNECTIVITY TO STORAGE SYSTEM 1
In this task, you will log into your assigned storage system 1 and verify iSCSI multipath
connectivity.
STEP
ACTION
1.
How many sessions does storage system 1 have with your assigned Windows
machine?
1
2.
How many connections does the session have with your assigned Windows
machine?
2
A-32
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Appendix
Appendix B B
Hardware
Protocol
Local
Windows
Item
Value
Username:
Password:
UNIX
Name:
Console IP
Address:
IP Address:
Root Password:
FC
WWNN:
Adapter 1 OS
Device Name:
Adapter 1 WWPN:
Adapter 2 OS
Device Name:
Adapter 2 WWPN:
iSCSI
Interface Name:
IP Address:
WWN:
Remote
Windows
Name:
Console IP
Address:
Local
Administrator
Password:
Domain
Administrator
Password:
FC
WWNN:
Adapter1 WWPN:
Adapter 2 WWPN:
B-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Hardware
Protocol
Item
Remote
Windows
iSCSI
1 Interface Name:
Value
1 IP Address:
1 WWN:
2 Interface Name:
2 IP Address:
2 WWN:
Storage
System 1
Hostname:
Type of System:
Console IP:
Root password:
FC
WWNN:
Adapter 1 Name:
Adapter1 WWPN:
Adapter 2 Name:
Adapter 2 WWPN:
iSCSI
1 Interface Name:
1 IP Address:
1 WWN:
2 Interface Name:
2 IP Address:
2 WWN:
B-2
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Hardware
Protocol
Storage
System 2
Item
Value
Hostname
Type of System
Console IP
Root password
FC
WWNN:
Adapter 1 Name:
Adapter1 WWPN:
Adapter 2 Name:
Adapter 2 WWPN:
iSCSI
1 Interface Name:
1 IP Address:
1 WWN:
2 Interface Name:
2 IP Address:
2 WWN:
FC Switch
IP Address:
Username:
Password:
Switch Name:
Fabric Address:
Port 0 WWPN:
Port 1WWPN:
Port 2 WWPN:
B-3
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Hardware
FC Switch
Protocol
Item
Value
Port 3 WWPN:
Port 4 WWPN:
Port 5 WWPN:
Port 6 WWPN:
Port 7 WWPN:
B-4
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.
Appendix
Appendix C C
Description
uname -a
prtdiag
fcinfo hba-port
fcinfo hba-port -l wwpn
luxadm -e port
Identifies platform
Prints diagnostic information
Lists active HBA(s) information
Lists details for a specific initiator port
Displays whether Solaris HBAs are attached to
the fabric
Displays devices visible to an HBA
luxadm -e dump_map
/device_path
iscsiadm list initiator-node
iscsiadm list discoveryaddress
cfgadm -al
cfgadm -al -o show_SCSI_LUN
devfsadm
devfsadm -Cv
format
newfs /dev/rdsk/...
mount /dev/dsk/... /mntpoint
mpathadm list lu
mpathadm list lu /dev/rdsk/...
Description
basic_config
mpxio_set
COMMON BROCADE COMMANDS
Command
Description
uname -a
Identifies platform
Identifies switch configuration
Enables a particular port
switchshow
portenable #
C-1
2008 NetApp. This material is intended for training use only. Not authorized for re-production purposes.