Professional Documents
Culture Documents
Module Overview
In this module, we will cover the following: NetApp core software technology Specific on-box and off-box features of Data ONTAP NVRAM functionality NetApp SnapShot technology Describe NetApp RAID-DP implementation
Module Objectives
By the end of this module, you should be able to: Identify NetApp core software
On-box features of Data ONTAP Off-box features of Data ONTAP
Describe the functionality of NVRAM Describe the values of NetApp RAID 4 and RAID-DP technology Demonstrate NetApp Snapshot whiteboard
Protocol Support
Protocol Support
NVRAM / RAID-DP
NVRAM Operation
Client Storage System
GbE
Dual-attached FC
Storage System
NIC
+
Main Memory
NIC ack
Main Memory
Operation is logged in batterybacked RAM and is now safe from controller failure Operation is also placed in controllers main memory where further processing will occur
2008 NetApp. All rights reserved.
Client free to forget about it its done! Purely electronic, memory-tomemory path
10
Storage System
NIC
+ -
N V R A M BATT
Main Memory
Activities involving the operation consume main memory Up to 10 seconds can elapse between CPs while many other ops arrive (not shown)
2008 NetApp. All rights reserved.
The organized data from the operations are written to disk NVRAM is zeroed
11
NVRAM5
Dirty
Tavor 4x (10 Gb/s) InfiniBand 5.1Ah Battery (Dirty shutdown life 3-7 days)
NVRAM6
512-MB/2-GB DIMM 3-Cell Battery
IB CFO Connectors
13
Write Chain
RAID Stripe
Parity Drive
14
2 2
2 7
RAID-DP is dual / diagonal parity data protection NetApp RAID-DP is an implementation of the industry standard RAID 6 as defined by SNIA
SNIA definition recently updated to include NetApp RAID-DP
http://www.snia.org/education/dictionary/r/
2008 NetApp. All rights reserved. 15
NetApp Snapshot
16
Protocol Support
17
95%
95% 94% 89%
SnapMirror
SnapVault FlexVol performance SnapManager
81%
76% 73% 69%
SnapRestore
89%
86% 86% 85% 85% 85% 85% 83%
68%
68% 64% 61% 60% 60% 59% 40%
WAFL integration Multi-protocol Data ONTAP simplicity WAFL file system FlexVol virtualization iSCSI leadership SnapLock
18
Take snapshot 1
Copy pointers only No data movement
A A B B C C
A B C
Snap 1
19
A A B1 B B C C
A B C B1
A B C
Snap 1 Snap 2
20
A A B1 B C1 C
A B C B1 C2
A B C
A B1 C
21
Snapshot Performance
Snapshots
TPC-C published with 5 active Point-in-time copy Created in a few seconds snapshots
No performance penalty
NetApp Confidential -- Do Not Distribute 22
Competitors Snapshots
23
Others Snapshots
Blocks in LUN or File Blocks on the Disk
Take snapshot 1
Create copy-out region 1 Create pointers to old blocks and copy-out
A A B B C C A B C
A
B C
A B C Copy Out 1
Snap 1
24
Others Snapshots
Blocks in LUN or File Blocks on the Disk
A B C Copy Out 1
B1 B
C
A B C
Snap 1
25
Others Snapshots
Blocks in LUN or File Blocks on the Disk
A B1 C B Copy Out 1
B1 B
C
A B1 B C
Copy Out 2
26
Others Snapshots
Blocks in LUN or File Blocks on the Disk
A B1 C B Copy Out 1
B1 B
C2 C
Take snapshot 1 Continue writing data Take snapshot 2 Continue writing data
Block changes Old block written to all copy-out regions Update all snap pointers to copy-out regions Update block on disk
A B C
A B1 B C
Copy Out 2
Snapshot Comparison
NetApp Others
A B C B1 C2
A B1
C2 B C
No data movement
Guarantees disk performance Enables more snapshots
Space on disk is better Performance is better Number of snapshots is better
28
Block C2 is bad
A B1 B C2
A B C B1 C2
A B C
A B1 C
A B1 C2
29
A B1 B C2 C
A B C B1
Block C2 is bad Let users self-restore from .snapshot directory in NAS environments
.snapshot directory
C2
A B C
A B1 C2
B1
C
30
A B1 B C2 C SnapRestore
A B C B1 C2
Block C2 is bad Let users self-restore from .snapshot directory in NAS environments Restore from snapshot with SnapRestore
Move pointers from good snapshot to file system
A B C
A B1 C2
B1
C
Snapshot Performance
Snapshot Technology
TPC-C published with five active Point-in-time copy Created in a few seconds snapshot copies
No performance penalty
NetApp Confidential -- Do Not Distribute 32
Competitors Snapshots
33
Others Snapshots
Blocks in LUN or File Blocks on the Disk
Take snapshot 1
Create copy-out region 1 Create pointers to old blocks and copy-out
A A B B C C A B C
A
B C
A B C Copy Out 1
Snap 1
34
Others Snapshots
Blocks in LUN or File Blocks on the Disk
A B C Copy Out 1
B1 B
C
A B C
Snap 1
35
Others Snapshots
Blocks in LUN or File Blocks on the Disk
A B1 C B Copy Out 1
B1 B
C
A B1 B C
Copy Out 2
36
Others Snapshots
Blocks in LUN or File Blocks on the Disk
A B1 C B Copy Out 1
B1 B
C2 C
Take snapshot 1 Continue writing data Take snapshot 2 Continue writing data
Block changes Old block written to all copy-out regions Update all snap pointers to copy-out regions Update block on disk
A B C
A B1 B C
Copy Out 2
Snapshot Comparison
NetApp Others
A B C B1 C2
A B1
C2 B C
No data movement
Guarantees disk performance Enables more snapshot copies
Space on disk is better Performance is better Number of snapshot copies is better
38
Block C2 is bad
A B1 B C2
A B C B1 C2
A B C
A B1 C
A B1 C2
39
A B1 B C2 C
A B C B1
Block C2 is bad Let users self-restore from .snapshot directory in NAS environments
.snapshot directory
C2
A B C
A B1 C2
B1
C
40
A B1 B C2 C SnapRestore
A B C B1 C2
Block C2 is bad Let users self-restore from .snapshot directory in NAS environments Restore from snapshot with SnapRestore
Move pointers from good snapshot to file system
A B C
A B1 C2
B1
C
Exercise
Module 2: Snapshot Whiteboard Estimated Time: 20 minutes
44
Protocol Support
45
http://now.netapp.com/NOW/cgi-bin/software/
2008 NetApp. All rights reserved. 46
General Availability Key certifications required for solution sets Basic client compatibility Tier 1 partner certification
GD
General Deployment Adoption metrics Full solution sets Full client compatibility
RC1
...
RCn
GA
Maintenance Releases
7.0RC1
7.0RCn
7.0 GA date
7.0.2
Time
http://now.netapp.com/NOW/products/ontap_releasemodel/post70.shtml
2008 NetApp. All rights reserved. 47
Release Metrics
http://now.netapp.com/NOW/cgi-bin/metrics
2008 NetApp. All rights reserved. 48
2007
10.0.x Tricky.x
2008
10.1 Whirlwind
2009
7.4 Kingfisher
Rolling Rock
10.2 Stormking
Rolling Rock +1
2010
2008 NetApp. All rights reserved. 49
Client Code
ZZZ
x
CPU 100% !! ERROR !! Disk Full Hardware Failure Idle Mgmt I/F 1
x
Data Loss
Mgmt I/F 2
Simplicity
All clients see all data Simplifies managing mount points No client changes
A1 A2 A3 B1 B2
C1 C2 C3
Transparency
Virtual Server
A B1 A3 C1 B C A1 C2 B2 A2 C3
Scalability
Grow namespace to Petabytes Manageability
51
Customer Benefits
Scalability and performance Flexible volumes that span many controller nodes
9 10 11 12 B2
A1 A2 A3 B1 B2
C1 C2 C3
1 3
2 4 B1
5 7
6 8 B
Striped Volume X
C1 A3
A1 C C2
C3
A2
GX Cluster
Customer Benefits
Rapidly/seamlessly deploy new storage and/or applications No downtime required Transparent to compute farm, namespace is unchanged
A1 A2 A3 B1 B2
C1 C2 C3
A A1 A3
A2
C2 B B2 B C C3
B1 C1
53
Customer Benefits
Optimize performance Maximize disk utilization No disruption to application No need to touch clients because namespace is unchanged
A1 A2 A3 B1 B2
C1 C2 C3
A B1 A3 C1 B A1 C2 B2 A2 C3
Example
C
54
Protocol Support
55
IP
Async and sync remote replication over inexpensive IP. FC now also supported. Heterogeneous super-efficient hourly disk-based online archiving with versioning up to weeks or months.
SnapVault
$ $
SyncMirror
SnapLock
plex0
plex1
Synchronous RAID-1 local mirroring via disk shelf plexes. RAID-1 remote mirroring product for DR is MetroCluster. SEC-compliant disk-based WORM technology
LockVault
$ $
No License Fee License Fee Location of the Quick Reference Guides: http://www.netapp.com/mycommunities/PartnerCenter/tools/spotlight-presentations.html
56
$
$ $
FlexVol
Disks
Disks
Disks
Aggregate
FlexClone
FlexCache
Priority
FlexShare
57
$
$
58
Protocol Support
59
Client
WAFL
Client
Network Stack
Protocols
RAID
Storage
Client
NVRAM Disks
Client
Network
Clustering
60
Protocol Support
61
Filer/DataONTAP
Client
WAFL
Client
Network Stack
Protocols
RAID
Storage
Client
NVRAM Disks
Client
Network
Clustering
62
63
SNMP
SMTP
Protocol Support
65
66
67
68
Operations Manager Protection Manager Storage Manager Appliance Watch MOM OpenView TSM CommandCentral Storage (Symantec)
69
Aggregate review
Competitive layout
70
RG 0
RG 1
RG 2
Aggregate collection of physical disk space used as a container to support one or more flexible volumes Aggregates are the physical layer
71
Default RAID type = RAID-DP One or more RAID groups RAID group size definable Supports SyncMirror Aggregate snapshot support (default enabled) Target all flexible volumes contained within aggregate
72
73
74
RG 0
RG 1
RG 2
Traditional volume collection of physical disk space that is used to support a single volume
Traditional volumes are directly tied to an aggregate Traditional volumes are both the physical layer and the logical layer
75
RG 0
RG 1
RG 2
Flexible volume collection of disk space allocated as a subset of the available space within an aggregate
Flexible volumes are loosely tied to their aggregate Flexible volumes are the logical layer
76
77
78
79
FlexVol1
80% 90%
.snapshot
95%
FlexVol#n
80%
.snapshot
20% Adj.
snapshot Reserve
Aggregate snapshot Reserve
(20% Adjustable)
(5% Adjustable)
80
X
Volume None File
81
40 empty cups available for filling 50 empty cups available for filling
Available water reduced by 10 cups immediately to guarantee the cups needed to fill the bucket
Space is not used, but the ability to take that space is reserved
Space guarantee set to volume Space allocated from aggregate at creation for entire size of volume Space allocated within volume does not affect aggregate space
2008 NetApp. All rights reserved. 82
49 empty cups available for filling 50 empty cups available for filling
A new volume requests 10 cups, however no real space is taken until it is needed by the volume
Guarantee = none Space allocated from aggregate as used Does not support file and LUN space reservations May run out of aggregate space before achieving volume size
2008 NetApp. All rights reserved. 83
48 49 empty cups available for filling 50 empty cups available for filling
It is possible to have many flexible volumes that can possibly exceed the limit the aggregate has available This is because they are empty and not taking any real space until needed by the volume
2008 NetApp. All rights reserved. 84
48 empty cups available for filling 50 empty cups available for filling
It is possible to have many flexible volumes that can possibly exceed the limit the aggregate has available This is because they are empty and not taking any real space until needed by the volume
2008 NetApp. All rights reserved. 85
86
What is FlexShare?
88
Relative priority of different volumes Per-volume user vs. system priority Per-volume cache policies Administration using CLI or Manage ONTAP API Dynamic updates of configuration changes
89
MultiStore
MultiStore is an optional software product available with Data ONTAP
Allows partitioning of the storage system and network resources into separate storage containers These storage containers are called virtual filers
Sometimes referred to as Vfilers
Each virtual filer offers file services to the clients NOT the same as V-Series
90
Benefits of MultiStore
Virtualization
Provides a logical view of the storage and computing resources Hides complexity
Security
Delegation of management Data owned by a virtual storage controller cannot be accessed by other virtual storage controllers
2008 NetApp. All rights reserved. NetApp Confidential -- Do Not Distribute 91
File System
Start-ups
Users and Applications Storage Consumer
(e.g. file systems, databases, etc.) File System
DataCore FalconStor
NO disk optimization
92
FlexVol Volumes
RAID-DP Rapid RAID Data Protection Recovery Data NVRAM Accelerated Checksums Logging
Composite LUNs
(striped or concatenated physical LUNs) Composite Disk Composite Disk Volume Manager Composite Disk
Source: http://mktg-web.netapp.com/products/launches/nov04/Nov2004LaunchWeb/index.htm
2008 NetApp. All rights reserved. 93
EMC CLARiiON
Disk Groups / RAID CX300 - 60 disks / 16.4 TB CX500 - 120 disks / 35.8 TB CX700 - 240 disks / 74.4 TB RAID 0/1/3/5/10 (RAID 6 talk no delivery) MetaLUN (FLU/Flare LUN) Two or more FLUs joined as one = MetaLUN Theoretical limit of 2048 Cannot shrink without destroying data Manually sized SnapView Copy-on-write = performance impact snapshots cannot mount on originating server MirrorView Synchronous or limited asynchronous BCV / Backup to ATA
95
Exercise
Module02: Aggregate and Volume Creation Demo Estimated Time: 30 minutes
References
Competitive Layout Information
http://mktg-web.netapp.com/products/launches/
PartnerCenter- Solutions
http://www.netapp.com/mycommunities/PartnerCenter/solutions/solution-sets.html
Capacity Calculator
http://www.netapp.com/seef/mycomm/partnercenter/solutions/roitei/downloads/capacity-calculator.xls
MultiStore
http://www.netapp.com/mycommunities/PartnerCenter/10251
98
Module Summary
In this module, you should have learned to: Identify NetApp core software
On-box features of Data ONTAP Off-box features of Data ONTAP
Describe the functionality of NVRAM Describe the values of NetApp RAID 4 and RAID-DP technology Demonstrate NetApp Snapshot whiteboard
99