You are on page 1of 62

OceanStor 9000 Pre-sales Training

Storage Marketing, IT Marketing Dept.


www.huawei.com

HUAWEI TECHNOLOGIES CO., LTD.

Page 1
1 Market Overview and
Product Positioning
2 Introduction to the
OceanStor 9000
3 Competitive Analysis
4 Application Scenarios
5 How to Obtain Help

Market Overview and


Product Positioning

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 2


History of video surveillance storage

1960s Mainframe
1980s PC
1990s Internet
2000s Mobile Internet 2010s Big data

2.8 ZB Data source: IDC


87.5 billion sets
• In 2012, the global data volume reached 2.8 ZB.
• 2.8 ZB = 87.5 billion sets of 32 GB PADs.
• In 2020, the volume is expected to reach 40 ZB.

Big Data brings about new challenges and opportunities.


HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 3
Big Data market space
2010 to 2015 Big Data market space ($B)
18.00
Service
16.00
Software
14.00
Storage 7.88
12.00
10.00 Server  The Big Data market is expected to top 16.9 billion
5.59
8.00 USD in 2015. Storage provides the biggest room
3.48
6.00 3.96
4.42 2.59
4.00 2.80 for growth in this market. In 2015, storage in the
1.99 1.93 3.19
1.41 1.44 1.98
2.00 0.80 1.07 0.76 1.23
0.00
0.29
0.70
0.47
0.89 1.13 1.44 1.84 2.34 Big Data market is expected to reach 3.19 billion
2010 2011 2012 2013 2014 2015 USD with a 61.4% CAGR.
Source: IDC

Distributed NAS System  In 2015, the distributed NAS is expected to reach


Vendor Revenue ($M)
3,000.0 1.95 billion USD with a CAGR of about 40%.
2,532.2
2,500.0

1,951.4
 EMC Isilon is a typical scale-out NAS product. Its
2,000.0

1,500.0
1,467.9 equivalents include IBM SONAS and HP IBRIX.
1,015.9
1,000.0
621.7
475.4
500.0 308.5

0.0
2010 2011 2012 2013 2014 2015 2016

Source from Gartner

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 4


OceanStor 9000: fastest scale-out storage system

 Outstanding Performance:Industry-leading performance, 1.6


GB/s throughput per node and 400 GB/s throughput per system,
innovative eTurbo acceleration technology, 5 million OPS, and
linear performance improvement
 Flexible Space:Fully distributed architecture, accommodation of
288 nodes, reduced CAPEX, elastic capacity expansion, 60 PB
storage space per file system, and simple management on
massive data
 Open Convergence:Open system, flexible connections to
applications, support for various interfaces such as S3, HDFS,
NFS, CIFS, JDBC/ODBC, NDMP, and FTP, and support for both
file- and object-based storage
 Simplified Management:Automatic deployment and
configuration of the software platform enable one-click capacity
OceanStor 9000 expansion — a single node can be added within 60 seconds.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 5


Application scenarios Major sector of focus for
OceanStor 9000
Sector Importance Scenario Scope
Media & entertainment (major concerns: ★★★★★ NLE system, media assets library, play-out Worldwide
bandwidth, capacity, reliability, and storage system, and video on demand
tiering capabilities)
HPC (major concerns: file system ★★★★★ Earthquake data processing and oil reservoir Worldwide
architecture, performance indicators, exploration simulation
capacity, and reliability)
Metrological forecasting and earthquake Worldwide
prediction
Satellite remote sensing and topography Worldwide
Astronomical image processing Worldwide
Gene sequencing and comparison Worldwide
Video surveillance (1000+ channels) ★★★★★ Safe city, metro, light rail, railway, express way Worldwide
Finance (major concerns: capacity, ★★★★ Financial check image archiving Worldwide
reliability, fast indexing, and storage tiering)
★★★ Government departments, SMEs, hospitals, and Worldwide
Commerce
education
Carriers ★★★★ Resource pool projects Worldwide
★★ xDR scenarios, such as CDR, SDR, and TDR China
Public security (GA Big Data platform) ★★ Network surveillance, technical inspection China

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 6


OceanStor 9000 positioning in media,
entertainment, and broadcasting markets
TV station Broadcast/Live show
Wired network
TV
NLE system Video on Digital on demand
M&E management demand
Play-out system M&E
management Mobile phone
New media
Internet on demand
Video on demand Computer
Play-out system
M&E management
Mobile TV

Storage Requirement Status Quo and Challenge

Video definition evolves from SD to HD, 4K UHD, and 8K UHD, which requires enhanced processing
Outstanding
performance.
performance
Major storage requirements: high performance and reliability.
Resource sharing Traditional solutions are based on isolated service systems, complicating resource sharing.
Difficult system expansion and complicated deployments of conventional systems open up the opportunities
Flexible expansion in video cloud solutions.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 7


OceanStor 9000 positioning in video
surveillance market
Level of Specialization

 Video analysis
 Video recording for important
Safe City government departments (more
Smart City than 1000 channels)
Level-1 storage
Rail transit
Airport
Energy
Education  Storage of data collected by more
Port than 1000 HD camera channels;
Data center
capacity = 1000 channels x bit rate 6
Manufacturing Mbit/s x 1.1 (bit rate fluctuation
Government Large-sized enterprises
factor) x duration (s) /8/1024/1024
Health care such as banks and
Level-2 storage  Video analysis
financial companies
Large-scale
activities
Gaming (Casinos)
Commerce  Storage of data collected by less than
Rail transit: 500 HD camera channels
Retail highway/railway

Residence

Level-3 storage

Capacity

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 8


OceanStor 9000 positioning in HPC market
Focus on storage HPC projects with more than 5 GB/s aggregated throughput and larger
than 500 TB capacity.

I/O storage intensive


Energy exploration
Gene sequencing
Animation rendering Capacity
Satellite 1PB OceanStor
mapping
9000

Pharmacology Hydromechanics
Material Highly complicated 500TB
science scientific computations
OceanStor
V3
200TB
Throughput
Computing and memory intensive

2 GB/s 5 GB/s 10 GB/s


1 Market Overview and
Product Positioning
2 Introduction to the
OceanStor 9000
3 Competitive Analysis
4 Application Scenarios
5 How to Obtain Help

Introduction to the
OceanStor 9000

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 10


Scale-up and scale-out
Scale-up: traditional NAS expansion Scale-out: linear improvement of performance and capacity
Limited performance and capacity Fully symmetrical architecture

Server

Network

NAS engine

Storage
Array ……

Storage node Storage node Storage node

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 11


OceanStor 9000 nodes

High-performance Large-capacity archive


storage node node
P series C series

P12 C36

2 U, 3.5", 12 disks

P25 4 U, 3.5", 36 disks


Online M&E, low-end HPC, and
video surveillance
2 U, 2.5", 25 disks

P36 C72

4 U, 3.5", 36 disks 4 U, 3.5", 72 disks

HD editing, news production, and Near-line M&E and video


high-end HPC surveillance

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 12


P-series nodes

Front view 2 U, 25 x 2.5-inch data disks


Standard configuration: two Intel IvyBridge
P25 CPUs, 48 GB memory, 2 GB NVDIMM, 1 x
Rear view 400 GB SSD + 24 x 900 GB/1.2 TB SAS

Front view
4 U, 36 x 3.5-inch data disks
Standard configuration: two Intel IvyBridge
P36
CPUs, 48 GB memory, 2 GB NVDIMM, 1
Rear view x 400 GB SSD + 35 x 2 TB/4 TB/6 TB
SATA or 2 TB/4 TB NL-SAS

2 U, 12 x 3.5-inch data disks


Front view
Standard configuration: two Intel
P12 IvyBridge CPUs, 32 GB memory, 2 GB
Rear view NVDIMM, 12 x 2 TB/4 TB/6 TB SATA or
2 TB/4 TB NL-SAS
Same node types must be added in groups of three or more.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 13


C-series nodes

Front view

4 U, 36 x 3.5-inch data disks


C36 Standard configuration: two Intel IvyBridge
CPUs, 32 GB memory, 2 GB NVDIMM, 36 x
Rear view 2 TB/4 TB/6 TB SATA or 2 TB/4 TB NL-SAS

Front view 4 U, 72 x 3.5-inch data


C72 Top disks
Standard configuration: two
view
Atom Rangeley CPUs, 64
GB memory,
Rear view
72*2 TB/4 TB/6 TB SATA

Same node types must be added in groups of three or more.


HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 14
Switch unit
 Huawei

10GE switch  1U
 48-port 10GE SFP+
CE6810-48S4Q-EI (10GE optical access ports)

 Huawei
GE switch S5300-52P-LI (Carrier use case)  1U
 48*GE RJ45

S5700-52P-LI (Enterprise use case)

Infiniband  Mellanox IS5023


switch  1U
 18 x 40GE QDR ports
Mellanox IS5023

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 15


OceanStor 9000 network
Management terminal
File system network types:
Pseries:
 2 x 10GE front-end networks + 2 x 10GE
back-end networks
P25/P36/P12/C36/C72
 2 x GE front-end networks + 2 x 10GE

Management switch back-end networks


 4 x GE front-end networks + 2 x 10GE
back-end networks
 2 x IB front-end networks + 2 x IB back-end
networks
 2 x 10GE front-end networks + 2 x IB back-

end networks
10GE switch, IB 10GE switch or IB C36:
switch  2 x 10GE front-end networks + 2 x 10GE
switch, or GE switch
(customer-supplied) back-end networks
 2 x GE front-end networks + 2 x 10GE

back-end networks
The internal network is preconfigured at factory;  4 x GE front-end networks + 2 x 10GE

reducing hassles in deployments. back-end networks


C72:
Application servers OceanStor 9000  4 x GE front-end networks + 8 x 10GE

Note: back-end networks


1. All hardware and software, with the exception of IB switches, are developed by Huawei. Front-
end IB networking requires that the back-end also be an IB network.
2. C72 nodes can only be used for the 8 x GE front-end networks + 4 x 10GE back-end networks.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 16


OceanStor 9000 system architecture
Media and Video Precision Commercial Interconnecti Backup and
HPC Web disk
ons to
entertainment surveillance marketing promotion archiving software
Hadoop
Application
layer
File storage Data analysis Backup and archiving

FTP NFS CIFS HDFS NDMP

Data
processing OceanStor DFS(WushanFS)
layer
InfoTier (dynamic tiering) InfoAllocator (quota) InfoLocker (WORM)

InfoStamper (snapshot) InfoReplicator (replication) SecureVideo

Hardware node P series nodes C series nodes


layer

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 17


Fully distributed architecture for highly reliable
data protection
 N+1 to N+4 data
protection, tolerable of
the faults on up to four
disks or nodes
 95% maximum disk
utilization rate
 Expandable from 3 to 288
nodes
 Single-node capacity
+1 +2 expansion in 60 seconds
+3 +4

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 18


Smart load balancing (InfoEqualizer)
• Workloads are automatically
balanced across all nodes.

• Dynamic balance between


OceanStor 9000 capacity and performance

• IP address failover and failback


OceanStor DFS (WushanFS)

InfoEqualizer InfoEqualizer InfoEqualizer InfoEqualizer • No need for human intervention or


manual change in configurations

node node node node


192.168.0.22 192.168.0.25
192.168.0.20 192.168.0.24
• Transparent to applications
192.168.0.21 192.168.0.23

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 19


Smart load balancing (InfoEqualizer)

NFS client
1. Client accesses the file system using the
primary or a secondary domain name, for
example, fx.tx.com.
1
2. The OceanStor 9000 resolves the domain • Access using a single domain
2 name and returns an IP address based on the
3 load balancing policy. name
3. The client initiates service requests.
• Support for zoning, with each zone
assigned a secondary domain name
OceanStor DFS and load balancing policy
• Load balancing policies can be
applied to CPUs, memory, bandwidth,
Node Node Node Node Node Node
network connections, and node
Zone 1: based on CPU Zone 2: based on network capabilities
usage connection count
Secondary domain name: Secondary domain name:
fx.tx.com td.tx.com

OceanStor 9000
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 20
Global cache
Application servers

A B C

CPU CPU CPU


Memory GlobalMemory
cache Memory

Storage Storage Storage

 Global cache logically consolidates memory space of all storage nodes into a unified memory resource pool.
 Any storage node can hit data in the global cache. Only one copy of user data is cached into the entire system,
without caching any parity data.
 Full use of global cache significantly improves overall system performance.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 21


Global cache and data reading
1. Host E initiates a read request to the CA on node C.
2. The CA on node C applies for a stripe read lock
from the distributed lock server.
Host E
3. The system checks whether the target data resides
1. Host E sends a read
request to Node C. in the global cache and on which specific node the
target data is cached. As shown in the left figure,

3. The lock server replies that the file stripe resource resides in the cache of node
Lock data is in the cache of node A.
A.
CPU CPU CPU 4. Node C obtains the data from the global cache of
2. Node C applies for a stripe
Memory
Global cacheread lockMemory
from the lock server.
node A and returns it to host E. If the target data is

4. Data is read from the not in the global cache, node C obtains all the strips
cache of node A.
of the stripe from each node, constructs the stripe,
Storage Storage Storage
and returns the stripe to host E.

Node A Node B Node C

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 22


Global cache and data writing
1. Host E initiates a write request to the CA on node C.
2. The CA on node C applies for a stripe write lock
Host E from the distributed lock server.
3. Data is locked and
written to the global 3. Data is locked and written to the global cache of
1. Host E initiates a write request
to node C. cache of node C.
node C.
4. Based on the protection level defined for the file,
2. Node C applies for a
stripe write lock from the the CA on node C divides the file stripe into
LOCK lock server.
fragments. With the erasure code protection
CPU CPU CPU technology, parity data fragments are generated for
original data fragments. Then, parity data fragments
Global Cache
4. The data is divided into fragments and original data fragments are written to the
and saved to the NVDIMM.
NVDIMMs of the corresponding nodes. The write
operation is successful as long as all the fragments
Storage Storage Storage are successfully written.

Node A Node B Node C

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 23


Dynamic storage tiering (InfoTier)
√ Creation time Access time

√ File size I/O popularity


SSD
File name I/O count
P series nodes

Modification User-defined
time
SAS
 Three types of disks, providing the precise storage
resources for the use case
 Eight policy templates, offering finer-grained
C series nodes migration control

SATA  Transparent to applications, upper-layer services


are unaware of the migration event
 Fully automated execution based on a preset policy,
no need for human intervention

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 24


InfoTier technology: node pool

 The OceanStor 9000 automatically generates node


P25 pools based on physical node types. During the
deployment and expansion, the OceanStor 9000 adds
nodes to the corresponding node pools based on their
physical types. The use of node pools provides two
advantages: fault isolation and dynamic storage tiering.
 It is recommended that all nodes in a node pool be of
the same physical type. Otherwise, the performance
of the node pool is affected.
C36  One OceanStor 9000 supports three storage tiers.
 After the deployment is successful, the nodes
contained in a node pool cannot be modified. To
change the owning node pool for a node, you must
delete the node and then add it to another node pool
in capacity expansion mode.
 The OceanStor 9000 supports a maximum of 32 node
pools. Each node pool must contain 3 to 20 physical
C72 nodes. Otherwise, the node pool becomes unavailable.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 25


Quota management (InfoAllocator)

Storage Capacity File number


quota quota
100 TB
Soft quota Hard quota

User quota Directory quota

User group quota


General Finance HR
20 TB manager 40 TB department 40 TB department
 Variety of quota types
Support for directory quota, user quota, and user
group quota
 Support for NFS/CIFS-based soft and hard quotas
 Space management mode that matches the
organization structure, with eight-layer nesting
10 TB 10 TB 10 TB 10 TB
 A single file system, preventing uneven use of
Employee A Employee B Employee C Employee D multiple file systems and improving efficiency of
space use

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 26


Enterprise-level WORM (InfoLocker)
Soft WORM clock

WORM directory
configuration
Tailored WORM clock Read-only Administrator
WORM logs

Protection mode (manual or


automated)

• Protected data can only be accessed but


cannot be modified or deleted.
• Expired files can be deleted but cannot be
modified.
• Independent WORM clock is supported,
which cannot be modified after setting.
• Child directories can automatically obtain
the WORM properties of their parent
directory.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 27


Snapshot (InfoStamper)
By day
By week
/ Snapshot 81 is By month
created for directory
snap81
data/ data, and then file3 is
deleted.
.snapshot/
file2
 Directory-level snapshot. A single directory can have up to
snap81/
2048 snapshots, while the whole system can have at most
File3 can still be accessed 8192 snapshots.
file2 fIle3
in the directory of  Snapshot can be used together with other value-added
snapshot81. features.
 A snapshot can be completed within 1 second and does not
The OceanStor 9000 snapshot technology
affect services, greatly improving backup efficiency and
combines the metadata COW and data ROW
technologies, greatly improving the system reliability.
space utilization.  Six periodic snapshot policies are available to achieve
continuous data protection.
 The space of a deleted snapshot is automatically reclaimed.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 28


Asynchronous remote replication
(InfoReplicator)
P36 C72

LAN/W
(1) Primary Secondary
AN (3)
directory: directory:
/d/h/j /a/b/c
(2)  Directory-based replication
Snap  Primary-secondary, one-to-many, many-to-one, or
Snap
shot two-way replication
shot
 Full or incremental replication
 Real-time monitoring of replication tasks
OceanStor 9000 OceanStor 9000  Remote disaster recovery, remote archiving, and remote
Primary site Secondary site backup
Directory-based asynchronous remote replication  Manual and periodic replication, failover, and failback
 1. Before starting data synchronization, create a benchmark
snapshot in the primary directory.
 Flow control and resumable download at less than a
 2. Synchronize full or incremental data. 20% impact on service bandwidth and latency
 3. After data is synchronized, create a consistency snapshot for the
secondary directory.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 29


Video image repair (SecureVideo)
 Developed specifically for video
ABCD00 (Add 0s to repair the damaged file.) Strip surveillance applications.
A B C D 0 0  Slightly damaged video data can
still be played out (some blurring
may still be present).

Disk 1 Disk 2 Disk 3 Disk 4 Disk 5 Disk 6  The continuity and availability of
video surveillance services are
ABCDEF (failed to read complete data.) Strip ensured.

A B C D
 If the number of faulty nodes or
disks exceeds the upper threshold,
the integral data can still be
accessed but new video data cannot
Disk 1 Disk 2 Disk 3 Disk 4 Disk 5 Disk 6
be written into the system.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 30


eTurbo technology

Optimized data layout and Optimized data block size for


Multi-link technology
cache/write algorithms transmission

 Intelligent cache: predicts


the data to be read based on
the previous service model,
and moves the data to the  Zero copy design for I/O  SMB multi-channels:
cache in advance. paths: minimizes data dynamically adds
 Optimized disk layout: copy jobs. connections when
integrates and sorts data in multiple available
NVDIMM, and then writes network paths exist.
the integrated sequential
data to disks.

eTurbo performance acceleration in M&E scenarios

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 31


Performance statistics tool
 Offers real-time monitoring,
historical trend analysis, comparison
Monitor Analysis Trend Diagnosis analysis, diagnosis analysis, and
report report analysis analysis
capacity prediction based on data
PC
collection, archiving, analysis, and

Performance
statistics.
prediction utilities.
Phone
 Hotspot statistics report
 Real-time and trending analysis on
clusters, nodes, disks, clients, and

management
Resource
Pad network ports
 Cluster and node capacity trend
analysis
 Performance comparison
 Diagnosis analysis
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 32
HDFS API

 Seamless connection to standard


R(RHIPE) PIG Mahout HIVE HBASE
HDFS APIs
Job Tracker Task Tracker

Item 9000 Isilon Open-Source HDFS

Performance High High Medium


HDFS Space
High (EC) High (EC) Low (three duplicates)
WAN utilization

Optional, maximum +4 Optional, maximum


Data protection, +4 protection,
+2 protection
protection Snapshot/remote Snapshot/remote
Server replication replication

OceanStor 9000 Software package Automatic and


Manageability must be installed on integrated Difficult to deploy
clients deployment

Compatibility High High High

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 33


1 Market overview and product
positioning
2 Introduction to the
OceanStor 9000
3 Competitive Analysis
4 Application Scenarios
5 How to Obtain Help

Competitive
Analysis

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 34


Comparison of specifications
Item Function/Indicator OceanStor 9000 EMC Isilon Panasas Netapp FAS(C-mode) HDS model4100 SUN Lustre

File Single file system Supported Supported Supported Supported Supported Supported
system Scalability Up to 288 nodes Up to 144 nodes Up to 100 nodes Up to 24 controllers —— Up to 10,000 nodes
Management mode WebUI/CLI WebUI/CLI WebUI/CLI WebUI/CLI —— CLI

Protocol NFS/CIFS/SNMP
NAS/backup/manageme NFS/CIFS/NDMP/SN
NFS/CIFS/SNMP/HDFS NFS/CIFS/NDMP/SNMP NFS/CIFS NFS/CIFS/NDMP/SNMP
nt protocol MP

Search Quick retrieval of Not supported


unstructured and Supported Not supported Not supported Not supported Not supported
structured data
Reliability Mirror, N+1, N+2, N+3, RAID 4/RAID 6 (RAID- Multiple data
Data protection level N+1, N+2, N+3, N+4 RAID15/RAID10 RAID 0,1,5,6,10 duplicates
N+4 DP)
——
File-based protection
policy with dynamic
Folder-based protection policy Supported Not supported —— ——
adjustment of
protection levels

Automatic fault Supported


Supported Supported Supported Supported Supported
recovery

Performa Up to 100 GB/s per


Up to 1.6 GB/s per node; Up to 2000 MB/s per
system
nce Bandwidth Linear performance Up to 1.2 Gbit/s per node 1600 MB/s (AS12) —— system (mixed reads
improvement and writes)

OPS (SPEC sfs2008 5,030,264 OPS, 1.63-ms 1,112,705 OPS, 2.54-ms No current test results 1,512,784 OPS, 1.53-ms 607,647 OPS, 0.89- ——
NFS testing) average latency average latency posted average latency ms average latency
Data restoration rate 1 TB/hour 1 TB/hour —— —— —— ——

Value- Snapshot
Load balancing, quota Load balancing, quota
added Load balancing, quota Quota management,
management, dynamic storage management, dynamic Snapshot, remote
feature management, snapshot, dynamic storage
Value-added features tiering, snapshot, storage tiering, snapshot, replication, and quota
remote replication, and tiering, and remote
asynchronous replication, remote replication, and management
deduplication replication
WORM, and video image repair deduplication

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 35


Competitive analysis: EMC Isilon
Isilon OceanStor 9000
P25 Isilon OceanStor 9000
S-Series
S200
OPS

OP
S210 S
OneFS OceanStor DFS
Performance Accelerator/ InfoAllocator (quota management)
SmartQuotas
Backup Accelerator SmartConnect InfoEqualizer (load balancing)
Smart Pools InfoTier (storage tiering)
X-Series
Bandwidth

InsightIQ Device Manager (device management)


X200 P12
SnapshotIQ InfoStamper (snapshot)
X400 SyncIQ InfoReplicator (remote replication)
P36/C36 SmartLock InfoLocker WORM
X410
Aspera for IQ Absent
SecureVideo (video image repair)
C72 (advantage)
Capacity

NL400

HD400

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 36


OceanStor 9000 vs. EMC Isilon
Advantage of OceanStor
OceanStor 9000 EMC Isilon
9000
Data reliability N+1 to N+4 data protection N+1 to N+4 data protection

Architecture Fully symmetrical distributed architecture Fully symmetrical distributed architecture

Performance 1. Up to 1.6 GB/s bandwidth per node 1. 1.2 GB/s bandwidth per node
Outperforms Isilon
2. OPS: 5,030,264, ORT: 1.65 ms 2. OPS: 1,112,705, ORT: 2.54 mss
Data
Up to 1 TB/hr Up to 1 TB/hr Faster speed than Isilon
restoration
Scalability 3 to 288 nodes 3 to 144 nodes Higher scalability than Isilon
1.2 times larger capacity than
Capacity Up to 60 PB Up to 50 PB
Isilon
Global cache Up to 55 TB Up to 20 TB Larger cache than Isilon

NFS, CIFS, NIS, Microsoft Active Directory, CIFS, NFS, HTTP, FTP, NDMP, SNMP, LDAP,
Protocol LDAP, SNMP, FTP, JDBC, ODBC, HDFS, ADS, NIS, HDFS, iSCSI (OpenStack is to be
NDMP supported.)

Load balancing, quota management, dynamic


Load balancing, quota management, dynamic
Value-added storage tiering, snapshot, remote replication,
storage tiering, snapshot, WORM, SecureVideo,
features vCenter, Aspera backup acceleration,
and asynchronous remote replication
deduplication, and auditing
Performance
In design; planned for future releases Supported
monitoring

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 37


OceanStor 9000 VS Hadoop HDFS
OceanStor 9000 Hadoop HDFS Comparison
Three copies of the same data, reducing Hadoop HDFS has lower space
Data reliability N+1 to N+4 data protection
space utilization utilization.
Namenode metadata causing system
Reliability Fully redundant system components, free of Hadoop HDFS is susceptible to
performance bottlenecks and single points of
metadata nodes and single points of failure single points of failure.
failure
1. Up to 1.6 GB/s bandwidth per node
Performance
2. OPS: 5,030,264, ORT: 1.65 ms ——
3. Recovery time: 1 TB/hr
Hadoop HDFS does not provide
Cluster ISM, a unified and visual management
Unified management is unavailable. hardware, so it is unable to provide
management interface
unified management.
Load balancing Supported Not supported
Quota management Supported Not supported
Dynamic storage Hadoop HDFS provides a few
Supported Not supported functions and does not support
tiering
value-added functions.
Snapshot Supported Not supported

Remote replication Supported Not supported

Permission Not supported


Supported
authentication
Not supported
Data encryption Supported

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 38


1 Market Overview and
Product Positioning
2 Introduction to the
OceanStor 9000
3 Competitive Analysis
4 Application Scenarios
5 How to Obtain Help

Application
Scenarios

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 39


M&E scenario —TV station
Ingesting Editing system M&E storage archiving
system library
Editing Packaging Rendering
Low read
latency Large
capacity
Stable read Low TCO
bandwidth Tape/cloud storage
Low read latency

M&E management/
Playout system Online M&E library
Standby Upload & Cataloging
Playout Retrieval
playout download
……

Robust stability Efficient query


Enhanced reliability Fast acquisition

Traditional solutions adopt isolated architectures, complicating resource sharing and


capacity expansions while prolonging the time needed for deployment.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 40
M&E scenario — HD production and news production
storage solutions
News recording News editing

Content Content
acquisition design and
creation

OceanStor
9000 OceanStor
Standby playout 9000 News M&E



Rendering, synthesis
and transcoding

HD production highlights News production highlights


 Leading performance: The fully symmetric and distributed  Leading performance: The fully symmetric and distributed architecture
architecture allows a single node to provide 800 MB/s stable allows a single node to provide 800 MB/s stable bandwidth and
bandwidth and support the concurrent production of 64-channel support the concurrent production of 64-channel 100 Mbit/s HD videos.
100 Mbit/s HD videos. Its performance is 30% higher than its next- Its performance is 30% higher than its next-leading competitor, and
leading competitor, and can be improved as the number of nodes can be improved as the number of nodes increases.
increases.  Secure and reliable: Huawei's shockproof and anti-corrosion patents
 Easy expansion: on-demand addition of performance and capacity enable the system to tolerate faults on up to four nodes.
with online expansion capabilities.  Simple maintenance: Both the front and back ends support all IP
 Simple maintenance: Both the front and back ends support all IP networks, which are simple to deploy and maintain.
networks, which are simple to deploy and maintain.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 41
M&E scenario — M&E library storage solution

Highlights
• Large capacity: A single node
provides up to 432 TB capacity, and a
unified namespace provides up to 60
Upload/
download
Material
collection
Cataloging/ Review Transcoding PB capacity, enough storage for
Recording query cluster
approximately 1.5 million hours of HD
video.
• Elastic expansion: All-IP
interconnection and on-demand
procurement. Online expansion of
nodes can be completed within 1
Process/web
Migration
application
Archive minute, and the whole process is
server server Online Near-line
server transparent to users.
OceanStor 9000 • Low TCO: The capacity density is
over 100 TB/U, reducing occupied
space and lowering procurement
costs.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 42


M&E scenario — converged production storage
solution
Standby
Highlights
Recording Production M&E library playout
Converged: Storage resource pools are
Low bit-rate High bit-rate
workstation workstation shared by ingesting, editing, playout,
management, and storage services, and
these services can be deployed and

Editing/rendering/ Catalog/indexing/ Broadcast and


configured on demand. Tiered data
Satellite/camera/DVD Editing/rendering/
composite composite transcoding/web control
storage, intelligent migration, and life
cycle management are available.
Elastic: fully distributed architecture and
IP
Network

all-IP interconnections. Storage resource


layer

pools can be scaled up to 60 PB. New


services are rolled out with high
efficiency.
Storage resource

High-performance resource pool (tier 1) Large-capacity resource pool (tier 2) Efficient: unified namespace, linear
performance improvement with the
pool

addition of nodes. The bandwidth for


upper-layer production services is larger
than 10 GB/s.
OceanStor 9000
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 43
M&E scenario — tapeless cold data, online applications, and
instant migration back
Disk prices drop at a faster speed.
Nearline
Traditional distributed

tape Online M&E There is a new generation in LTO standard tapes every two years, and
library library Online their prices are on the decline.
storage Using IBM LTO tapes as an example:
0-5
storage

2 - 25 2 0.5 2.5 2.5 minutes


minutes minutes minutes minutes minutes Nominal
File Capacity Native Reference Price Per TB of Native
Located Tape File Queuing
transfer Tape Model
Queuing
capture loading transfer (Compression Capacity Price (RMB) Capacity
Ratio: 2:1)
IBM LTO5 3 TB 1.5 TB 420 Yuan 280 Yuan/TB
IBM LTO4 1.6 TB 0.8 TB 320 Yuan 400 Yuan/TB
7 - 30 minutes 2.5 - 7.5 minutes IBM LTO3 800 GB 0.4 TB 240 Yuan 600 Yuan/TB

15% drop year by year

OceanStor 9000 unified namespace

Low amount of
Storage resource pool

Tier2
concurrent processing
Tier3

Tier1
20% drop year by year
• If there were no innovative technologies, the prices of tapes and
< 1 minute: migration rollback across tiers disks would be the same in 2017, while the price of tapes would be
lower than the price of disks in 2018.
• SMR technologies reduce tape prices and make them equal to
disk prices by 2015 or 2016.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 44


Solution advantages
Excellent performance Energy conservation Efficiency improvement

1. The only NAS supporting 6-layer 1. High-density design, supporting 1. Converged architecture,
HD editing. OceanStor 9000 up to 60-PB capacity and allowing one system to support
single-node performance is 30% reducing the M&E library space end-to-end service processes
higher than that of Isilon. by half. 2. Convenient data movement
2. Two times higher scalability than 2. Low power consumption, saving across systems, eliminating
the industry average, supporting 30% in power consumed by the cross-system migration and
a larger range of applications. M&E library improving efficiency by 40%

Shenzhen Liaoning TV Henan TV Guangzhou


China Central Yunnan TV
broadcasting and Station Station TV Station
TV Station Station
TV project

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 45


Video surveillance scenario — video cloud center
solution for Safe City
Converged aggregation,
wider range
Service
systems Real-time Intelligent Image Facial GIS
retrieval
Open architecture, massive storage space,
analysis detection recognition system
easy access
Convergence of various video data

High efficiency, quicker response


Network Share Analysis Archive

Video Parallel architecture, flexible capabilities,


Storage pool multiple processing modes
cloud
Highly efficient analysis of various types of
center video assets
OceanStor 9000
Secure data, full reliability
Video
capture Distributed RAID, elastic redundancy, and
and automated DR add even more assurances
collection Cell Commerce Road Metro
to the reliability of key videos assets

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 46


Video surveillance scenario — unified namespace, on-
demand application, and resource convergence, enabling
data aggregation
A single namespace of
up to 60 PB

An open architecture offers a unified


storage resource pool of up to 60 PB.
Different types of video are centralized for
enhanced storage and management
efficiency.
After system expansion, the additional
resources can be added into the
Safe.com/video resource pool for immediate use,
simplifying system maintenance.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 47


Video surveillance scenario — robust reliability adds
greater assurances to the searchability and traceability of
discovery data (clues)
Multiple layers of video
security technologies
 Distributed data
redundancy
Parity data is distributed on multiple
nodes; faults on more than one node
do not affect service continuity.
+1 +2  4 redundancy levels for
+3 +4 key video assets
4 copies of redundant data are
generated for key video assets.
Elastic  DR protection
redundancy Automated DR and backup for key
Fast video assets, achieving zero loss of
video data.
recovery

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 48


Solution advantages

Elastic expansion Secure and reliable Ease of use

1. Standard interfaces, up to 60-PB 1. Proprietary multi-level reliability 1. Unified view and central management
resource pool, and central technology, fast data recovery, of edge and central nodes
storage of video data video data repair, and DR 2. Single namespace, free of RAID, LUN,
2. Two times higher scalability than assurance for key data and independent hot spare disks
the industry average, supporting
a larger range of applications.

Karamay Safe St. Petersburg Safe City Jining Safe City


City Project Project Project

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 49


HPC scenario — satellite mapping
Satellite signal receiving and processing Process:
Satellite signal 1. Satellite signal processing: High-
processing
frequency carrier signals are encoded and
decoded to obtain desired image data.

2. Satellite image data processing: Image
Coding/Decoding data is processed with various methods,
including image dehazing, logical division of
Map World
scenes, and 3D imaging.
Digital terrain Satellite image
applications processing applications 3. Map World applications: Satellite
… Editing workstations … mapping application center provides online
mapping applications with access to a large
Distributed file systems
Web servers Oracle database
number of microfilmed map files.
Analysis workstations
4. Offline archive: Processed logical scenes
and 3D images are archived offline to tape
ETL systems every seven days.
5. Digital terrain applications: The terrain
LAN Free
changes during a specific period of time are
analyzed, and data is transferred from offline
Analysis Offline Offline
Online high-end storage disk systems to analysis systems
storage tape library archive

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 50


HPC scenario — satellite mapping
Satellite signal
processing Challenges

 Coexistence of large file (GB to 10 GB level)
Coding/Decoding
and small file (KB level) storage, large file
Image query system
read/write (up to 200 GB of a single file)
Satellite image editing system Image analysis system
 TB-level data generated and PB-level data
Web servers
stored every day

Smartphone
 Images generated in batches, requiring high-
Editing PC
Editing workstations workstations throughput storage
 Raw data loss not allowed

Solution

Digital landscape
application

 Up to 1.6 GB/s performance per node, meeting
the storage requirement of a large number of
images
Online Near-line  Dynamic storage tiering, improving storage
access efficiency by 5 times
Free of data loading
 Linearly scalable from 3 to 288 nodes, making
OceanStor 9000 expansion easier to support business growth

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 51


HPC scenario — earthquake prediction and oil
exploration
Earthquake Earthquake Earthquake Oil reserve
Visualized
simulation data data exploration
imaging
collection processing simulation

Earthquake data processing procedure


Oil exploration computing need
analysis:
General
1. Reflected wave data collection:
Pre-stack time/ Post-stack
handling depth migration handling handling Simulate earthquakes and use
equipment to collect the reflected waves.
2. Earthquake documentation
handling: Collect the kinematics and
Computing Data processing dynamic information about the
earthquake wave, and generate the
 The increase of processing  The increase of exploration data based on the geological
precision and algorithm area and data capture density information.
complexity call for improved require enhanced data 3. Oil reserve exploration
computing capability. processing capability.
simulation: Using advanced
computing and analytics; the geological
characteristics of source oil, oil
reservoirs, and caprock can be worked
out.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 52
HPC scenario — gene sequencing
Process:
Gene sequencing (454): The intermediate data of
DNA library preparation, PCR amplification, and
pyrophosphates sequencing needs to be stored for
Human health Animal/plant Pharmaceuticals Micro-organism around half a year, and then archived after 1 year.
research research Data analysis: The length of raw data extends to
tens of base sequences. These sequences are then
assembled or compared to obtain existing or similar
Species Gene sequencing Analysis gene sequences, and generate results with
result biological significance.
Gene Data Gene
sequencing analysis library Gene library: The library stores and manages the
national genetic resources, biological information,
and gene data.

The volume of data generated by genomics


increases ten-fold every 12 to 18 months,
much higher than that of Moore's Law.
Therefore, biological enterprises and
research institutes are facing rather
Trace
database/SRA Basic National gene significant challenges in obtaining the
databases library
database needed level of data analysis and storage.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 53


HPC scenario — gene sequencing
Challenges
 High-performance, large-capacity, and flexible scalability in
Health data
storage required to meet continuous business growth
 Compatibility with Hadoop: The storage system must be

compatible with Hadoop.

Experimental  Complex management: Data was manually migrated from the
data computing cluster to tier-2 storage, and the process was
complicated.
 High cost: Traditional backup software was used to import data
DNA Compound Tier 1 storage to tapes.
sequencer library

…… Solution

……  On-demand expansion: Storage performance can be


linearly improved according to service requirements.
 HDFS APIs: compatible with Hadoop environment, no need
…… for secondary development.
Hadoop HPC  The storage system provides data storage and analysis
cluster capabilities, which automates the data migration process
Tier 3 storage Tier 2 storage and simplifies management.
 No need to purchase backup software, thereby lowering
procurement costs.

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 54


OceanStor 9000 HPC storage solution

Computing node Computing node Computing node


Head queue 3
queue 1 queue 2
… Data computing
collection nodes

10GE or
InfiniBand switch

GE switch
Core switch
(10GE or InfiniBand
switch)

User query
access
OceanStor 9000
GE network

10GE or InfiniBand network

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 55


Solution advantages
Outstanding performance Flexible expansion Ease of use
1. Up to 1.6 GB/s performance per node, 1. Expandable from 3 to 288 nodes, on- 1. Expansion of a single node
3 times higher than the industry demand deployment and procurement, completed in 1 minute, single
average, greatly reducing the time linear improvement of performance namespace
need to complete computations. and capacity 2. Free of RAID, LUN and hot spare
2. Interconnection between HDFS APIs 2. Up to 60-PB system capacity, 3 times disks, simplifying system
and Hadoop ecosystem higher than the industry average management

Geophysical Shanghai China Meteorological Tsinghua University Beijing Institute of


Prospecting Astronomical Administration Project Project Genomics Project
Bureau Project Observatory Project

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 56


Financial application scenario — enterprise
content management (ECM)
ECM system Requirements

 The storage of receipt image/transaction data and


report files requires file sharing services.
ECM
 The data volume is large and data needs to be
ECM stored for a long time, so online capacity expansion
and near-seamless improvements in performance
ECM must be assured to avoid data loss.

Receipt Content
Important Scanner images/ server cluster
credentials Transaction of branches Solution
data
 Fully converged architecture for data sharing and
efficient access.
 The number of nodes, performance, and capacity
can increase as service requirements expand. The
Online content storage system provides up to 288 nodes and 60 PB per
system file system.
Archive system
 Industry-leading performance, efficient and
OceanStor 9000 simultaneous access of small files.
 Different protection levels to suit the needed level
of data protection..

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 57


Carrier XDR application scenario
Online business hall,
Online business hall,
customer service, reception
Rating customer service, reception
desk, and mall Rating
system desk, and mall
system
Bill detail
record import Bill query Bill detail
record import Bill query
Scheduled
export Scheduled
Oracle export
Oracle

IBM P595 IBM P595

OceanStor 9000
IBM DS8300

XDR scenario requirements: MPPDB advantages:

ODBC and JDBC interfaces are provided to interconnect with The OceanStor 9000 significantly reduces TCO compared with
service layers. traditional architecture comprising Unix servers + high-end SAN +
professional database software,
Data generated within the last 3 months is stored in databases, and
that generated within the last 3 to 6 months is stored after Speed of searching mass structured data is vastly improved while
compression. efficiency of complicated associative queries is improved by 200%.

Continuous data growth create the need for large capacity expansion. Standard SQL interfaces are available, so service logics do not need to
be adjusted.
Detail records generated within the latest 6 months can be queried,
with a latency shorter than 5 seconds. Near-zero learning curve, and ease of maintenance and management

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 58


1 Market Overview and
Product Positioning
2 Introduction to the
OceanStor 9000
3 Competitive Analysis
4 Application Scenarios
5 How to Obtain Help

How to Obtain Help

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 59


Marketability tool (For details, see the OceanStor 9000
Configuration Quotation Guide.)
 Field engineers can use Unistar, SCT, and eDesigner to configure quotations. The contents in Unistar and SCT
are synchronized. eDesigner provides quotations for media & entertainment solutions.
 Use the permission-controlled SCT to configure a non-typical network. Please contact SAs for solution design
and configuration.

Configurator Version Release Date Description Status

Formal Enterprise network (In 2015.04.25 FusionInsight Hadoop and MPPDB are offline. (For the latest policy, see Online
configurator China/Outside China) the sales guide.) WushanFS remains unchanged.

Carrier (Outside 2015.09 C30 value-added software is added, including snapshot, asynchronous To be released
China) remote replication, and WORM.
Nodes are updated to P25, P12, P36, C36, and C72.

Carrier (in China) 2015.04.28 FusionInsight Hadoop and MPPDB are offline. (For the latest policy, see Online
the sales guide.) WushanFS remains unchanged.

2015.09 C30 value-added software is added, including snapshot, asynchronous To be released


remote replication, and WORM.
Nodes are updated to P25, P12, P36, C36, and C72.

Permission-controlled SCT (SAs and 2015.04.25 A manual quotation template is not used in the C01 version. Online
SEs only.)
2015.07 C30 value-added software is added, including snapshot, asynchronous Online
remote replication, and WORM.
Nodes are updated to P25, P12, P36, C36, and C72.

eDesigner 2014.09 Media & entertainment solutions Online

2015.07 Video surveillance solutions To be released

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 60


Obtaining documentation

 W3 internal documentation platform


http://3ms.huawei.com/mm/msl/documentList.do?method=getTopicDocDetails&topic_i
d=1000620
 Huawei enterprise business website
http://e.huawei.com/cn/products/cloud-computing-dc/storage/massive-storage/9000
 Official channel documentation
http://enterprise.huawei.com/ilink/cnenterprise/partners/partners-zone/channel-data-
tool/products-info/it-applications/storages/cloud_storage/index.htm

HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 61


HUAWEI ENTERPRISE ICT SOLUTIONS A BETTER WAY

Copyright © 2015 Huawei Technologies Co., Ltd. All Rights Reserved.


The information in this document may contain predictive statements including, without limitation, statements regarding the future financial and operating results, future product
portfolio, new technology, etc. There are a number of factors that could cause actual results and developments to differ materially from those expressed or implied in the predictive
statements. Therefore, such information is provided for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the information at any time
without notice.

You might also like