Professional Documents
Culture Documents
数据库闪存加速器
1,951.4
2,000.0
1,467.9
1,500.0
1,015.9
1,000.0
621.7
475.4
500.0 308.5
0.0
2010 2011 2012 2013 2014 2015 2016
• The Big Data market scale is estimated to be $16.9 billion in 2015, and data storage
occupies the largest market share, which will reach $3.19 billion with a CAGR of 61.4%.
• The market share of distributed NAS will reach $2.5 billion in 2015, with a CAGR of
about 40%.
• EMC Isilon is a typical scale-out NAS system, and other
mainstream NAS vendors include NetApp, HP, and Dell.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 5
What is Big Data?
Volume: huge data volume 2.9 million emails Tens of terabytes of logs generated Hundreds of terabytes of
generated every minute every day videos uploaded
• Central data storage and computing
cannot process the huge amount of data.
CAGR
20% Structured data 80% 63%
Variety: varied data types and sources 60%
40% 32%
Unstructured data
• Logs/pictures/videos/files/locations 80%
20%
0%
Structured Unstructured
data data
e-commerce Social networks
Velocity: fast analysis and • Translates information to promote sales and • Fast analyzes user behavior to achieve
enhance user loyalty. intelligent marketing
processing speed
Mobile Internet advertisements Internet of Things (IoT)
• Timely and efficient analysis of mass data • Rapidly adjusts content to precisely attract • Generated a tsunami warning only 9 minutes
target audience. after the earthquake occurred in Japan in 2011.
Source: IDC
Performance Cost
Data blocks are managed according to their Big Data processing requires
access frequencies, which cause data high-performance systems,
separation, low automation level, high data which adds cost pressure.
migration cost, poor effectiveness, and
complicated management.
Traditional technologies are challenged in Big Data
lifecycle management.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 8
Big Data challenge 3
Converged
• Converged system architecture,
replacing costly data migration
Standard
• Standard scale-out capability,
addressing unexpected data growth
Simple
• Simple configuration and deployment,
OceanStor 9000 Big Data reducing management complexity
storage system
4,500,000
3,500,000
2,016,450
2,500,000
1,007,611
1,512,784 1,592,334
1,500,000 1,112,705 506,126
500,000
10 20 40 100
EMC Isilon NetApp Avere Huawei nodes nodes nodes nodes
OPS
http://www.spec.org/sfs2008/results/sfs2008.html
OPS: number of concurrent requests processed per second
•
Install devices and
connect cables.
Install devices and
Manages different file
connect cables.
Manage HBAs.
• ManagesInstall
Install devices and
connect cables.
a single
devices and file
connect cables.
Create directories.
systems
Configure HBAs. < 100 TB Manage
Plan RAID. RAID and hot
spare disks.
Configuresystem:
the network. 60the
Click PBexpansion
button.
Share data.
Plan RAID and hot Configure RAID and Manage LUNs. Create directories.
spare disks. hot spare disks.
Share data.
Configure RAID and hot Plan LUNs and hot Manage file systems.
spare disks. spare disks.
Share data.
Adjust the data volume
of each file system.
Disk enclosures
1 TB data
recovery 9.5 hours 10 hours 1 hour
time
file2 file3
19:00 snapshot data
WAN /a/b/c
/d/h/j
Directory-based replication
One-to-many or many-to-one replication
Full or incremental replication
Real-time monitoring of replication tasks
OceanStor 9000 OceanStor 9000
WORM directory
configuration
Tailored WORM clock Read-only Administrator
WORM logs
Protection mode
(manual or automated)
management
Physical resource
PC
Two types of system resources: Physical
and logical resources
management
Logical resource
Four types of alarm notification methods:
Email, audio, SMS, and indicators
Pad
performance
P25 storage nodes
P12
C72
Throughput
Open architecture
Standard X86 server platform
Broad definition on interfaces, suitable for all
semi-structured and unstructured data
processing
OceanStor 9000
OceanStor DFS
Distributed file system
M&E management/
Playout system Online M&E library
Playout Standby Upload & Cataloging Retrieval
playout download
……
High-performance resource pool (tier 1) Large-capacity resource pool (tier 2) Efficient: unified namespace, linear
Storage
tape Online M&E LTO standard tapes have a new generation every two years, and their
library Online prices are on decline.
library
storage Using IBM tapes as an example:
storage
Application
layer
File system
layer
Network
layer
System
integration
HPC industry
50%
10GE or
InfiniBand switch
GE switch
Core switch
(10GE or InfiniBand
switch)
User query
access
OceanStor 9000
GE network
Elastic Linear expansion from 3 to 288 nodes, 60 PB capacity per file system,
expansion addressing service development in the following years.
Huawei solution
Deployed one Huawei OceanStor 9000 to match service and
upper-layer applications, provided 2.4 GB/s throughput, and
supported the real-time editing from 40 craft editing
workstations.
Supported the diversified workstations including packaging,
transmission, and dubbing, as well as data exchange among
islands.
Customer benefits
Key points: Reliable and 24/7 system running, offering sustainable support for
CCTV editing services
Distributed architecture, high Simple operation, maintenance, and capacity expansion,
scale-out capability, and non-disruptive improvement of
performance, and high reliability performance and capacity
Huawei solution
Deployed 10GE networking and 30 storage nodes (20 for online storage and
10 for archive storage).
Configured the symmetric distributed architecture and the 40 PB single file
system (scalable up to 288 nodes).
The overall system storage architecture combined online and archive storage
to enable the hierarchical storage for media and non-media files.
Customer benefits
Quality services thanks to the all IP networking architecture and large
throughput, capacity, and resource sharing
"Compared to other NAS storage from different vendors, Huawei Brilliant scalability for future needs due to the advanced architecture, symmetric
OceanStor 9000 is proven to be quite competitive in terms of the distributed design, and linear increase of performance and capacity as storage
performance of stable and ultimate read and write bandwidths. I nodes grew
am quite impressed by the test result of bandwidth's linearly Ensured reliability because of the full redundancy deployment and N+M data
scalable capability as storage nodes increase."
protection
- Supervisor Zhao, technical management center of SZMG
Huawei solution
Provided a video cloud storage solution for 12,000 channels of
cameras.
Deployed an OceanStor 9000 with 2 PB of capacity (would be
expanded to 15 PB in the future).
Configured the N + 2:1 redundancy algorithm for striking a perfect
balance between disk utilization and reliability.
Benefits
Key points: distributed Enhanced resource utilization because of the unified resource pool for
all service systems in Saint Petersburg
architecture, powerful scalability, Sufficient data storage capacity in the future thanks to the scalability to
and single namespace
288 nodes
Smooth transition to video analysis because of the future-oriented
solution
Huawei solution
Huawei video cloud storage solution, offering up to 25 PB capacity
Video storage: Data collected by 4500 HD cameras can be stored for
30 days.
Real-time display: Important surveillance data can be displayed on the
screens in data centers in real time.
Retrieval of historical video data on government website.
Customer benefits
Key points: central construction, Excellent scalability: The storage system can be flexibly scaled to
accommodate the addition of more cameras, reducing the procurement
scalability, and three professional cost.
storage technologies Professional storage technologies: Such technologies as video repair,
data restoration, and key video DR improve device reliability and
secure key data.
Huawei solution
High-speed Internet technologies, providing a total bandwidth of 5
GB/s
Single file system, reducing system management and maintenance
complexity, eliminating data silos, and improving disk utilization rate
Distributed architecture, providing a maximum of 288 nodes
Huawei solution
Deployed 38 Huawei OceanStor 9000 storage systems in 4 districts divided based on
business volumes for data storage and archiving.
Configured the N+M redundancy mode for data protection, ensuring data reliability.
Huawei solution
Used the all-IP interworking technology to add a new backup and archive system
based on the existing storage systems.
Deployed a Huawei OceanStor 9000 storage system, three RH2288 V2 servers,
and Simpana.
Configured a unified view for central management.
"Huawei's solution, easy and efficient, perfectly
addresses our problems because it deploys a full-IP Customer benefits
network and a unified and visual backup and archive Adaptable to the 3- to 5-year business development planning thanks to elastic
scalability and linear performance increase in line with capacity growth
system without changing our existing system Zero data loss thanks to advanced data protection technologies and highly reliable
networking architecture. This solution is exactly what designs
we need." Unified management for easy usage, clearly demonstrating system activities,
- Haris Broumidis, CEO, Vodafone Ghana reducing O&M complexity, and lowering O&M cost
Fully utilized storage resources, reduced device quantity, and simplified system
O&M management due to the central and unified data backup and archive system
Over 20% TCO saved when comparing with the original storage systems
Huawei solution
Deployed an OceanStor 9000 big data storage in the Sydney production
center to back up VM service data with Simpana.
Deployed another OceanStor 9000 big data storage in the Brisbane backup
center and used Simpana to replicate data from the production center,
implementing backup data DR.
Customer benefits
Optimal user satisfaction because the backup speed was faster than 1500
GB/hr, 25% higher than Brennan IT's expectations
"With a distributed architecture, Huawei OceanStor 9000 big On-demand capacity expansion because the industry-leading architecture
data storage has outstanding scalability and its bandwidth and
enabled performance and capacity to linearly increase with the number of
capacity can increase linearly as nodes grow. This is why we
nodes, meeting future business development requirements
choose the OceanStor 9000 big data storage to cope with our 30% O&M costs saved thanks to easy deployment, management, and
future business needs."
maintenance
- XX, Director, Brennan IT
Rendering, synthesis
and transcoding