()

(Internet Data Center:IDC)Enterprise Data Center:EDC

Service Data Center:SDC
 1

2
DMZ

3FC SANIP SAN

4

Internet
Internet

6()

 3GDC3-
5kW/10kW+

1-2

DCDC+IT


IT(CAPEX)(OPEX)
(Accenture)IT72%
1.1
 ITx86

IT
ITIT
ITIT
IT
Telifonica
85+
50,000+
35+
5+ , 20+
4000+
10+
25+
10+ PB
15+140+700
19.21.25.69PBIT
39%32%
 1150050002
31
02500
200250040001

EDC

RDC

100ms8RDC///
//

SRSR

(SR1)///////

(SR2)

(SR3)


VDC
 100G

IaaSPaaSSaaS

IT

IT&CT

 ITIT

15%CPU60%

5(10/
500/)

ITIT
IT

3

PUE(Power Usage Effectiveness
)2.53.01.5


DC

VDCVDC
VROUTER,VFW,VLB

SCOpen APIVDCOCVDC
VDC




ITIT

ITIT

IT

ITIT

TCO


IDC

VDCVDI
IDC

IT
 CSS & VS

VS8

CSS4

TRILL

512

IETF

nCenter

100010-20

API:


 ITIT as Service

ITaaS = IaaS + NaaS + PaaS + BKaaS +DRaaS + SaaS

SDDCIT
ITaaS

SDDC = SDC + SDN + SDS SDDCSDC

SDNSDS

ITaaS= IaaS + NaaS + PaaS + BKaaS + DRaaS + DCaaS ITaaS:

IaaS,PaaSNaaSBKaaS
DRaaS (SECaaS)

ITSLA

ITaaSIT

vSphere/KVM/XEN

SLA

SCOC,RD,domain

 VDC

VDC

VDCSLA

VDC

VDC

VDC

APP

DC(Data Center): Is the physical place with the entire physical infrastructure (HW, Storage,
Network Elements, Racks, Power, Cooling ) and its management systems.

VDC(Virtual Data Centre): Is the "The Service of Data Centre" that can be used. The
Telco/Services Platforms are deployed on the VDCs, A VDC is an isolated entity and shall
have: its own Manager System, its own IP Address management, its own
communications

VDCDCaaSVDC



SLA

 SDN
OpenstackOpenstack
Router/Firewall/Loadbalance/NetworkSDN
LoadbalanceFirewall




19462

15001500140

19571958

 1994

21
IT
IT

2010180

IT


 IT
IT










/




1



 2IT


3

4IDC


IT







IT
//ITIT






















IT
ITIT
IT

ITIT

PUE

ITIT

3
 4

 UPS10%
(EER) 3.5~5.5
5%PUE1.6~2.0

PUE,PUE

 2.



L1
8

ATSUPS

/8

8
ATSUPS




 L1

IT

L1

UPS/

KVMRFID




1985
1988EIA)TIA
ANSI TIA/EIA 568A




6
7
 ://

8
9
10
 IDS2000IDS2000
UPS

UPS2000-A1-10kVA

UPS2000-G1-20kVA

UPS5000-E25kVA800kVA

UPS5000-A: 30kVA800kVA

UPS
UPS

 IDS2000NetColNetCol5000
NetCol8000

EC

 NetEco6000
3D
NetEco6000
ManageOne
17
 NetEco6000
3D
NetEco6000
ManageOne
 IDS2000NetHos67%
IT


 NetEco6000
SNMP\Modbus


 80A10K UPS100A20K UPS
 RPDURPDU

RPDUITRPDU

RPDURPDU
RPDU




600*1200*2000mm/600*1100*2000mm
600*1350*2000mm

26/40Ah4065/100Ah20

10K UPS2020K UPS4020K UPS



N+1

11KW7.5KWIT


 IT,

(Virtual Data Center
VDC)VDC

IDCInternet Data CenterIDC

IDC200
8.5127
1000
10
110

IDC
 IDCIT

IDC


iTVipad



QOS

70%

 e2e

Qos



VPN
 IaaS: infrastructure-as-a-service; PaaS: platform-as-a-service; SaaS: software-as-a-service

VDI: Virtual Desktop Infrastructure VDC: Virtual Data Center

 :


145000
,IT

Gartner 10GE TOR 2011

40GE/100GE


 IT

IP
VLAN


FCOE DCB

 IT





ERP
IT
OS
MySQL MongoDBSQL Server

2OverlayFabric

EDC


3Overlay
OverlayoverlyaOverlay
Overlay
overlay NFV

3Overlay
OverlayoverlayOverlay
Overlayoverlay

VPCRSPPortal

SDN Controller Agile Controller

API

OpenFlow/OVSdb/Netconf

Fabric

Overlay

VXLAN

VLAN

vswitch/

VFW
 VTEP Overlay
VTEP
L3
L3SpineService leaf
EVSVLANAC
VTEP Overlay
VMVTEPEVS
BMVTEP
VML3EVS
BML3
VTEP Overlay
VMVTEPEVS
BM
L3EVS
FW/LB
under
 Spine

VXLAN FabricIP
Leaf

Leaf

VXLAN FabricVXLAN

Fabric

SpineLeaf

Service leaf

LeafFirewallLoadBalanceL4~L7VXLAN Fabric

Server leaf

LeafVXLAN Fabric

Border leaf

LeafVXLAN Fabric

NVE
 Network Virtualization Edge
NVENVEUnderlayOverlay

VTEP

VXLAN Tunnel EndpointsVXLANNVEVXLAN

VTEPIPVTEP IP
VTEP+VXLAN

VNI

VXLAN Network IdentifierVXLANVXLANVXLAN

VXLAN L3 Gateway

VXLAN L2 GW

VXLAN BridgingVXLANVXLANVXLAN

VXLAN L3 GW

VXLAN RoutingVXLAN IP GatewayVXLAN



1.

2. ACOverlay

3. FabricUnderlay/Overlay

4. L4-L7

5. Bare Metal

ACNetconfOpenFlowOVSDBSNMPREST ful

ACREST ful

Overlay

VTEPESXi/Hyper-
V/KVM/XEN

ACJAVA SDKREST FulRPCetc

VSAAgile Controller OpenFlow



openstack Juno

openstack Juno

AC

ACopenstack neutronAC

FusionCompute

Vmware vCenter

Microsoft system center

 1

AgileController

AgileControllerJAVAvCentervSwitchLocal Network

vCenter(//
Local Network

AgileControllerJAVAvCenterVM/

//
 1

AgileController

AgileControllerJAVAvCentervSwitchLocal Network

vCenter(//
Local Network

Nova-SchedulervCenterDrivervCentervSphere
ESXiNova-Scheduler
vSpherevCenterDynamic
EntitlementsResource Allocation settingsESXi
LBDRSNova
 AgileController

AgileControllerJAVAvCentervSwitchLocal Network

vCenterLocal
Network

AgileControllerJAVAvCenterVM/

//
 Nova-SchedulervCenterDrivervCentervSphere
ESXi

Nova-SchedulervSphere

vCenterDynamic EntitlementsResource Allocation settings

ESXiLBDRSNova

AgileControllerJAVA-SDKvCenterRPC
vSwitchAgentVM vSwitchVSSVM vSwitch
PORTGROUP

AgileControllerOpenFlow/OVSDBCE1800VOverlay

 DriverOpenStack

ODLDriverOS



overlay

overlay

overlay

LB

NFV

Overlay

DC SDNVXLAN Overlay

DC


overlay

overlay

overlay

LB

NFV

Overlay

DC SDNVXLAN Overlay

SDN
SDN



overlay

overlay

LB

NFV

Overlay

overlayEVSvxlanVTEP

CEvxlan

underlay

overlayDC SDNVXLAN Overlay

 CloudEngine 12800CE12800
VRP8
L2/L3

CloudEngine 12800
160Tbps576100GE57640GE230425GE
230410GE
CloudEngine 12800Clos
CloudEngine
12800
CloudEngine 12800CE12816CE12812CE12808CE12804CE12808S
CE12804S

160T
CE1280010Tbps20Tbps
160Tbps320Tbps
CE12800CE8800/CE7800/CE6800/CE5800
TOR25GE
10GE 4T CE128003.6Tbps
36*100GE/36*40GE/144*25GE/144*10GE
576100GE57640GE230425GE230410GE 18GB
 CE12800100GE/40GE/10GE/GE
18GB
200ms CE12816
CE12816
CE1283232 CE12832Clos
CE12816 CE12832
CE12816

 USG9500
TNATVPNIPS
99.999%
Mbps
USG9500USG9520USG9560USG9580

USG9500
VPN

IPS5000Web
SQL
AV500

120+
WordExcelPPTPDFRAR30+

SSLSSLIPSAV
URL
Anti-DDoS SYN floodUDP flood10+DDoS500


URLURL8500
FTP

VPNIPSec VPN
L2TP VPNMPLS VPNGRE

QoS
QoSURLQoS

FC SANIP SAN

 200

L2xSTP/CSS/SVFL2
Fabric

/


headoop

SPINE-LEAF

SPINE-LEAFSPINELEAF
SPINE

IPVXLANTRILL
Fabric

 10GE
40GE 100GE 24
24CSS/iStack

PODPOD
CSS/iStackxSTP
SVFSwitch Virtual Fabric


ACLQOS

VLANIGMP Snooping

DHCP snoopingDAIIP Source GuardMFF

LAGiStack

QoS

GE/10GE

EOR/TOR


NSFSmartlink

VRRPOSPF

SSL


;10GE/40GE

/,

iStack/CSS

CSS + LAG + iStack

22

xSTPms

IP

VRRP,

Trunk ,



PODTOREOR

ERP



EORTOR 2

2STP

:TIA942









LB

1.

IDS/IPS

SSL VPN

LB()

2..
.DMZ


VLAN/ACL

LB1

LB2

NetStream,
 TOREOR

TOREOR



//

TOREOR/MOR

GE10GEPOD

TOREORMOR

EORMORTOR
 MACMAC2

MAC

Trunk

MACMAC2

MAC

Trunk





RDPVNCTelnetSSHplsqlsqlplusFTPSFTPHttp
Https

KVM


KVM

KVM
.

,,

NAS IP SAN FC SAN

IPMPLS VPN
VPLS

SANDWDM

NAS
IP10G


WANQoS
 MPLS VPN

MPLS VPNMPLS VPNL3VPNL2VPN

VPN
SOHO
 VPNL2TP over IPSecSSL VPN

L2TPL2TP
L2TPIPSec

SSL VPNHTTPSSecure HTTPVPN

SSL VPNSSL
SSL VPNWeb

 LBFW IPS/IDS SSL VPN

FWIPS
IPS

LB
FWVPN

ISPLB

 IO

/KVMSAN
IP

CPU

IP

IP

 > 100m

2GE2GEIP1FE
1GE

8103

 LB

LB

LBLB

WEB3msW3SSE

WEB/APP/DB

UnixWEB/APP/DB4/40/20

WEB/APP/DBIP

WEB
 VLAN,

,VLAN,VLAN

VLAN,:

VLAN:

VLAN

VLAN

L3,

VLAN:

VLAN

VLAN

VLAN:

,,VLAN

VLAN


IP FRR

VLAN

MSTP

OSPF

()Area 0

OSPF
Area ID 1,2,N

Area 1,2..N OSPF NSSA LSA

Area 0
 FWLB

FWLB

LBLB

LBLB

FWLB


()Area 0

OSPFArea ID
1,2,N

Area 1,2..N OSPF STUB LSA

LB

LB

 23

XXXXVOIP

XXXXXX,


MPLS

DCDC



23

DWDM

IP+

OTNFCEthernetFICON

50ms


OSN

OSN(FCIP

,50ms
 VPLSMPLSVPN,VPLS
LAN

VPLS

VPLSIP/MPLSVPLS

VSI(Virtual Switch Instance)

PWPseudo Wire

ACAttach Circuit)


CSS+VPLS

Full Mesh

CSSxSTP

H-QOS

 PEMPLSSDH

CE

E-TrunkPE

()CSS

PESTPBPDUSTP


OAWeb

L3VPNIPMPLSSDH

5HQos

MPLS/IP
InternetWAN

WAN
MPLS/IP
VPNVPLSMPLS L3VPNGRE VPN

WAN
MPLS/IPInternet
 :Telecommunications Infrastructure Standard for Data Centers
TIA-942



IT

TIA942IEEE

 MTBFMTBF

MTTRMTTR
MTTRMTTR=+
++++MTTR

Reliability Based DiagramRBD



VRRPBFD for VRRP50ms

OSPFISISBGP

GROSPFISISBGPLDP

IP FRRHuawei

BFD/APDP50ms

MPLS OAMFFD10ms~500ms

ETH OAMOAM802.3ahOAM802.1ag802.3ah
100ms802.1ag10ms

 CE128ISSU

11

N+M

N+NN+1

1+1

Map-ReduceIncast

CE12800100GE/40GE/10GE
100ms

 NE50ms

VRP8


VRP8ISSU
ISSUISSU

ISSU

BIOSBasic Input Output SystemOSOperating
System

BIOSOSISSU
BIOSOSBIOSOSISSU

 1/
LACP
LACP


2410Git/s2040Gbit/s
1G10G40G100G

 Eth-Trunk

Eth-TrunkMAC
MAC/IPMAC/IP

HASHHASH-KEY

Eth-TrunkHASH-KEY

MAC
MACIPIPTCP/UDPTCP/UDP

Eth-Trunk

Eth-Trunk
HASHHASH-KEYEth-Trunk
MACIPHASHHASH-KEY



 IEEE802.3adLACPLACP
LACPDULink Aggregation Control Protocol Data Unit

LACPEth-TrunkLACPDU
MACKey



 LACP

LACPLACP

LACP
LACPLACP
LACP

LACP/
LACP

LACP

 LAGLAG

M-LAGM-LAG



IPIPV4IPV6IPV4 VPNIPV6 VPNNickname

 MC-LAGMC-LAG
MACARPIGMP

ARPIGMP

MC-LAG

 NSR

BGPLDPOSPFISIS

RIPRSVP

BGP



 TCPTCPTCP

 NSR

Up


NSR
NSR

NSR



 NSFNon-stop Forwarding

bypass

NSFNSF

()

OSPFIS-ISBGPLDP
RSVP(GR)

NSRNSF
GR-Aware

VRP8NSFhelperNSR
OSPFIS-ISBGPLDPGR Helper
GR
 CSS+iStack/

STP/SmartLink/VRRP.
CSS/iStack10ms

CSSiStack
CSS/iStackCSSiStack

IP
MAC IP MAC

DADDual-Active Detect

Relay
RelayEth-Trunk DAD
DAD DADEth-Trunk
DAD Relay

DAD
Recovery
 downLACPDU

1+1LACP

22

22mac

1
 BFD10ms3
BFD100

Packet length Ethernet header + IP header + UDP header + BFD packet

Ethernet header = 208 bit (26 byte)

IP header160 bit (20byte)

UDP header 64 bit (8byte)

BFD = 192 bit( 24bytes)

Packet length = (208+16064192)= 624 bits

78Bytes100/s8bit/Byte=624000bit/s=60.9Kbps.

BFD
BFDBFD

 BFDBFDBFD
BFDLocal DiscriminatorRemote
DiscriminatorBFDLocal DiscriminatorRemote
Discriminator

BFD
BFDRemote Discriminator0BFD

BFDRemote Discriminator0BFD
BFDBFDLocal
Discriminator
 BFDDownInitUpAdminDownBFD
StateBFD
BFD

BFD

SwitchASwitchBBFDDownDown
BFDBFDRemote Discriminator
BFDRemote Discriminator0

SwitchBDownBFDInitInitBFD

SwitchBBFDInitDown

SwitchABFDSwitchB

SwitchBInitBFDUp

SwitchABFDSwitchB
 VRRPMasterBackupMaster

MasterVRRPBackup
1BFDBackupMasterMaster
BFDBackupMaster
BackupMasterMasterVRRP
BFD50


SwitchASwitchB

SwitchASwitchB
ID

SwitchASwitchB

SwitchASwitchB

OANotesEmail

100km

400km

EVNBGP/MPLS IP VPNSite
PEEVNCEPE
VXLANVirtual eXtensible LANEVN
BGP/MPLS IP VPNPECE
MACPEEVNMACCE
MACPE

PECEEVNCECE
 EVNPECEESIEthernet Segment Identifier
CEPEESICEESIPE
ESIPECEPE
 EVNPEMAC
MACPEPE
PESingle-SidedEVN
BGP ServerPEBGP ServerBGP
BGP ServerPEBGPClientBGP RR
PEPEPEBGP
Single-SidedBGP ServerPEBGP
BGP ServerRR
BGPPE

PEMACMAC
BUM
 EVN



PECE
EVNPEPE



EVNMACPE
MAC
MACPE
MACMAC

MAC
MAC

ARP

ARPARP

EVNPEARPARPARP
ARPPE


EVNDF

CE1PE1PE2CE1PE1PE2PE3PE1
PE2EVNDFPE1PE2
PEPE1DFCE1
PE1CE2PE2DF

PEEthernet Segment Route

ESIPEPEPE
CEPE

PESource IPSource IP
PEPE0

DFPEi=vlan-id mod nvlan-idPE

VLANIDnPEPEivlan-idn

 CE1PE1PE2PE1PE2PE1
PE3PE1PE2PE2
CE1EVNDFDF
DFPE1DFPE2DFPE1PE3
PE1PE2
 CE1PE1PE3PE3
CE1PE1PE1
PE3PE3Site1PE3
PE3PE2Site1MAC

 CEEVNCE
PECE
PE1PE2
 site2EVN
EVNRouterCRouterDRouterCRouterD
VRRPIP192.168.1.1192.168.1.11192.168.1.12
EVN

VRRP

siteEVNPE

CPU
EVN

EVN

EVN
ARPARP



DWDMIP WAN
80FC-SAN
DWDM
80
IP WANInternetDWDM




 GSLBGlobal Server Load Balance

GSLBDNSGSLBGSLBIP
GSLBGSLB
DNSGSLB


VPLSEVNTRILL
TRILL
VPLS
 OTN

CSS
/LAG

OAM

OTNFCEthernetFICON

50ms

 VPLSMPLSVPN
LAN

VPLSVPLS
IP/MPLSVPLS

VPLS PE

IPMPLS


 CEPE(
)PEPW
 CE
PE
CEVPLS PE
 IP IP GREVPLSGREPE
CE
 MPLS TE LSP


 BGP LDP VPLS
LDP LDP BGP
PW
PW VPLS N PE VPLS NN-12
VPLS PE VPLS N100
LDP 4950

VPLS HPLSHierarchicalVirtual
Private LAN ServiceHVPLS
QinQ PW

 VPLS

CECE

CEPEE-Trunk Smartlink Mstp

PEPEPE

PE PWBFDPW
 DCEVN
PECEMPLS

EVN4K VLANVLAN
DCEVN16MVLANEVNBGP
MACMAC
 EVNVPLS

EVNBGPMAC
MACMAC
EVN

EVNPEBGPBGP
PE
EVN

PEARPMACIP
PEARPMAC
PEARPARPPE

EVNMPLSVXLANVXLANPE
EVN
 EVNPE
PEN
EVNPE

 CEPEEVNVLAN

 CEPEEVNVLAN

 EVNMAC in UDPPE
EVNPEP
MACHash

 L3VPNMPLS L3VPNIP/MPLS
L3VPN

MPLS L3VPN
CEPEPEMPLS L3VPN

IP/MPLSL3VPN
CEPEPEMPLS L3VPN

 CEPE

OSPFCEPEBGPOSPFISIS
PE CE

OA
Multi-VPN-Instance CE

Multi-VPN-Instance CE CE OSPF
OSPF VPN ,VPN OSPF
Multi-VPN-Instance CE .
 PEPEVRFRDRT
,


VPNVPN
 ,VPN,
PE RT Import Target Export Target Export
TargetVPNImport TargetImport Target
VPNExport Target
 VPN

PC1 VPN
VPN

VPN

VPN
 EVN

PEEVN

EVNCEPEPE
CEPEPEPE
CE

PE
EVNPEEVNEVN
EVNEVN
EVN


EVN

GeoclusterIP

DC

DCPOD

POD

PODEVNEVNPODDC

PODEVN

DDoS

Web server

DMZ

IDCIDC

IDCDevice&Testinternet
SMB

IP/FC SAN



 DC

DC

\\DC

DC

DC

 WEBportal/ APP\DB

DMZ

DMZDMZ
DMZDC

DC/PODDC

DMZ

DMZ server

PODPOD
 WEB portal/ APP\DB

DMZ

DMZDMZ
DMZDC

DCDC

POD
DC

PODPOD



DMZDMZ
DMZDC

DC

ACL
 :

DCPOD
DCACL

DCDC
DC



DMZ

DC

DC/
 :

DMZ
IPSAntiDDoS

DMZDC(POD)

PODDMZ
DMZPOD

VM

VM\

VM

ESX/ESXiDeep Security
VMvShield Endpoint

VMVMVMDeep
Security

VM
Deep Security

Deep Security IDS/IPSAVWEB

Deep SecurityVM
 Deep Security

DSM/vCenter DSAV;

ESXiDSAV,DSAV

ESXivShield EndPoint Driver

DSAVvMotion

DSAV*10MB


VM

VM

VM

VM

VM

vSwitch\MUX VLAN
VMVLANVMVLAN

VM

TrunkPVLANVLAN

VLAN
VLAN
VLAN


IPIP

VS1VS2

VS2VRFIP

VMVS2VRF;

VRFtrust

VS2VRFtrust

untrustVRFOSPF

vFWVS2VRF

vFWVS1VS1

NATvFWUntrust


ip

VS\

VSVRF

VSvFW,VMvFW;

VS
vFWVS

VRF2vFWuntrust
trust

VMvFWuntrustNAT

VRF



IP

untrust\trust

VLAN;

untrsut
VRF2VRF2

IP

untrustVRF230
VRF

VRF2


vlan

VRFVRF
VRFVRF

VRFLBIDS
VRF

VRFVRFOSFP;

VRFVRF


TRILL

TRILLCE VLAN

VS1VS2VS1TRILLVS2

VSVLAN

VS1\2
VLAN

CE VLANCE VLANTRILLVS2
VS1

VS1

1VLAN

2VLAN


VLAN

VLAN

VRRP

VLANARP

TRILLFabric

1VLAN

2VLAN
 iSoC

UMA

SSL VPNUMA

KVM

OracleSybaseSQL ServerInformixDB2

SQL
pcap

InternetNGFW/DMZ

DMZ

DDoS

IPDC

\vFW,vFW

 eSight



ATIC

ATICBGPIP

GRE

Offline IP

ATICAnti-DDoS

BGPIP

InlineDDoS

+
 SVNSSL
443

SVNIP

IPNAT

webIP
SVNSVN



Anti-DDoSDDoS

NAT

DMZDCDMZ

SSL VPN

DMZDMZIPS

webWAFhttp/httpsweb



DDoSAntiDDoS

NAT

IPS

DMZAVE

WebWAFwebDMZ
webWAFhttp/httpsweb

SSL VPN:SVN

DMZ



1.
IPSecVPN

IDS/IPS

SLBLLBGSLB

2..
.DMZ

InternetSDHMPLS VPN
InternetInternet

IPSecVPN
VPN
IPSec VPN

VRFvFWVLAN



LANWAN

Internet
VPNIPSec VPN
\
VPN


SDH\MSTP

DC

DC
IPSecVPN

 &

USG

DeepSecurity

ESXiDeepSecurity



UMA

iSoC



+ +
+

/




IP


VRRPOSPF


IP


IP
IP





VPNVPN Instance


 DDoSInternet



DDoS

DDoS

Anti-DDoSDDoS
DDoS
DDoS
DDoS
,
DDoS

 Anti-DDoS

UDP FloodDNS FloodICMP Flood

SYN FloodACK FloodSYN-ACK

FloodTCP Fragment Flood

DNS Query FloodDNS Reply

FloodHTTP FloodHTTS FloodSIP Flood

FIN/RST FloodTCP
TCPSockStressDNS Cache Poisoning
DNS SSL-DoS/SSL-DDoSHTTP Slow Header/Post Attack

CC
TCPTCP Flood

SVN

SSL VPNSSL443
SSL VPNIPIP
NAT

SVN
SVN
IPIP
URL

SVN
ITSSL VPN
TCP/UDPNAT
SSL VPN

 SVN

SVNSVN

13DES\DESRC4AES

2RSA

3HashMD5SHA-1

SVN
(
)

SVN

1
 SVNSVNSSL



IPS
(
)
()
TCP

 IDS
IDS
IDS
IDS
 IPSIPSUTMIPS
IPS
 UTMIPSUTMIPSIPS

UTMIPSUTMUTM

 IPS

IPS


 ICSA 1%93%email2%Internet
4

SQLSlammer

CPU

Anti-Virus
Anti-Virus

Web Web

Internet


ITIT

IT

 ,

SSL VPN


PlanetLabEmulab,
(National Science FoundationNSF)
GENIGlobal Environment Networking Innovations)
 1 IP

2IP

3~5

3IP
IETFRFC7000

 10

SDNNFV

DCSDNNFVSDNNFV

SDN/NFV

SDN

SDN+NFV

or


 x

xx

/
,


()

XX

xxxxAC

xxAC

AC

DMZinternet

AC

 /

 SpineSpineSpineLeaf
IP Fabric

LeafLeafCE6800Spine
LeafunderlayL2/L3Spine
LeafToRZTPToR

UnderlayOSPFSpine-LeafIP ECMP
LeafSpineECMP
ECMPL4 PortVXLAN

 OverlayVXLANVTEPVXLAN L3 GW
vSwitchVXLANOverlay
OverlayOverlay

CE68TORVTEPCE12800
VXLAN L3 GWOverlay

SDNVXLAN

TORMACARP

 VXLAN


 VXLANSpine
4K VRF4K VNI

FWLBL4-L7
VMware

VXLANTOR
VNIFWLB
L4-L7

 SpineSpine
Spine
Spine

SpineSpine/Leaf/
Spine

VXLAN
BDIF IP/MACVTEP IPVM

VXLAN L2 GatewayVTEP IPUnderlayIP ECMP
DFS
GroupPeer linkARP/MAC

VRF/Subnet/RIB/FIB/ARP/MAC

TR5-2


VRF/Subnet/RIB/FIB/ARP/MAC/ACL/QOS

ToRVNI
AC

4
4K4K25K ARPARP
120K

 VPCNATEIP
ACVPCVPCVXLAN
GWVRFACVXLAN GWVRF
IPVPC
VRFIP

VPCpublic VFW()
VXLAN GWpublic VRFpublic VFW
Public VRFinternet
public VRFvlanInternetVRF
Internet
 VPCMPLS VPNAC
VPCVFW
ACVXLAN GW
VRFVRFAC
VPCVFW
VRFVRFPE/
VRF
VPNVXLAN GWAC
 VPCVMvSwitchVPCDVR
VPCNVEVXLAN
VXLAN GWVXLAN GWVPCAVRVPC
VFWVFWACVPCVPC
VFWVPCVFW,VFW
VPCAVRVXLANVM
NVE

VPCVFWVLANVPCAVRAVRVPC
ACVXLAN GWVRFVRF
IPVPCAC
AC
 IPSec VPN

IPSec VPNACipsec vpn

VPCVFWipsec
vpnIPSec VPN

SSL VPN

SSL VPNVXLANVXLAN GWSSL VPN

ACSVNSVNSVN
VLANAVRSVNAVRVPN
AVRVLANVLAN

SVNSVNACSNAT443
SVNIPNATSVN
SVNVPCVPC
AVRAVRVXLANVMNVE
VM


WAFIPIP
ACACIPWAF
web server

WAFVXLANVXLAN GWVLAN
VXLANVXLAN GWPublic VRFWAFpublic VRF
IP

ACWAFIPACVXLANVXLAN GW
public VRF-ip-any
ip-web serveripTCP80\TCP443\-waf
IPWAFVXLANVXLAN GW
VXLANVXLAN GWPublic FWVPCVFW

web serverACVXLANVXLAN GW
WAFVXLANVXLAN GW
 AC1N

64

 HTTPHTTP

FabricIP

IPSSH

NetConfOpenFlow


IPIP

 /

VPCRSPPortal

SDN Controller Agile Controller

API

OpenFlow/OVSdb/Netconf

Fabric

Overlay

VXLAN

VLAN

vswitch/

VFW
 AC <->

Restful

AC<->VMM

ACVMMRPCVM

AC<->/VSA(

ACnetconf

LB<->BIG-IQ<->F5-Agent

F5 LBF5neutronAgentLB
BIG-IQBIG-IQ

AC<-> VTEP

ACVTEPTORnetconfOpenFlow

NetconfACTOR VTEP

OpenFlowACVXLAN

AC<->vSwitch

ACvSwitchOpenFlowOVSDB
 OVSDBACvSwitchVMPortAC
vSwitchvlan

OpenFlowACvSwitchVXLAN
 DriverOpenStack

ODLDriverOS



1+

2Underlay->Overlay

3License

1FusionSphere

2VMware/

3OpenStackGBP

4Subnet/Router/FWACL/SNAT/IPSec VPN

AgileController

AgileController

2ARP

 DLUX: ODLWEB Portal

RESTFUL APINeutronMD-SALAPI
API

OpenStackGBP

(
OAM

MD-SAL ODL
APIJava

OpenFlowNetConf SNMPOVSDB

ODLPlugIn

Overlay

VTEPESXi/Hyper-
V/KVM/XEN

1.
2. ACOverlay
3. FabricUnderlay/Overlay
4. L4-L7
5. Bare Metal

ACNetconfOpenFlowOVSDBSNMPREST ful
ACREST ful
ACJAVA SDKREST FulRPCetc

VXLAN Overlay
 Spine

Spine

SpineLeafIP Fabric

SpineLeaf2*3=612/28

Leaf

LeafiStackM-LagSVF

LeafSpine

LeafSpine

LeafToRZTPToR

UnderlayOSPFSpine-LeafIP ECMP

LeafSpineECMP

ECMPL4 PortVXLAN

 1.

SpineBorder LeafService Leaf

Border LeafService Leaf

2.

Border LeafService LeafSpine

FW/LBSpineSpine

FWSpine

POD

3. A

Service LeafBorder Leaf

Spine

4.
 Board LeafService Leaf
Spine

Service Leaf



VM
Underlay

IP ECMP

BDIF IP/MACVTEP IPVM

VXLAN L2 GatewayVTEP IPIP ECMP

DFS GroupPeer linkARP/MAC

FW/LBService Leaf
 FW/LBService Leaf

VRF/Subnet/RIB/FIB/ARP/MAC

Ping



VRF/Subnet/RIB/FIB/ARP/MAC/ACL/QOS

ToR
VNI

POD

POD

44K4K25K ARP
ARP125K

VRFVRF

 AC

SpineECMP

VRFSubnetACLQOS

UnderlayOSPFVTEP123IP

ACvRouterNetworkToRNetwork
vSwitchVLAN

VM1VM4BD 1VNI1VM2VM3BD 2VNI2ToR12

VM1~4VXLAN

VM1VM4ARPARPToR1ToR2
VM1VM4MACUnderlay(VTEP1<->VTEP2)

1.VM1VM4SMAC/SIPVM1VLANX(vSwitch
ToR1VLAN)DMACVM4MACDIPVM4IP

ToR1VLANVNI 1MAC
VNI1+VM4 DMACMACVTEP 1->VTEP 2

2.VTEP 1VXLANMACMAC
NetMacVXLANIP FabricVTEP2

3.VTEP2VXLANVNI1DMAC:VM4MAC
VLAN YVM4
 vSwitchVLAN:YVM4

L2ACARPMAC
Underlay


UnderlayOSPFVTEP123IP

ACvRouterNetworkSubnetToR
NetworkvSwitchVLAN

VM1VM4BD 1VNI1VM2VM3BD 2VNI2ToR12

VM1~4VXLAN

VM1VM3ARPAC
ARPL2/L3

1.VM1VM3VLANX(vSwitchToR1
VLAN)

ToR1VLANVNI 1MAC
VNI1+ BD1 DMACMACVTEP 1->VTEP 3

2.VTEP 1VXLAN

2DMACBD1 MAC
VM IP3ARPVTEP3->VTEP2

 3.VTEP 3VXLANVNI2SMACBD2
MAC

4.VTEP 2VXLANVNI 2+VM3 MAC3MAC

VLAN YVM3

vSwitchVLAN:YVM3


ACFW

ACFW

ACGWPBR

VM1VM3PBRFW
VXLAN

FW
DIP

ACGW

GWFWDIP VM3 IPVTEP3-

>VTEP2

VM1VRF1VM3VRF2MACARP

ACVRF1VRF2vFW1vFW2

ACNAT

VM1VM3VM1VM3EIPVM3VM3 EIP)
VM1VRF1:BDIF1

ToR1VXLANVTEP1->VTEP3
VRF1BDIF1

VXLANVM3 EIPVRF1
vFW1

FWVM3 EIPvFW2NAT
VRF:BDIF2

vFW2E-W

FWEIPIPNAT
NAT


VM1VRF1MACARP

ACVRF1vFW1

ACNAT

vFW1Public-vFW

Public-vFWvFWVLANRouter

Public-VRFPublic vFWRouter


VSAAgile Controller OpenFlow

vSwitch

Internet VSAInternet

VPC

6
7


9
VSAARPMACVSA
VSAoverlay
VSAoverlayoverlay
VSAIGWIPSec VPN GW

vSwitchVSA
ARPVSA

hrp enable

hrp interface g x/x/x x.x.x.x

hrp interface g x/x/x remote x.x.x.x

track

hrp track interface g 1/0/0

hrp track interface g 2/0/0

10
11
 NeutronACACDVR
ACDVR
neutron

Neutron vRoutervRouterDVR

NeutronDVRvRouter
DVRPort2vRouterPort3
NeutronPort4vRouter
NeutronACvRouterPort4vRouter
NeutronACvRouterPort3ACVSA
vRouterDVR
NeutronACDVRDVRPort2IPPort3IPAC
vRouterDVRARP
uplink
NeutronACDVRvRouter
NeutronACRouterACvRouter
DVR
NeutronACDVRAC
VMDVR3AC

13
15
 Service leafVPCAVR

VPCVMVTEPVPC
VTEPVXLAN L3 GWvRotuervrouter
VNI/VLAN
Service leafVPCAVR
VPCvRouterAVR

AVRDVR

VPCvSwitchvrouterVNI
vrouter

VMDVRIPVPC
AVR

AVR

22
27
 VDC CPU

VDC

47
FusionManager
VPC
VPC

48
49
50
51
 *F5 BIG-IP LTM
 DC

VPC

->VPC

DCDCvDCDMZ VPC
VPC

DMZ VPC
VPC

VPC1DMZvFWNATVPC23
VPC

VPC1vFW

54
 Email

Email

VDCEmailVDCVDC
Email
Email

75
77
78
79
80
81


AgileController

AgileControllerJAVAvCentervSwitchLocal Network

vCenter(//
Local Network

AgileControllerJAVAvCenterVM/

//
 1. AgileController
RESTAgileController

2. AgileControllerOverlayVNIPODP+V1:1
VLAN-IDVLANVNI

3. AgileControllerJAVAvCenterVMware VDSLocalNetwork
PORTGROUPLocal VLAN-IDPORTGROUP

AgileController
AgileControllerVMware VDSPORTGROUP
PORTGROUP
 vCentervCPURAM
ROM

vCenter
ESXi

vCenterPORTGROUP
PORTGROUP

vCenterPORTGROUPESXiPORTGROUP

AgileControllerJAVA-SDKPORTGROUP

ACPORTGROUPLocalVLANVNIACLLDP
ESXiTORACNetconfTOR
LocalVLANVNI
 vCenter

vCenterVMESXiVM
PORTGROUP

vCenterESXiPORTGROUP
PORTGROUP

AgileControllerJAVA-SDKPORTGROUP

ACLLDPESXiTOR ACTOR
LocalVLANNetconfTOR
LocalVLANVNI
 VM:

ESXivSphere HAVM
DRSVM

VM

vCenterESXi

vCentervSphereVM

AgileControllervCenterVMESXi

AgileControllerLLDPTORnetconf

 VM

1. ESXivSphere HA VM
DRSVM

2. VM

1. vCenterVM

2. vCenterVMESXivCenterESXi

3. AgileControllervCenterVM
ESXi

4. AgileControllerLLDPTORnetconf



AgileController

AgileControllerJAVAvCentervSwitchLocal Network

vCenter(//
Local Network

Nova-SchedulervCenterDrivervCentervSphere
ESXiNova-SchedulervSphere
vCenterDynamic Entitlements
Resource Allocation settingsESXiLBDRS
Nova
 AgileController
RESTAgileController

AgileControllerOverlayVNIPODP+V1:1
VLAN-IDVLANVNI

AgileControllerJAVAvCenterVMware VDSLocalNetwork
PORTGROUPLocal VLAN-IDPORTGROUP

AgileController
AgileControllerVMware VDSPORTGROUP
PORTGROUP
 OpenStackNOVA

NOVANeutronCreatePort
ACNeutronDriverNetwork

NOVAvCenter-Driver
vCentervSphere

AgileControllervCenterVMVM
VMPORT-IDNeutronVMNetwork
NetworkVLANVXLANOverlayVNIPORTGROUP
LocalVLAN

AgileController JAVA-SDKvCenterPORTGROUPVLAN

vCenterNova-vCenterDriverPORTGROUP

Nova-vCenterDrivervCenterVMPORTGROUP

AgileControllerVMPORTGROUPVMTORLLDP
TORnetconfVLANVNI
 OpenStackNOVA

NOVAvCentervCenter-DrivervCenter
VMPORTGROUP

AgileControllervCenterVM

AgileControllerPORTGROUPPORTGROUP
PORTGROUPJAVA-SDK
vCenterPORTGROUP

AgileController

AgileControllerTORLLDP
TOR

AgileControllerTORNetwork
netconfVLANVNI

NOVANeutronPORT

AgileControllerDriverNeutronPORTPORT

 VM

ESXivSphere HAVM
DRSVMNovaVM

VMNovavSphere APIvCenter
VM

vCenterESXi

vCentervSphereVM

AgileControllervCenterVMESXi

AgileControllerLLDPTORnetconf

vCenterNOVA
 VM

ESXivSphere HAVM
DRSVMNovaVM

VMNovavSphere APIvCenter
VM

VMRESTNOVA

NovavCenterVMvCentervCenterDriver
vCenter API

AgileControllervCenterVMESXi
LLDPACTORnetconf

vCenterNOVA
 AgileController

AgileControllerJAVAvCentervSwitchLocal Network

vCenterLocal
Network

AgileControllerJAVAvCenterVM/

//
 AgileController
RESTAgileController

AgileControllerOverlayVNIPODP+V1:1
VLAN-IDVLANVNI

AgileControllerJAVAvCenterVMware VDSLocalNetwork
PORTGROUPLocal VLAN-IDPORTGROUP

AgileController
AgileControllerVMware VDSPORTGROUP
PORTGROUP
 vCentervCPURAM
ROM

vCenter
ESXi

vCenterPORTGROUP
PORTGROUP

vCenterPORTGROUPESXiPORTGROUP

AgileControllerJAVA-SDKPORTGROUP

AgileControllerRPCvSwitchAgentvSwitchVM
PORTGROUP

ACPORTGROUPLocalVLANVNIAC
OpenFlowvSwitchLocalVLANVNI
 vCenter

vCenterVMESXiVM
PORTGROUP

AgileControllerJAVA-SDKPORTGROUP

AgileControllerRPCvSwitchAgentvSwitchVM
PORTGROUP

ACPORTGROUPLocalVLANVNIAC
OpenFlowvSwitchLocalVLANVNI

vCenterESXiPORTGROUP
PORTGROUP
 VM

ESXivSphere HAVM
DRSVM

VM

vCenterESXi

vCentervSphereVM

AgileControllervCenterVMESXi

AgileControllerRPCvSwitchAgentvSwitchVM
PORTGROUP

AgileControllerPORTGROUPLocalVLANVNIAC
OpenFlowvSwitchLocalVLANVNI
 VM

ESXivSphere HAVM
DRSVM

VM

vCenterVM

vCenterVMESXivCenterESXi

AgileControllervCenterVMESXi

AgileControllerRPCvSwitchAgentvSwitchVM
PORTGROUP

AgileControllerPORTGROUPLocalVLANVNIAC
OpenFlowvSwitchLocalVLANVNI
 Nova-SchedulervCenterDrivervCentervSphere
ESXi

Nova-SchedulervSphere

vCenterDynamic EntitlementsResource Allocation settings

ESXiLBDRSNova

AgileControllerJAVA-SDKvCenterRPC
vSwitchAgentVM vSwitchVSSVM vSwitch
PORTGROUP

AgileControllerOpenFlow/OVSDBCE1800VOverlay

 OpenStackNOVA

NOVANeutronCreatePort
ACNeutronDriverNetwork

NOVAvCenter-Driver
vCentervSphere

AgileControllervCenterVMVM
VMPORT-IDNeutronVMNetwork
NetworkVLANVXLANOverlayVNIPORTGROUP
LocalVLAN

vCenterNova-vCenterDriverPORTGROUP

Nova-vCenterDrivervCenterVMPORTGROUP

AgileControllerRPCvSwitchAgentvSwitchVM
PORTGROUP

ACPORTGROUPLocalVLANVNIAC
OpenFlowvSwitchLocalVLANVNI
 OpenStackNOVA

NOVAvCentervCenter-DrivervCenter
VMPORTGROUP

AgileControllervCenterVM

AgileControllerCE1800VNetwork

OpenFlowVLANVNI

AgileControllerRPCvSwitchAgentvSwitchVM
PORTGROUP

NOVANeutronPORT

AgileControllerDriverNeutronPORTPORT

 VM

ESXivSphere HAVM
DRSVMNovaVM

VMNovavSphere APIvCenter
VM

vCenterESXi

vCentervSphereVM

AgileControllervCenterVMESXi

AgileControllerRPCvSwitchAgentvSwitchVM
PORTGROUP

AgileControllerPORTGROUPLocalVLANVNIAC
OpenFlowvSwitchLocalVLANVNI

vCenterNOVA
 VM

ESXivSphere HAVM
DRSVMNovaVM

VMNovavSphere APIvCenter
VM

VMRESTNOVA

NovavCenterVMvCentervCenter
vCenterDrivervCenter API

AgileControllervCenterVMESXi

AgileControllerRPCvSwitchAgentvSwitchVM
PORTGROUP

AgileControllerPORTGROUPLocalVLANVNIAC
OpenFlowvSwitchLocalVLANVNI

vCenterNOVA
 VMwareVSS/VDSOVSDBOpenFlowACVMware
vSwitchvSwitchAgentVMwareVSS/VDS

vSwitchNVEAgileControllerOpenFlowOVSDBvSwitch
VXLANRPCvSwitchAgent
vSwitchvSwitch

vSwitchvSwitchAgentVM
VMwareVSS/VDS

vSwitchNVEAgileControllerOpenFlowOVSDBvSwitch
VXLANRPCvSwitchAgentvSwitch
vSwitch


vSwitchvSwitchAgentAgileController
RPC

CE1800V ovavCenter

vCenterovaVMVM
vSwitch

VM vSwitchESXiVMDRS

VM vSwitchvSwitchAgentvSwitch
IPAgileController

ovavSwitch VMESXi
DRSvMotionESXiVM

ESXiEVS VMvSwitch VM
vMotion
 DriverOpenStack

ODLDriverOS



HTTPHTTP
Active-Active

UI

Master

Master

Netconf
IP

IP
 PODSDN

PODSDN

--SVF

DCVLANXSTP/CSS/SVF

iStack








DC

web


WEBAPP


DBAPPDB



overlay

overlay

overlay

LB

NFV

Overlay

DC SDNVXLAN Overlay

SDN
SDN



VRF

VXLANVXLAN
VTEP

VTEPvxlanMAC


overlay

overlay

overlay

LB

NFV

Overlay

FW/BR

L2BRVLANVNI

SDNDC

SDNDC SDNVXLAN Overlay

L2BRL2BR
VLANVNI

 VLANtrunkL2BR

L2BRVLAN-VNIVXLAN
vxlanVTEP

VTEPVXLANMAC

L2BR

1M-LAGL2BR;

2L2BRXSTPL2BRXSTP


overlay

overlay

LB

NFV

Overlay

overlayEVSvxlanVTEP

CEvxlan

underlay

overlayDC SDNVXLAN Overlay



VRF

VXLANVXLAN
VTEPEVS

VTEPvxlanMAC
 SDNVLANSDN
VLAN

VXLANVM

VXLANvSwitch

CPU

IPMAC



VLANVPNVirtual Private Network

IEEE 802.1QVLAN Tag12
4096VLAN

VLAN/VPN

10GE
40GE100GE


VLAN+xSTP



IPTCP

WEB-APP-DB


TTL

 STP


 TRILL

1000

IS-IS

TRILLhop-count

 VXLAN

VXLANVLAN IDVXLANVNIVXLAN
Network ID2416MVXLAN

VXLANIPMAC

 VNBGPMAC
MACMAC
EVN

EVNPEBGPBGP
PE
EVN

PEARPMACIP
PEARPMAC
PEARPARPPE

EVNMPLSVXLANVXLANPE
EVN
 STP

Trill

VXLANSDN

EVN
 M-LAG(Multi-Chassis Link Aggregation Group)

M-LAG
M-LAG

peer-link
 M-LAGM-LAG

M-LAGPeer-Linkm-LAG

M-LAG
OSPFM-LAGM-LAG

M-LAGIP

 DFSDynamic Fabric Service Group

M-LAGpeer-linkM-LAG
M-LAGM-LAGDFS Group
DFS Group

M-LAGDFS Group
DFS GroupMACMAC
M-LAG

M-LAG

M-LAGpeer-link

peer-linkM-LAG
M-LAGMACARP



MSTP
SwitchA
SwitchBM-LAGSwitchSwitchASwitchB

SwitchASwitchBM-LAG
SwitchASwitchB

M-LAG

SwitchASwitchBM-LAGSwitchCSwitchD
M-LAGM-LAG
M-LAGV-STP

 M-LAG
AOC

M-LAGSVFSVF
CE8800&7800&6800&5800
CE8800&7800&6800&5800

M-LAGSVFSVF

peer-link
 M-LAG

NOPEERLINKpeer-link

NOADDRESS

SAMEMACMAC

TYPEMISMATCH

TIMEOUT

PEERLINKDOWNpeer-linkDOWN

DETECThello

CMTDOWNTRILL CMTDOWN
 CSSCluster Switch System

CSS

CSS

CSS

CSSTRUNK

 CSS

CSSOpex

CSSCSS

CSS
MSTP

100

CSS
CSSCSS

 CE5800 CE6800
 CSS

CSSCSS

CSS

CSS
CSSCSS

CSSCSS
CSSCSSCSS



Master

Standby

Slave

Domain ID
 ID

IDMember ID
ID

CE5800CE6800CE7800CE8800
Stack-Port1Stack-Portn/1n
ID

CE12800Stack-
Port1Stack-Portn/1nID


CSS
CSS

CSSMAC

CSSGE

CSSCSS
CSS
 SIPSIPSIPGEGE
ComboCombo


 CE12800SSIPDown
Up

SIP

SIP
 1+1LPU

N+MN>=1, M>=2LPU



 MPU

MPUCSS

MPUMPUMPUCSS

MPUMPUMPUMPU
MPU

CSS

CSS

ETH-Trunk

CSS

CSS


CE12800

VRSPC

MACMAC
 Eth-TrunkHASH

 DAD

DAD

Active
Recovery

DAD

MACMAC

Recovery

Active
ActiveRecovery
Active



IP
MACMACIPMAC


 2016/8/29

ISSU

IDID


MACIP

TrunkCE5800/CE6800-Atrunk1

trunk HashCE12800-A
trunk HashCE12800-B
CE12800-BCE12800-B

CE5800/CE6800-ACE12800-A

 Trunk3Mesh

Mesh

 CE12800CSS:2CE12812CSS40GE
CE6800CE12800CE6800mesh
Trunk580810GE

TORTOR

2440GE/*11/*2/4/TOR 132

10GE4410GE/TOR*132TOR = 5808

(4*40GE) : (44*10GE) = 1 : 2.75

 CE12800CSSCE5800CE6800GE10GE:2
CE12812CSS10GECE5800CE6800
25344GEMesh

CE12800CSS

 CE5850HICE5850EI
CE6850HICE6851HI

CE5810-24T4S-EICE5810-
48T4S-EI

CE6850-48T6Q-HICE6850-48T6Q-HI
CE6850-48S6Q-HI/CE6850U-48S6Q-HI/CE6850U-24S2Q-HI
 IDID

ID
ID1
IDID

Domain ID

 stack renumber new-member-id [ inherit-config ]
IDinherit-config

inherit-config
ID

IDinherit-config
 SwitchA10GE1/0/110GE1/0/21/1

SwitchB10GE1/0/110GE1/0/21/110GE1/0/310GE1/0/4
1/2

SwitchC10GE1/0/110GE1/0/21/1


Stack-Portn/1Stack-Portn/2n
ID
 SwitchA10GE1/0/110GE2/0/1SwitchB
10GE1/0/110GE2/0/1SwitchB
SwitchA
 display stack configuration
ID



SwitchASTACKSwitchBSTACK
SwitchASwitchB

Console
IP
 save
 SVFsuper virtual fabricSVF
CSS/iStackSVF
,

SVF

SVF

Leaf

OPEX

TORTOR

EOR/MORTORserver

CE5810TOR

CE58104*10GE
 SVF
AP
 SVFFabric-port

CE12800
 SVF

Stack

LeafSVF

Auto-negotiationStack
Leaf

SVFSVF
Stack

Stack
Leaf
 LeafIDSVF

ID
ID

 SVF



 SVF
AOC

SVF

SVF

Domain ID
SVF

SVF
ID4

SVFID
44ID

CE5810-48T4S-EI24GE210GE24GE
210GECE5810-48T4S-EI24GE
210GEHASH24GE210GE
HASH
 CE5810-48T4S-EI410GE1

CE5810-48T4S-EIGE24210GE
24GE210GE
24GE210GE
 SVF

system-view

stack

switch svf enableSVF

SVF

SVF

SVF

Console

Ctrl+Y
Press CTRL+Y to modify the switch mode

1. Set SVF enableSVF



Press CTRL+Y to modify the switch mode ....................... 2

Switch SVF Enable Menu

1. Set SVF enable //SVF

2. Continue to boot //

You have 30 seconds to select the menu, the system will continue to boot when time is
up.

Enter your choice(1-2):1

 Fabric-portID

system-view

interface fabric-port port-idFabric-port

Fabric-portport-id132

VS32Fabric-port

port bind member member-idFabric-portID

Fabric-portIDmember-id101254

SVFIDID
IDFabric-port
ID

Fabric-portIDIDFabric-port

Fabric-portID

description descriptionFabric-port

Fabric-port

Fabric-portFabric-port
Fabric-portID

commit
 Fabric-port

Fabric-port

SVFFabric-port
Error: Some conflicting configuration exists.
Fabric-port

Fabric-port system-view

interface fabric-port port-idFabric-port

port member-group interface interface-type { interface-number1 [ to

interface-number2 ] } &<1-8>Fabric-port

commit

system-view

interface interface-type interface-number

fabric-port port-idFabric-port

bcFabric-port

commit
 SVFSVFSVF

display svf [ member member-id ]SVF

display svf configuration [ all | leaf | virtual-system vs-name [ leaf ] ]SVF

display svf topology [ all | link | neighbor | virtual-system vs-name [ link | neighbor
] ]SVF

display svf troubleshooting [ all | virtual-system vs-name ]SVF

display svf link-state last-down-reason [ all | virtual-system vs-name ]SVF

Down
 system-view

dfs-group dfs-group-idDFS GroupDFS-Group

DFS GroupnicknameIP

TRILLDFS Groupnicknamenickname

source nickname nickname-valueDFS Groupnickname

pseudo-nickname nickname-value1 [ priority priority ]DFS Group

nickname

IPDFS GroupIP

source ip ip-address [ vpn-instance vpn-instance-name ]DFS Group

IPv4VPN

source ipv6 ipv6-address [ vpn-instance vpn-instance-name ]DFS

GroupIPv6VPN

priority priorityDFS Group

MACMAC

DFS Group100

commit
 system-view

interface eth-trunk trunk-idEth-Trunk

mode { lacp-static | lacp-dynamic }Eth-TrunkLACP

Eth-Trunkm-LAG
LACP

peer-link peer-link-idpeer-link

peer-linkVLANERPS
VLANTRILLCarrier VLANFCoE VLAN6peer-link
VLANCarrier VLANFCoE VLAN

port vlan exclude { { vlan-id1 [ to vlan-id2 ] } &<1-10> }peer-link

VLAN

commit


system-view

interface eth-trunk trunk-idEth-Trunk

dfs-group dfs-group-id m-lag m-lag-idDFS GroupEth-

Trunk

m-LAGm-LAGID

Eth-Trunk

commit

LACP

system-view

interface eth-trunk trunk-idEth-Trunk

mode { lacp-static | lacp-dynamic }Eth-TrunkLACP

dfs-group dfs-group-id m-lag m-lag-idDFS GroupEth-

Trunk
 m-LAGm-LAGID

lacp m-lag priority priorityLACP m-LAG

m-LAGEth-TrunkLACP m-LAG

LACP m-LAGEth-TrunkEth-
TrunkLACP m-LAGEth-Trunk
Eth-Trunk
Eth-Trunk

m-LAGEth-TrunkLACP m-LAG
Eth-TrunkLACP m-LAG

LACP m-LAGLACPEth-Trunkm-LAGLACP
LACPEth-Trunklacp priority

LACP m-LAGLACPLACPEth-
Trunkm-LAGLACP m-LAGLACP

lacp m-lag system-id mac-addressLACP m-LAGID

m-LAGEth-TrunkLACP m-LAGID

LACP m-LAGIDEth-TrunkEth-Trunk
LACP m-LAGIDEth-Trunk
Eth-TrunkEth-
Trunk

m-LAGEth-TrunkLACP m-LAGID
Eth-TrunkLACP m-LAGID

LACP m-LAGIDLACPEth-Trunkm-LAGLACP
IDLACPEth-TrunkLACPID
MAC

commit
 display dfs-group dfs-group-id [ node node-id m-lag [ brief ] | peer-link ]
M-LAG
 Heart beat stateOK
SwitchANode 1150StateMasterSwitchBNode 2
120StateBackupCausation-Node
1Port StateUpNode 2Port StateUpNode 1Node
2m-LAGactivem-LAG


VS(Virtual System)

VS (Virtual System) Cloud Fabric,

VS
VS
VS




VS
;

VS

VS;

VSVSVS
 VS VS
VS
VSVS
VS
VSVS
VS
VS
VS
VSVSVS
VS
VS
VS
VS
VS In future)
VS/VS
32
VS
 VSVS

VS

VS

VSVS

VSMPLSTRILL

VS

VS

VS
 VSVS

VSVSQos

VSVSVLAN, VRF

VSVS
MAC, ARP, ACL

VS

VSVS240K MAC

VSVS240K MAC
 VSPS
VS

VSVS1VS2VLAN10

PortVS
VLAN4063VS1VS2Port
VS1Admin-VS3000VLANAdmin-VSPortVS2
1063VLAN

GroupVSVLAN4063VS1VS2
GroupVS1VS24063VLAN
VSGroup
VS28441VLAN7GroupVS284417*4063
VLANVLANGroupVS

VSCPUVS/VS
*100%

VSVS
 CSSVSVSCSSCSSCSS
CSSVS

CSSVSCSSVS0CSS
VS

VSCSSCSSVSVS1VS4CSS
/VS

VSCSSCSSVSCSS
VS2VS3VS1VS4

CSSVSCSSVS
VSCE12800V1R18VSCSSCSS
8VS


VS2VS
VSVS

 GroupVSVS
VS10GE1/0/010GE1/0/23
10GE1/0/0vs110GE1/0/010GE1/0/23vs1

GroupVS
display device port-map [ slot slot-id ]
VS
 VSVS
resourcedisplay virtual-
system[ name vs-name ] verboseVS
 vs1vs1IP

VSTelnetSSHConsole
 TRILL (Transparent Interconnection of Lots of Link)IETF
L2TRILL
Ethernet

TRILLISIS

RFC5556Such an approach would develop a new kind of bridge system

that was capable of using network-style routing, while still providing Ethernet service.
TRILL

RBRouter BridgeTRILL

TRILL CampusRB

RBRB
 ECMPTrill16

TrillSPF
CLOS

Trill2vlan

Trill

STP
Trill500

TRILLTTL
 DAMACRBMACMAC

SAMACRBMAC

VLANTRILLVLANTRILL VLAN

Vtrill00

M01

Op-Lengthtrill

HopHop-count 64TTL

E-Rb-NicknameRBnicknamenickname

I-Rb-NicknameIngress RBnickname

Original Frame
 TRILLIngressNickname
MACTRILLNicknameNicknameIngress RB
NicknameEgress RBMAC

TRILLEgress RBTRILLNicknamesMAC

TRILLTRILLMAC
 Trillnickname16bit0x0000~0xFFFF,0x0000
0xFFC0~0xFFFE0xFFFF
0x0001~0xFFBF101-65471nickname

nicknameRBnicknameTRILL
nicknamenicknamesub-tlv
LSPRouter Capability TLV

nickname sub-tlv

priority1 byteRBnickname
nickname128-255192

tree root priority 2 bytesrootroot

nickname1-6553532768

nickname2 bytesnickname

RBLSDBNickname

 EORTRILL

200.

EORTORMAC.

TOREORTORMACMAC

TRILL

TORTRILL

TRILLTOR

>500.

TORCOREMAC

TRILLTOR
 Carrier VLAN

VLANLANVLAN
VLAN
VLANCarrier VLANTRILLETH
RBCarrier VLAN

CE VLAN

CE VLANVLANTRILLETH

Designated VLAN

VLANTRILLTRILL VLANTRILL
VLANTRILL VLANDesignated VLANDVLAN

3carrier-vlancarrier-vlan Designate vlan

TRILLHelloTRILLVLAN
 HelloTRILL DesignatedVLANDRB
MTUAF

Down

Detect

2-WAYMTUMTU

reportMTU
 DRBpppDRB

DRBIIH7bit

MAC

ID8 bit

ISISsystem ID

TRILLLANDRBISISDISDRB

Designated VLANTRILLTRILLDVLAN

VLAN-x ForwarderVLANRBForwarderholding
time

Lsp

CSNP

DowndownTRILL

suspendMACTRILL-HelloDRB
Down

DRBDRBTRILL

NotDRBDRBTRILL
 12Access PortISISLSPLink
RB1nickname3TRILL

TRILL

12Hybrid PortISISLSPLink
RB1RB2Access LinkcostRB1RB2
TRILL12

 TRILLVLAN
A
TRILLRB1RB3VLAN
RBAFAFDRBCE VLAN
AFIngressEgressAFTransit RBRB1AF
RB1RB3

AFDRBRBCE VLAN

DRBDRBRBAF

DRBMACRBAF

MACPortIDRBAF

PortIDSystemIDRBAF

RBAccessHybridRBAF

RBnicknameAF

DRBAF
 LSDB

RB3Hello

RB3LSPLSP
01-80-C2-00-00-41LSP

DRBRB3LSPLSDBCSNP
CSNPLSDBCSNP10

RB3DRBCSNPLSDBPSNP
LSP

DRBPSNPLSPLSDB

DRBLSDB

DISLSPLSP

LSPLSP

LSPLSPLSP
 Remaining LifetimeLSPRemaining
LifetimeLSPRemaining Lifetime
LSPRemaining LifetimeLSPRemaining Lifetime
LSP

Remaining LifetimeChecksumLSP
ChecksumLSPChecksum
LSPChecksumLSPChecksumLSP

Remaining LifetimeChecksum

P2PLSDB

P2PRB1CSNPRB2LSDBCSNP
PSNPLSP

RB1LSPLSPPSNP
LSP

LSPPSNP
LSPPSNPRB1

LSPLSPLSDB
PSNPLSPLSPLSP

LSPLSP
PSNP

LSPRemaining LifetimeLSP
Remaining LifetimeLSPRemaining LifetimeLSPLSDB
PSNPLSPLSPLSP
LSPRemaining LifetimeLSPRemaining Lifetime
LSPPSNP

LSPLSPRemaining LifetimeChecksum
LSPChecksumLSPRemaining LifetimeLSP
LSDBPSNPLSPLSPLSP
LSPChecksumLSPRemaining Lifetime
LSPPSNP

LSPLSPRemaining LifetimeChecksum

 LSPLSPRemaining LifetimeChecksum
LSPChecksumLSPRemaining LifetimeLSP
LSDBPSNPLSPLSPLSP
LSPChecksumLSPRemaining Lifetime
LSPPSNP

LSPLSPRemaining LifetimeChecksum

 RB1-RB6RB
RBLSDBLSDBSPT
nickname
 RB1

RB1RB2RB3RB4

TRILLEgressNicknamenickname
ECMP
 Root priorityNicknameroot priority
root priorityNicknameN

root priorityNicknameRBnickname
root priorityNNickname

RPFIngress RBRPF

Ingress RBVLANTRILL

root priority

 TRILLRB1TRILLROOT RB2TRILL
TRILLRB32STPRB11RB4
3TRILLRPFRPF

 RPF

IngressRB61RB2L1
RPF

TRILLIngress RBRBRB
NicknameIngress RBNicknameRPF
RPFTRILL

L1
L1

RB
RBPIM
JoinPrune
 RB2RB4RB9VLAN1RB4RB10LAN2

RBIngress RB
TRILLRBTRILL

CERB1RB7VLAN1
VLAN2
VLAN1VLAN2RB
VLAN1VLAN2

RBVLAN1VLAN2

TRILLNickname+VLANkey
VLAN

RPFNickname+Ingress RBNickname

 Ingress RBVLAN
Root1VLANRoot2
VLAN
 2000VLANIngress RBVLAN

Ingress RBVLANVLAN 1351999Root1

L1VLAN 2462000Root2

RBIngress RBVLAN

 ARP RequestTRILL

ARP ReplyTRILL

 Ingress RBmacVLAN
ARP Request

RBRB

Egress RB
 Ingress RBmacRBARP

RB

Egress RB
 1AC

Ingress RBRB1AMAC
L2Egress NicknameEgress Nickname
RBL5RB5TRILL

Transit RBTRILLTRILLEgress Nickname

RBRB6L6RB6

Egress RBTRILLTRILLEgress Nickname

TRILLMAC

 Ingress RBRB1AMAC
MACVLANTRILLTRILL
M1Root RBNicknameTRILL

Transit RB4TRILLTRILLM=1
Egress Nickname

Root RBTRILL

Egress RBTRILL



DCMSTPTRILL
S9300

DCTRILLCE12800
MSTPMSTP
TRILL VM

TRILLMSTPMSTPMSTP
TCNMACRB
MAC


DC
VLAN3001TRILL
MSTPVLAN 1-3000

TRILL

C-VLANVLAN 3001
TRILLVLAN 1-3000TRILL
 DCRBTRILLTRILL Site

DCVPLS

RBMACMAC
 DC SiteTRILLDCRBTRILLTransit
TRILLMAC

DC SiteRBDC
Site
 TRILLMSTP

L2L3


SiteNative ETHSiteTrillSite

L2L3


RB

RBVSVS
VSVSRB

TRILL
VLANTRILL TRILLCarrier
VLANRB edgeCE VLAN

RB spineVSTRILL VSTRILL
VSVLANVLAN
VSTRILL VS

VSVRRP

TRILL

TOREORTRILL
DC

 FWLB

FW

TRILL

PODPOD
TRILL

TRILL
TRILL

TRILL

TRILL
TRILL

+VS
VS+VRRP+VSVRRP

 xSTPTRILL

TRILLAB
TRILLTRILLMSTP
/TRILLMSTP

2TRILLxSTP

TRILLxSTPC
TRILL1

TRILLD
2

/TRILLMSTP

3AF

TRILLGHVLAN
HG3

HIH
 TRILLRBnicknamenickname2NicknameIP
RBnickname
nicknameNickname nickname
priorityroot prioritynickname

1Nickname
nickname22
nicknamenickname

2Nickname
nicknameRBnicknameTRILL
nicknameRB
LSDBNickname

TRILLNickname,
XXNickName11,21XXXNickName
111,221
XXXX1101,2201

11,121111121101,1102

 TRILL

VS

CSS+VS

TRILL
 VS

VSTRILL
TRILL

1TRILLVS
VS1VS2VS2TRILLVS1
CE12800VS1

2VS1VRRPVRRP
TRILL

3VS1VS2VLAN

4VLAN
VRRP

VRRP



1TRILLCSS
VSVS1VS2
VS2TRILLVS1
CE12800

2VS1VS2VLAN
VLAN

3
VRRPCSS/
CSS


1TRILLVLAN

CE

2TRILLVLan100TRILL
VLan101

3Vlan101Vlan100TRILL

4VRRPTRILL
VLAN

5VRRP

VS
VLAN
 TRILL
TRILLTRILLTRILL
TRILL
RBRBVLAN
TRILLRBMACIDMAC
RB
NicknameRB
RBNickname
RBRB
RB
TRILLURPF
IngressEgressVLANTransmit
VLANMAC

system-view
trillTRILLTRILL
carrier-vlan carrier-vlanidTRILLCarrier VLAN Carrier
VLANVLAN
 network-entity net

NETNET

nickname nicknamevalue [ priority priorityvalue ] [ root-priority

rootpriorityvalue ]TRILLNickname

NicknameNickname
TRILL Nickname
RBNickname

NicknameSuppressed

port-mode { access | hybrid | p2p | trunk }

p2p TRILL
VLANaccess

TRILLTRILLtrunk

P2PRBp2p
 VLANTRILLhybrid

RBTRILLTRILL
CE VLAN
quitTRILL
vlan vlan-idVLANVLAN
quitVLAN
trillTRILL
ce-vlan { vlan-id1 [ to vlan-id2 ] } &<1-10>TRILLCE VLAN
CE VLANvlanVLANCE VLANCarrier VLAN

CE VLANVPLS
512TRILL

trill-name symbolic-nameTRILL

symbolic-nameLSP
TRILL
IDsymbolic-name
TRILLRBadmin
VLAN
quitTRILL
vlan vlan-idVLANVLAN
quitVLAN
trillTRILL
admin-vlan vlan-idTRILLVLAN
admin VLANvlanVLANadmin VLAN
Carrier VLAN
quitTRILL
interface vlanif vlan-idVLANIF
ip address ip-address { mask | mask-length } [ sub ]IP
VLANIFIPIP
Nickname
commit
 TRILL
TRILLRBTRILL
TRILL
trunkhybridTRILLaccess
TRILL
TRILLp2p


DRBDRB
DRBDRB

8
TRILLMPLS
dot1q tunnelTRILL

system-view
interface interface-type interface-number
port link-type { hybrid | trunk }HybridTrunk
 trill enable [ port-mode { access | hybrid | p2p | trunk } ]TRILL

DownTRILLundo
shutdownUp

p2p

TRILLVLANaccess

TRILLTRILLtrunk

P2PRBp2p

VLANTRILL
hybrid

trill drb-priority priorityDRB

DRB64RBDRB
priority

commit
 display trill interface [ verbose ]TRILL

display trill peer [ verbose ]TRILL

 display trill lsdb [ verbose ]TRILL

display trill name-tableTRILL

 display trill route [ nickname ]TRILL

display trill mroute [ nickname ]TRILL

nickname 2222cost20000OutInterface
2222OutVlan100Carrier-Vlan
TRILLVLAN

reset trill allTRILL

 VXLAN

VXLANUDPIP/MAC

MAC

VXLANVLAN IDVXLANVNIVXLAN
Network ID2416M(2^24-1)/1024^2VXLAN


VXLANIPMAC


NVo3
VXLAN
24VNI16MVXLAN

VXLANMAC
MAC
 MAC in UDP
IP

 VXLANVirtual eXtensible Local Area NetworkVLANMAC in
UDPUser Datagram ProtocolNVo3Network Virtualization over Layer 3

IT

 NVENetwork Virtualization Edge

NVE

VAPVirtual Access Point

VAP

VTEPVXLAN Tunnel Endpoints

VTEPVXLANNVEVXLAN

VTEPIP

VXLANIPVTEPVXLANIP
VTEPVTEPVXLAN

VNIVXLAN Network Identifier

VXLANVNIVLAN IDVXLANVXLAN

VNIVNI
VNI2416M(2^24-1)/1024^2
 VXLAN

Flags800001000

VNIVXLAN24VXLAN

Reserved2480

UDP

UDP4789

IP

IPVTEPIPIP
VTEPIP

Ethernet

SAVTEPMAC

DAVTEPMAC

VLAN TypeVLAN Tag0x8100

Ethernet TypeIP0x0800
 NETCONF
NVEVTEPIPMACARP
MACARP

OpenFlow
MACARP
OpenFlowMACARP

OpenFlowMACARP

MAC
ARPMAC
ARP

Agile ControllerSNC
 VXLAN
BDBridge-Domain
BDBD

VXLANVNIVNI1:1BD
BD

VXLAN

VXLANMAC

MACBUMBroadcast&Unknown-unicast&MulticastBUM

MAC

VXLANVXLAN
 Device1AVLAN
MACBUM MAC

Device1VTEPVNI
VXLANVXLAN
VXLANIP

Device2VTEPVXLANUDP/IPVNI
VXLANVNIVXLAN
MACBUM MAC

VXLAN

MAC

CPU

Device2/Device3VLAN Tag
B/C
 Device1AVLAN
MACMAC

MAC

BUM

Device1VTEPVXLAN

Device2VTEPVXLANUDP/IPVNI
VXLANVNIVXLAN
MACMAC

MAC

BUM

Device2VLAN TagB

 BDIFVLANIF

Device3VXLANDMAC
MAC

VXLANDevice3IPIP
ARPDMACVXLANVNI

VXLANVNI

VXLANVNI3

Device3VXLANSMACMAC
 VM1VM3VM1VM3
ARPARPVM3ARP
ARP

ARPARP
VM1ARPVM3MAC

VM1ARPSMAC:MAC1SIP:IP1DMAC:FF-FF-FFDIPIP3

Switch_1ARPOpenflow

IP3VM3MACMAC3

ARPOpenflowSwitch_1

Switch_1ARPARP
VM1
 VXLAN QoSQoS

Switch_1VLAN
DiffServ802.1pPHB

Switch_1VXLANUDP
IP802.1pDSCP
DiffServ

802.1pDSCP
DSCPDiffServ

VLANDiffServ
802.1p
 VXLAN

SNCAC

SNCSNCVXLANOpenFlow
VXLAN
OpenFlow
VXLAN

ACACAgile Controller-Enterprise
VXLANSNCACNETCONFVXLAN
OpenFlow
 SNCNetMatrixNeutron

ACNeutron


 AC

CLIZTPNETCONFVXLAN
NVEVTEPIPAC
NETCONF

AC
OpenFlow

AC

ACARPARPAC
OpenFlowARP

ACOpenFlowARPAC
OpenFlowARPAC
OpenFlowAC

 SNC

NMSCLINMSNETCONF
NMSNVEVTEPIP
MACARPMAC
ARP

OpenFlow
MACARP
OpenFlowMACARP

SNCOpenFlowMAC
ARP

SNCOpenFlowSNC
MACARPSNC
MACARP

SNCOpenFlow
OpenFlowSNC

 ARPARPARP
display arp forwarding-statusARP

VXLANIP


Internet

NVo3
VXLAN

VXLANVXLAN
VXLAN

OpenFlowOpenFlow

NETCONFVXLAN
OpenFlowVXLAN

VXLANVXLAN

VXLANMAC(VM)

Internet


NVo3
VXLAN

Switch_3VXLANVXLAN
VXLANVXLAN

OpenFlowOpenFlow
NETCONFVXLAN
OpenFlowVXLAN
Switch_1Switch_2VXLANSwitchVXLAN
Switch_3VXLAN
VXLANBDIFIPARP

VXLANARPARP
VM


IT

IPMAC
Cluster
VLAN

Cluster2VXLANVXLANMAC in UDP
IPIP

OpenFlowOpenFlow

NETCONFVXLAN
OpenFlowVXLAN

VXLANVXLAN

VXLANVXLAN
 SDNVMARP Cache

ingress NVEARPSDN Controller

SDN ControllerARPARP Cache

ARPARP

ingress NVE
 ARP

ARP

ARP

ARP



2
MAC

ARPARP
ARP.
 VXLAN

VRRPVRRP

VXLANVXLAN
Spine-LeafSpineVTEPSpine
VXLANSpine
Spine
Spine
SpineVXLAN

VXLANSpine
SpineVM

 SNMP

ControllerSNMPv3SNMPv3
Controller

CE12800
V100R006C00SNMPv3

SNMPv3dc-admin
adminSHAAES128

[*HUAWEI] snmp-agent usm-user v3 admin group dc-admin

[*HUAWEI] snmp-agent usm-user v3 admin authentication-mode sha

Please configure the authentication password (8-255)

Enter Password: Huawei@123

Confirm Password: Huawei@123

[*HUAWEI] snmp-agent usm-user v3 admin privacy-mode aes128

Please configure the privacy password (8-255)

Enter Password: Priva@1234

Confirm Password: Priva@1234

 NETCONF

VTYSSH

[~HUAWEI] user-interface vty 0 4

[~HUAWEI-ui-vty0-4] authentication-mode aaa

[~HUAWEI-ui-vty0-4] protocol inbound ssh

SSH

SSH

# Client001SSHHuawei@123

[~HUAWEI] aaa

[~HUAWEI-aaa] local-user client001 password irreversible-

cipher Huawei@123

[~HUAWEI-aaa] local-user client001 service-type ssh

[~HUAWEI-aaa] local-user client001 level 3

RSA

[~HUAWEI] rsa local-key-pair create

The key name will be: netconf-agent_Host The range of

public key size is (512 ~ 2048). NOTE: If the key modulus
is greater than 512, It will take a few minutes. Input the
bits in the modulus [default = 512] :

[~HUAWEI] commit

display rsa local-key-pair public

SSH

[~HUAWEI] ssh user client001 authentication-type password

[~HUAWEI] commit

SSH

[~HUAWEI] ssh user client001 service-type snetconf

[~netconf-agent] commit

NETCONF

[~NETCONF-agent] snetconf server enable

[~netconf-agent] commit

Spine
Leaf


Spine1/Spine2Spine1/Spine2
Spine1/Spine2
monitor-linkSpine1/Spine2Spine1/Spine2
DOWNDOWN
Spine1/Spine2

IP

OSPFOpen Shortest Path First

VMVLAN IDVLAN10VLAN20VLAN30

BD IDBD10BD20BD30

VXLANVNI IDVNI5000VNI5001VNI5002
 NVO3ACL

 VXLANVNIBDVNIdisplay
vxlan vniVXLAN

display vxlan vniVNI

VXLANdisplay vxlan tunnel

 Spine1Spine2NVEIP
BDIFIPMAC
 IP



PortalDC

OpenStack

SDN

VXLAN overlay

VXLAN GW

vSwitch NVEOVSEVSNVE

VASFWLB

VLAN
 Optus

OptusVLAN tag

ASWVLAN
VLAN TAG

VNI

VNIVLANVNIAWS
VLAN TAG
62



 SLBServer Load Balance

VIPVirtual IP






lb

 Round Robin mode

Ratio mode/Weight Round Robin mode

 Least connections mode



Fastest mode
TCP


Observed mode



Predictive mode






 GSLBGlobal Server Load Balance

CDN

+
 GSLBDNSHTTPIP
DNS
GSLB

GSLB
GSLB
VIP
DNS


RTT
RTT
LocalDNS
GSLBGSLBLDNS

(Topology)
LocalDNSGSLBLDNS
LocalDNSGSLB
GSLBLocalDNSLocalDNS

(Global Availability Mode)

IP


RTTGSLB
LocalDNS
RTT
LocalDNS

LocalDNSRTT

 VIP
GSLBVIPLLB/SLB
VIPGSLB

GSLBLLB/SLB



GSLB

VIP

GSLB



GSLB



OutboundNAT

InboundDNS

 Inbound

Inbound

InboundDNSDNS
DNS
DNSDNS
IP
IP

MAC
MAC

ISP
ISPIP

ISP1ISP1
ISP1
 Outbound

NATACL
ISPTCL
VIP

VIP
ISPIP


GSLBLLB
SLBGSLBLLBSLB
GSLBLLBSLB

GSLBLLBSLB
LLBSLBVIP
GSLB

GSLBLLB/SLB


PC
/41ms
250ms

QoS

WOC


WAN


TCP
/

5MBWord700550
150WAN250ms
175
 49

RiverbedRiOS
 VDC

 ManageOne

Service Center

Operation Center
//
(OC)(eSight)OC
OC
UI
 VDC

VDCVDCDomainVDC

VDCVDC

VDCVDC

VDCIPVPN..VDCVDC
VDCVDC

VDCVDC

 VDC

VDC

VDCSLA

VDC

VDC

VDC

VDC

VDC



VM

X86

EBS

IP

SNAT/DNAT

ACL

VPN
 VPCVirtual Private Cloud

VPCIPVLBVLANIPSec
VPNNAT

 VMwareAPIvSphere

VDC

VNC



 ACLVDC

IPMySQL
MySQL

IP
IPIPIP
IPIP

PHP
HTTPMySQL

VPCIP

VDC

VDCVDC:(VRF/vFW
, Vxlan/vlan)

VDCVPN,

VDC: , vfwVM
EIP/SNAT/DNAT

VPC

VPCVPC
 Subnet

SubnetVxlan

1VPCSubnet

SubnetNetAcl

: ( EIP/SNAT/DNAT)
VM

VPN : IPSec VPN,

VM

FwAcl,

vfwdeny
 VDC

VDC

VDCVDC
 DomainDC

DC
Available ZoneAZ

AZAvailable ZoneAZ
AZ

Host AggregateSLA
Cluster

VPCVirtual Private Cloud

IP

 VDC

VDCVDCVDC

VDCVDCVDCVDC

VDCVDC
VDCVDC

VDCVDCVDCVDC
VDCVDCVDC
 VDCVDC

 VDC


VDCIP

VDC

VDCVDC

 VDC
VDCVDCVDC





IP







VDCVDC
VDCVDC
 VDCVDC

 VDCCPUVPCIP

VDC

VDCExcel

VDC VDC


CPU///OS

VM

I/O

VDCVDC
VDC

PXEVLAN

RH2288RH2285RH5885

SUSE11SP3 SUSE11SP2

/BMC
 VDCSLA

VPC:Virtual Private Cloud

VPC

:GB

:



 SLA:SLA
SLARAIDSLA

/
/

VDC


VDC

VDC


 VDC





vLB

 IP

IP

VPCVPC

IPIPVPC

IPIP

IP
 IP

IP

IPIP

IPIP

IPIP

IP

IP

IP

IP

 //



/
/
/
/
/
/
/
VDC/







IP
ID

Excel

SMTP

SGIP1.2


ITIL

IDITIL

ITIL

 TopN

15


eSightFusionSphere





()


 TASK

STPC-C
TPCC

TPC-C
1~30

CCPUCPU
75%C=50%CPU1-0.5=0.5

Fn30%
31+0.33=2.197

2M3M
500MB256MB70%
SGA50G2000

=(512M/0.7+256M/0.7+2000*3M)/1024+50G=59.45G

64G
 VCPUCPUCPU(VCPU)

 VCPU
VCPU

 VCPU

 CINTCFPSpecCPU2006
http://www.spec.org/cpu2006/results

CPU CINTSpecCINT_rate2006

CPU CFPSpecCFP_rate2006

CPU

15%~20%VCPU
10%
 CINTCFPSpecCPU2006
http://www.spec.org/cpu2006/results

CPU CINTSpecCINT_rate2006

CPU CFPSpecCFP_rate2006

CPU CINT
CPUSpecCINT_rate2006

CPU CFT
CPUSpecCFP_rate2006

2CPU
CPU42*4*2=16

CPU

15%~20%13VCPU
10%
 vCPUvCPU

16G32G

107

vCPU321

856 GB

HA
CPU20%

 HML

 WebAppDB
WebAppDB
I/ODBI/ODB
HADB

IBMHPDELLx86
GalaX8800
 OpenStackactive-activeactive-standby




 agent
AV Server
WindowslinuxUNIX

Windows

100%

 vLAN taggingvLAN

BridgevLAN tagging
vLAN taggingvLAN



IP
TCPICMP

 CPU///
2.4GHz CPU1.2GHz/0.8GHz/0.4GHz 3vCPUCPU
3vCPU
3

FusionManager
IT

FusionCompute x86IT

FusionManagerFusionCompute

FusionCompute
FusionManager

FusionStorage3
FusionCompute

FusionComputeSANFusionStorage

FusionStoragex86
SAN
 UltraVR LUN

Hyper-DP ,eBackup

FusionCube

FusionAccess


67011:1
706
 HA High Availability
HA

FT Fault Tolerance

 VRM Virtual Resource Management

VNA Virtual Node Agent

CNA Compute Node Agent

Presentation Service WebUI

Business Process BusinessService

RESTAPI WebUI

Business Service

Data Service

Connectivity Service CNA

Database
/
 VRM (Virtual Resource Management) FC

CNA (Computing Node Agent)

128

3,000

VRM

16VRM4,09680,000

VRM
VRM4,09680,000

VRMVRMVRM
Web ClientVRMVRMVRM
ClientVRMVRM


DRSDPM

IPMAC

FusionComputexen

XenPV

x862VMWareFull virtualizationXen
Para virtualization
VMM (Virtual Machine Monitor)
ParaVMM
PVVMM
, Back-EndGuest OS (Front-End, FE)
Guest OSGuest OS
VM
PV

14
 QoS Quality of Service

CPUWindows
2008 ServerSUSE LinuxCPU
FusionComputeCPU

/
vDisk

Scale-Up QoS

Scale-Out
QoS


VMOS

Hypervisor

Balloon DriverGrant Table

 CPUCPUCPUE5 2620E5
2680CPU

FusionCompute
1
 3.1VRMHAVRM
VRMHA5.0
HAVRMHA
MasterMasterSlaveMaster
HA(
)MasterHAHA

1HA
VIMS

2HA32

HAVRMMaster



 FTHA

FT

HA

FTHA

19
 &

DRS Dynamic Resource Scheduler ,

128VMware32

DRS

 &

DRS Dynamic Resource Scheduler

DPM Dynamic Power Management

DRSDPMDRSDPM
DPMDRS

DPM5

:
;

:
;

 QoS Quality of Service

CPU QoSCPUCPU QoS

CPUVMCPU
VMCPUCPU QOS
CPU

QOS

22


VMNUMAGuest OSNode

Guest NUMAVMNUMAHypervisor

Host NUMAHypervisorVMNUMANode
Node

NodeNodeHost NUMAvCPU
Node

Oracle SQL Server

NUMA

23
 NUMA non-uniform memory access architecture

NUMA
node

RAM Random Access Memory

GuestNUMA

CPUNUMACPU
NodeCPUNodeOS
NUMAGuest NUMANUMANUMA
,Guest OSNUMA

Host NUMA

CPUCPUVM
VMHost NUMACPU
nodeVMVMCPUnode
VMCPUnodenodeCPU
nodeCPUnodeCPU
Host NUMACPUnodeVMVMCPU
CPUnodenodeCPU

24


GPUGPUvGPUvGPU
GPU3D
GPUDMAvGPU Driver3D
vGPUvGPU
GPU
GPU

25

 VIMS Virtual Image Management System

OCFS2

jbd2

SAN ()

()

Thin Provisioning
=

OS

 Storage Live Migration

2mirrorIO

4IO

 >

30%100GB130GB

IOPSIO

IOPS

cache
1/360%.

12
 RDM Raw Device Mapping

SCSI Small Computer System Interface

25m

LUN Logical Unit NumberSAN

 CNA

VSPVirtual Switch PortVSP

(VLANDHCP)Port Group
VSP

VM

VMvNICvNICVSP
 VXLANUDP

UDP

VXLAN+
12bit409624bit16M

VTEPVXLAN Tunnel End PointVXLAN

IP

VXLANVXLAN



hypervisordom0VM
I/OCPU

VMDq

Virtual Machine Device QueuesiNIC (intelligent

network interface card)

VMDqLayer 2/MAC
VLAN
Dom0CPU

SR-IOV

SR-IOVPhysical FunctionPhysical Function

Virtual Function

Virtual FunctionVirtual Function

CPU

PFVF

 20153FusionCompute5.0

37
38
 FusionCompute

FusionSphere

FusionComputexen
8GB48GB16GB



1U1U=4.45cm2U4U
19

HAHDHigh Availability High Density

 1

CPU

ECC

50

Internet

CPU

ECCSM

IntelCPUWindowsNetWareUnix

100

4CPU
PCI

RAMPCICPU

CPUUnix


 PC


PC

 ISP/ICP
WebFTP
 CPUPCIe

RHE6000X6000
E9000RH2288

 IPMI
(BMCBaseboard Management Controller)BMC
,
BMC
(Sensor Data RecordsSDR)
IPMI

 KVMKeyboard, Video, Mouse

KVM
PC


16
17
 5

82.5SAS/SATA/SSD

103.5SATA

123.5SAS/SATA

242.5SAS/SATA/SSD

243.5SAS/SATA

242.5SAS/SATA

242.5SAS/SATA/SSD

243.5SAS/SATA

252.5SAS/SATA/SSD

22.5SAS/SATA/SSD

FlashSATA DOMSD
 X68004U1U=4.445cm19
8
4U84U4



 X6800IO4U4

27
28

Kunlun 90164Kunlun
90328





46
 E90006N+NN+1
E9000
3000W AC
2000W AC2500W DC

E900014
N+1



 44814Gbps3232serdes

5.76T163632+4

50
 44814Gbps3232serdes

5.76T163632+4

51
52
 -OSCA-IT11MGEA-MZ110-4*GE, PCIE2.0 X4-2*2

-OSCA-IT11MXEC-MZ510-2*10GCNA, PCIe2.0 X8-2*2

-OSCA-IT11MXEA-MZ910-2*10GE,2*8G FC,PCIe3.0 X8-2*2

-OSCA-IT11MXEB-MZ316-2*10GE,PCIe2.0 X8-2*2
 tpmC

TT=60

S:tpmC
1tpmC
2030IO30IO
IO80100IO
IO50

F:
10%~30%
20%5F=1+20%) 3 =2.49
 OLTPOLAP
OLTPOLAP9OLTPOLAP91
oracleoracle8KB
OLAP64K

B:IPSANFCSANIPSANFCSAN
IPSAN1000MFCSAN4000M

UIPSANFCSAN100%
FCSAN80%IPSAN60%

L
FCSAN1IPSAN20%

Sbitbyte1Byte=8Bit8
 OLTPOLAP
OLTPOLAP9OLTPOLAP91
X90Y10oracleoracle
8KBOLAP64K


RAID35%

20%
31+20%3=1.728
 IOD
(1)D2P3P4D

IO2IO2IO3IOIO
IO

IOIOx%IOPS
1/(1+3x%)100/(100+3x)
 RAID2.0+

16896

96SAS
5

SAS192SAS2
9610 6
 Eg48600G SAS4RAID58D+1PRAID

600G600G0.931=558.6G
512558G520558G98.4%=549G

51248558G=26.156T520
48549G=25.734T83.42%
 XMLHTML/
NAS
 HML

IOPS



SAN/IP-SAN

VIS6000
 FusionStorage,.


FusionStorageHash

SCSI

cache

FusionStorage

FusionStorage
OMPortal
 FusionStorage



FusionStorage


3

URP8100PSTNPLMN
E1/STM-1
No.7MTP
URP8100SoftSwitchMSC ServerIP
FE

URP8100IP
GE
STM-1
BITSE1

URP8100PSTNPLMN
E1/STM-1
No.7MTP
URP8100SoftSwitchMSC ServerIP
FE

URP8100IP
GE
STM-1
BITSE1
12
13


416Gb/8Gb FC10Gb FCoE(10Gb ),

TargetScale-out

FCFCoE(ISM/CLI)(4
)
()FCFCoE

Smart IO16G/8G/10G

5500 V3


24*8Gb FC88Gb FC(

)target

24*10G QSFP+

1514

5300 V3/5500 V3(

)


10Gb ETH410Gb/sRJ45
Target

10Gb ETHiSCSITOENASFCoE

10Gb ETH10Gb/s1Gb/s

CAT6A310

V3IP

10Gb ETH2


2IB
4 lane*14Gb/s4*10Gb/s

40Gb IB

V3


gzip
CPU

16Gb/s8Gb/s16Gb/s

CPUIO

V32ACC

ACC

URP8100PSTNPLMN
E1/STM-1
No.7MTP
URP8100SoftSwitchMSC ServerIP
FE

URP8100IP
GE
STM-1
BITSE1
 RAIDchunk
RAIDCKG RAIDchunk

RAID

CKGextentextent
LUNextent

 SmartTier

SmartTierSSD
NL SAS

SmartTierLUNSmartTier

SmartTier

SmartTierSmartTierSmartTier

 SmartQoSLUN

SmartQoS

SmartQoS

SmartQoSIOIOIOIO

 SmartThin

SmartThin

SmartThinLUN

SmartTierSmartThinSmartQoS
 HDS

IO

N
N
3

SmartPartition

SmartPartitionOceanStorQoS
SmartQoS

SmartPartitionLUN
OceanStorIO

28
30
 vStorevStore
vStore


LUNLUNLUNLUN
LUN

LUN
LUNLUN

LUNLUN
LUNLUN
LUNMirrorCopy
LUN
Raid


36
 SMBServer Message BlockIBMBarry Feigenbaum
DOS13
SMB
 NFS

NFS (Network File System)SUN microsystem

linux/ unix

NFSv2NFSv3NFSv4 (V3R2NFSv3NFSv4)

UNIX/LINUX/AIX/SOLARISUNIX

 (NDMP)
(NAS)NDMP
NAS NDMP NAS
NAS

V3SpaceROW LUNFSSpace
Pool





 FS
 640GB/s

14ABPCIE 3.0*16CDPCIE 3.0*16AC

ADBCBDPCIE 3.0*8

1GB/s*(16*2+8*4)*2 = 128GB/s

2) 162PCIE 2.0*4

0.5GB/s*4*16*2*2 = 128GB/s

3) 16128GB/s*5 = 640GB/s

16TB

1TB1616TB

27PB

46086T27.6PB

3
 SmartHyperSAN/NASSAN
NAS

URP8100PSTNPLMN
E1/STM-1
No.7MTP
URP8100SoftSwitchMSC ServerIP
FE

URP8100IP
GE
STM-1
BITSE1

URP8100PSTNPLMN
E1/STM-1
No.7MTP
URP8100SoftSwitchMSC ServerIP
FE

URP8100IP
GE
STM-1
BITSE1
11


1ABCD

2SMM 0BDSMM 1AC

12
14
 B110V
 ENG :Engine

DSW :Data Switch

SVP :Service Processor

DAE :Disk Array Enclosure

KVM: Keyboard Video Display Mouse

 SVPSMM16

PCIEPCIE


416Gb/8Gb FC10Gb iSCSI10Gb FCoE(10Gb

),TargetScaleOut(
)

FCFCoE(DeviceManager/CLI)
(4)
()FC
FCoE

Smart IO16G/8G/10G

(5300/5500 V3 IOM1
5600/5800/6800/69003)ScaleOut4
10Gbit/siWarp RDMAV3
ScaleOut2~8

ScaleOutDeviceManager/CLI
(FCFCoEScaleOut)ScaleOut

V3(V2)


416Gb/8Gb FC10Gb FCoE(10Gb ),

TargetScale-out

FCFCoE(DeviceManager/CLI)
(4)
()FCFCoE

Smart IO16G/8G/10G

5500 V3


10Gb ETH410Gb/sRJ45
Target

10Gb ETHiSCSITOENASFCoE

10Gb ETH10Gb/s1Gb/s

CAT6A310

V3IP

10Gb ETH2


2IB
4 lane*14Gb/s4*10Gb/s

40Gb IB

V3


gzip
CPU

16Gb/s8Gb/s16Gb/s

CPUIO

V32ACC

ACC
 Scale-Out

URP8100PSTNPLMN
E1/STM-1
No.7MTP

URP8100SoftSwitchMSC ServerIP
FE

GE
URP8100IP
STM-1

BITSE1
CHUNK

IO enhancement

IO
tie storage

IO

CSchedIO

CSched

IO


 43

BIMBackend Interconnect Module

SmartMatrix 2.0V3

31
 SWPCIE

SASSAS

EXPSAS EXPANDER

4SASI/O

 4

1F

2ABCDE

3ABC

4AD

5B
 2011ZB Gatener2020
40ZB 200944, 2015
3.19ZB

1080%

IDCCAGR
31.7%2016238ICT

IDC2012-
2016

3
 Facebook2.52

3D1PB200PB

2011ZBGatener2020
40ZB

EMCIBM

4


4
5
6
OPS
145

1345232

1750

5
8
9
10
11
12


OPS

145

1345232

1750

14
 HDFS PluginFusionInsight HadoopCloudera HadoopCloudera
Hadoop

InfoTier

InfoEqualizerOceanStor 9000

InfoStamperInfoStamperOceanStor 9000

InfoLockerInfoLockerWORMWORM9000

InfoReplicator

NDMPNDMP

InfoTurboSMB3 MultichannelNFS

InfoAllocator
 InfoProtectorOceanStor 9000ODCOriginal Data Count+RDC
Redundant Data CountN+MODCN
RDCMODC+RDCOceanStor 9000M
M

InfoReviveInfoRevive/

InfoScanner

InfoContainerInfoContainerOceanStor 9000



 NFS/CIFS/FTP/NDMPNAS

CAClient Agent

MDSMetaData Service

Monitor

CMSCluster Management Service

DeviceManager ISM
OceanStor 9000UI

OBS-C:OBSOBS-COBS-S
OBSNOFSNot Only File System
OceanStor 9000NOFSLinux
OS

17
 Monitor

CMSCluster Management Service

DeviceManagerISMOceanStor 9000UI

NOFSNot Only File System OceanStor 9000NOFS

Linux
OS

OBS-C:OBSOBS-COBS-S
OBS

OSC:

OMD:

18
 NFS/CIFS/FTP/NDMPNAS

CA

56

19


20
 S3/Swift

OBS

OBS

21


OBS

22
 ext3

60PB

OceanStor 900033

24


OceanStor 9000M

RAID

Stripn-1Strip0m
Strip

25
 Strip512KB256KB128KB32KB16KB
Chunk Strip
4KB/8KB/16KB/32KB/64KB/128KB/256KB/512KBStripeStrip
XX<NStripeX+MStripa

26
27
 N+M:BMB

/ +M +M:B
OceanStor 9000NN
2-16M1-4

28


MDSMDS

CAMDSMDS
MDS
MDSMDS

MDSMDSMDS

MDSMDS/

M+2

29
 NFSNFSv3NFSv4240TB100

CIFSSMB 1.0SMB 2.0SMB 2.1SMB 3.0SMB3 Multichannel

CopyChunk
240TB100

FTP240TB100

30
 Global Cache

31
 DLM

32
 CA

33
34
 OceanStor 9000

:OceanStor 9000
OceanStor 9000

:OceanStor 9000

:OceanStor 9000
OceanStor 9000

36
37
38
39
40
41
42
43
44
45
46
47
48

=**C36364TB
SATA36*4TB=144TB

NM

50
 ---0.905

0.9

51
52
53
 OceanStor 9000

54
 OceanStor 9000

55
 Server SANc

Server SANX86
 (SQLOracle RACWeb
)

FusionSphereVMware
Openstack

PBServer SAN


LUN
LUN1+LBA14KB32
LBA2IO




VBSOSD

FusionStorageDHT

FusionStorageSATA/SASSAN
SANIO1-3

FusionStorage
CPUIOPS

20FusionStorage
2*10Gb1VBS
12020
20*2*10Gb=400Gb



FusionStorage

FusionStorageSSDHDDInfiniband
GE/10GE
IOPS

http://support.huawei.com/onlinetool/datums/fusioncloud/comptool/index.jsp

http://support-open.huawei.com/ready/
 FusionStorage
 DHTIO

 Server SANc

Server SANX86
 : SANRAIDRAID

962IO

VolumeLUN
Volume

 FusionStorage11MBDHT

Server1 Disk1P1Server2
Disk2P1P1P1P1
P1

 FusionStorage0~2^32N11
PartitionNN
360036100-

FusionStorage

FusionStorageLUN1MB1GBLUN
1024*1MBFusionStorageSCSILUN IDLBA
IDOSVBSVBSLUN IDLBA ID
keykeyLBA ID1MBDHT Hash
(0~2^32)Partition-
VBSIOOSD

OSDOSD1MB
1MBOSDVBSIO
keyVBS

LUN1+LBA14KB
key=LUN1+LBA1/1MkeyHASHNpartition
-
 IOVBSSCSIVBPCLIENT
SCSIVSC.KOIOVBSSCSIIO
SCSIIOSCSI
host_id/channel_id/target_id/lun_idIOoffset
lenIOSCSIIOVBP(Virtual Block
Process)
VBPIOFusionStorageKey-ValueIO
clientKEYtree_id4Byte+block_no4Byte+
branch_id2Byte+snap_id2Bytetree_id/branch_id/snap_id
FusionStorageblock_no1M
IO1M
IOclientclientKEYtree_id/branch_idhash
IOOSDIOOSD
OSDIO
DSware
tree_id/branch_id/snap_id
DSware
 OSDMDCOSDPartitionOSD
OSD

RSM:

SNAP:IO

CACHE:cache

AIO:IOSMIOSMIO

SMIO:IO

OSDOSD1MB
1MBOSD
VBSIOkey
VBSOSD-
-1-2OSDOSD
VBS
 VDB


 FusionStorageZK
ZKZKZK

MDCZKC/STCPMDCZK
TCPTCPMDCZK
 FusionStorageZK
ZKZKZK

MDCZKC/STCPMDCZK
TCPTCPMDCZK
 MDCOSDOSDMDCOSD
MDC5sOSD
MDCOSDOSDOSDMDC
MDCOSDMDCOSDOSD
OSD

MDCclientOSD
OSDPartitionOSD
OSD
 MDCZKMDCMDCMDCMDC
MDCMDCMDCZKMDC

OSDMDCMDC,MDCMDC
VBSMDCMDCMDCMDC

VBSMDCMDCMDCVBSMDC
VBSMDCMDCOSDVBSMDC
leaderVBSMDCIO ViewVBSOSDVBS
VBS

FusionStorageVBSVBS
FusionStorageVBS
VBSVBSFusionStorage
VBSVBSMDCVBSMDC

VBSVBSVBS
VBSVBS

 FusionStorage

CacheIOPSCache

 1TB30

FusionStorageDHTPartition
FusionStorage

 FusionStorageNVDIMMSSD
 FusionStoragecachecacheLRU

SSD cacheSSD cache

SSD
SSD

FusionStorage
SSD

OSDVBSIO

Step 1cacheIO
IOcacheLRUStep 2

Step 2SSDcacheIO
IOStep 3

Step 3SSDcacheIO
IO
SSDcacheStep 4

Step 4IOIO
SSDcache

 FusionStorage

FusionStorageNVDIMMSSD

SATAFusionStorageIO
1~3

FusionStorageSSD

FusionStoragecacheNVDIMMSSDSSDcache
cache 5
 APPIOOSOSIOVBSVBSIO
LUNLBAPrimary OSD

Primary OSDIOSSD cache

secondary OSDsecondary OSDSSD
cachePrimary OSDIOVBSSSD cache

VBSIO3primary OSDIOsecondary
OSDthird OSD
 SCSIiSCSI

iSCSIVBSiSCSI TargetInitiator
iSCSI Target

FusionStorage

CHAP

LUN MASKINGHostLun

 1

2
 HUAWEI ManageOne

TCO

 HUAWEI ServiceCenter

CA SDM

ITIL V3
CMDB

HUAWEI OperationCenter

 HUAWEI FusionManager

Portal

ITOM CA SAHUAWEI eSight

J2EEB/S

SSOCAS/SAML SSO

LDAP

API
SOAP/Restful

/

CMDB


//

UI


&

J2EEB/S

VMwareHUAWEI FusionSphere

 HUAWEI ManageOne Data Center Virtual Data
CenterVDCVDC
HUAWEI ManageOneVDC

DCDomainVM

VDC

VDCVDCVDCVM

ServiceUserVDC

VDCDCDC



IP

WebURL

ACLVFW

 /IP

IPWindowsRDP
LinuxSSHVNCVM
VM

/
IP
IPWindowsRDPLinuxSSH

SubnetSubnetNetACL

ACLASPFSNATVFW

httpsIP
LB

 Windows

22CPU/4G Memory/160G Disk/Windows7

ITIL V3IT
CMDB

//

UI


/




:



 :

SSO ServerCAS
Central Authentication ServiceSAMLSecurity Assertion Markup Language

LDAPLightweight Directory Access Protocol

ADOpenLDAP
LDAP
 Topo



ManageOne

Topo

Google

14IaaSOpenStack
3CloudStack
OpenNebula Eucalyptus
OpenStackCloudStackEucalyptus
OpenNebula

24OpenStack
OpenStack251
3CloudStackEucalyptus
OpenNebula

3
OpenStack3
CloudStackEucalyptusOpenNebula
OpenStack

 1.OpenStack

2.OpenStackApache 2.0 license

3.70%Python

4.OpenStack


 OpenStack FusionSphere DC FusionCompute
FusionStorage FusionNetworkOpenStackOpenStack
 OpenStackIaaS
IaaS+


nova-api

nova-scheduler

nova-console

nova-conductor

nova-novncproxy

fc-nova-compute

vmware-nova-compute

nova-compute
 OpenStack Region Availability Zone Host Aggregate
 Server matadata:
hd,cdrom,network)
 Cinder ClientCinderrestCLI

Cinder APIrest APIAPI

volume type/Nova

Cinder schudulerbackend
cinder-volume

Cinder volumebackend
driver

Cinder backupSWIFT/Ceph/TSM

SQL DBserviceMysqlPGMSSQLSQL

 Cinder-apiCinder-SchedulerCinder-Volume

APIAAHaproxyLBCinder API

ScheduerAArabbitmq3
rabbitqmqCinder volumeschedulerDB

Cinder VolumeAAbackend

Rabbitmq6.0

GaussDB


iSCSI

IET+LVM/TGT+LVM

Solaris

HP Lefthand

IBM XIV/StorwizeSVC

Nexenta

Dell EqualLogic

SolidFire

NetApp

Huawei

NFS(NAS)

NetApp

Glusterfs

Ceph

Sheepdog
 VRMFusionStorage
Cinder DriverOpenstack Cinder

VRMCinder

DriverVRM

VRM
 Neutron

linux-briptable

openvswitchVlan Tag
Vlan

Neutron

Vlan

NeutronvSwitchVlan

vSwitchVlan TagvSwitch

 ManageOneSCOCSCOC

IaaSFusionSphere OpenStackVRMVMwareOpenStack
KeyStone

BC&DR

FusionInsightHDFSHbaseSparkHiveMapReduce

 ManageOneSCOCSCOC

eSightDCOpenStackOpenStack OMVRMVMwareDC
OC

FusionInsight
 3.0ICTIT 2.22.3IT3.0
 2.3 ICT 3.0

2.2 ICT2.2 ICT 3.0

 ManageOneDCQos <= 200ms <= 1%


TopVDCVDC

TopVDCVDC
 eSightB/SB/S
TCO

B/S
 eSightH3CCISCOZTE

MIBRFC1213-MIBEntity-MIBSNMPv2-MIBIF-MIB
eSight

MIB
 (WLANAP)+ONU+UC/CC+
++IP/4+eLTE/5+eLTE*2+eLTE
*20+160*+160*/288+*40+
*10+*10+*2+*40++
*2


OpenSDK

OpenSDK

eSight

eSightOpenSDKSNMPHTTP

eSight

IT

eSight

KVM
 eSight

eSight

BIOSRAID
OS

eSight

eSight

OSCPU
WindowsRedHatSUSE

eSight

eSight

FusionCube

eSightMicroDC

MicroDC
L1

eSight

&

eSight

IPAR

eSightPON

PONOLTONU

 eSight

eSightWLAN

AC/AP
TOPO

eSightMPLSVPN

MPLSVPNVPNVPN

eSightMPLSTunnel

MPLSTELDP

eSightSLA

eSight

eSightIPSecVPN

IPSecVPNIPSecVPNIPSecVPN
VPN

eSight

IPSAV

eSightLogCenter

UCC

eSightUC/CC

UC2.0IPCCVTMIPTIPPHONEIAD/IPPBX

 eSight

VCN3000VMUMPUMTUTAUMBUMAUIPC

eSight

eLTE

eSighteLTE

eLTE


 eSight

eSight
eSight

IP

 eSight
eSight

eSight

eSightIP
IP

 eSight
eSight



 T/F/CD
 ManageOne

FusionSphereeSight

OC(OperationCenter)
//

SC(ServiceCenter)
/

FusionSphereManageOne
VRMOpenstack
VRM

eSightBGManageOne



DCFMLocal_FM

DCeSightL1L2

OCDCFMeSightDC

SCDCFM
 SLA

Local_FMSLASCAZ

SLALocal_FM

DCDC Admin

Domian Admin DC

VDC VDCAZ

AZSLA

AZSLA
 Domain Service Manager

2VDCVDCVDC Service Manager

5VM

6VDC

VDC Service ManagerVDC

1VDC

2VDC

3VDC

4VDCService User

5Service User
 6VDCService User

7VDCVDC

8VDC

9VDC

10VDC

VDC Service User

3
 VDC

VDCVDCDomain
VDC

VDCVDC

VDCVDC

VDCNetworkVFWVPNVLBVDC
VDCVDCVDC

VDC
VDC
 VDCVPC
VDCVPCVPC



VPCVPNVPN

VPNACL

VFWVPNVFWVPN

 VDC

VDC VDC (
VRF/vFW, Vxlan/vlan)

VDCVPN

VDC vfw VM
EIP/SNAT/DNAT

VPC

VPC VPC (
VRF/vFW, Vxlan/vlan)
 Subnet

SubnetVxlan/vlan

1VPCSubnet

SubnetNetAcl

( EIP/SNAT/DNAT)
VM

VPNIPSec VPN
VM

FwAcl

vfwdeny
 VPC
IP

A
VDC

 ACLVDC

IP
MySQLMySQL

IP
IPIPIP
IPIP

PHP
HTTPMySQL

VPCIP
 DC AdminDC
Domain AdminDC

Domain Service Manager VDCVDC Service ManagerVDC

VDCDomain Service ManagerVDCVDCDomain Service

ManagerVDC

VDCportalVDCVDCVDC
VPCService Manager
EBSEIPvAPP

VDC
 LAN-Base

 LAN-FreeSANSAN
LAN

(LAN-Free)


(),
,Mount,

SAN


GUI/WEB

 (Snapshot)
SNIA

 ,

IO
IO

 , , ,
, ,




0~8abcde

I/O

COW


 1.p1

2.

3.z6

4./

I/O I/O Redirect

 CBT
CBTCBT

 CBT

 P1P2:
P1CBTeBackupFusionCompute

FusionComputeS1CBT1
S1Redirect
on WriteS1Disk1
S1Disk1
CBT1Disk1CBT1
CBT0
CBT1CBT1'

eBackupCBT1
Disk1CBT1
P2
FusionComputeS1
Disk1CBT1'


 P3P4:

P3eBackupFusionCompute

FusionComputeS2

FusionCompute1CBT1'CBT2CBT
2

CBT2CBT2

eBackupCBTCBT2
Disk1CBT2
CBTCBT

P4

FusionComputeS2
Disk1CBT2

 SMB

FusionSphereVMware

2
 Commvault 3

CVMaster ServerManager Server

1

CVMedia ServerMedia Agent

1

CViDataAgent
iDataAgent



Windows 2008Windows 2008R2Windows 2012

IIS


Windows, UNIX, Linux Netware



Windows,
Linux, Unix Oracle, SQL Server, VMware, Hyper-V


 OceanStor eBackupFusionSphereVMware vSphere
CBTchange block tracing

 eBackup4

FusionSphereVMware

eBackup

SANNAS


6410000/

200Gbps
 SANNAS


3
 VIMS

VIMSVHDVIMS
VHD

CNA8
 FusionStorageFusionStorage

FusionStorageFusionStorage

CNA

VM///


 eBackup4MB

 VM

VMVM

 SAN

HypervisorLAN

LANHyperVisor
 iSCSI

HyperVisoriSCSI
VM

 CBT

RPO


VM

 LAN-Base

, , ,
, ,
, ,
, ,

 VMwareSAN TransportHotAdd Transport

SAN TransportSANFC SANIP SAN

HotAdd Transport

eBackupVmware

eBackup
 OceanStor BCManager

WindowsLinuxAIXHP-UX

FusionSpherevSphere



LUN
 BCManager5

 cachecache


LUNLUN

 OceanStor BCManager Agent
OceanStor BCManager Agent
OceanStor BCManager Server

FusionSphereVMwareOceanStor
BCManager Agent

OceanStor BCManager UI

OceanStor BCManager Server

 NAS->


LUN


pair
 HyperMetroSmartVirtualization

HyperReplication+
3DCBCManagerC



ABOceanStor V3

HyperMetro

A-A LUN

30%

10GE8G FC16G FC

SLA

> & IO > IO

10GEGE2MbpsIP

HyperMetro

V3

V3
 AI/O

APair

LUN

 HyperMetroPairPair
Pair
Oracle
LUNOracle
LUNLUNLUNLUN
pair

Pair
Pair

LUN
LUN

 LUN

 GB
2-3GB

HyperMetro

 I/OI/O
128M0-128MI/OA128M-
256MB
 HyperMetro

I/O



IO

IO

UltraPathAABB



VM

LicenseLUNLUN
LUNLUNLUN
LUNLUN

IPSANLUNLUN

IO

RPORTO

DR

RTO


RPORTO

DR

RTO




 FusionManager
 BCManagerB/S

BCManagerBCM UIBCM Server

BCM UIBCM

BCM ServerBCM
BCM

BCMBCMFCVRGREST over Https

BCMFM SOAP over Https



AA

ROBO

BCMFMFC
VRGBCM

BCMBCM
BCM
 Rainbow hConvertor

XXX/


.

6




OracleSQL SERVER



















&IT: IT

IT:

:
 IT








 ,

 supporthttp://support.huawei.com/enterprise/-
-IT---DC Rainbow
 TCOROI:
IT

ITIT
IT
IT

 DCaaS(VDC)
DCaaS(SDDC)VDC

Bare-metalVDCVDC
VDC

DC2



VMware,
FusionSphere

DC2OpenStackFusionSphere
VPC

VDCDCaaS
VDC
 OpenStack
OpenStack

ManageOneSCOC:

SC:

OC://

FusionCompute

eBackup

FusionSphere OpenStackREST
VMware, UVP

Nova:,Glance:,cinder:,neutron:,swift: ,
keystone:,Ceilometer:


FusionSphere OpenStackVMware vSphere,UVPOpenStack

vSphere
VMwareOpenStackFusionSphereVMware
Nova/CinderVRM OpenStack

 Web2.0SOA

IPSSSL VPNAnti-DDoSIDS/IPSVDC
VDC

IPS

Cloud

Web

IT
 IDSIPSVPNAnti-DDoS

VDC
1

VSA Virtual Service Appliance

VSAVMVSA

VRouter/VFWL3OSPF/BGPACLNATIPSec/GRE VPN

VLBTCPHTTPHTTPSVLB

NGFWVPNIDSIPSAnti-DDoS
WEB



 VDCVFWVSAvIDSvIPS
vAnti-DDoSVDCVDCVPC
VFWVPCVPC

 APIAPI


windows



TPM


TPMOSOS


 1
DC
 AAOceanStor V3 HyperMetro
Web
100km
RPORecovery Point Objective=0RTO
Recovery Time Objective=0RTO

:

OceanStor V3HyperMetro
I/O

OceanStor V3SmartVirtualization

FastWrite1I/O 21

CloudEngineEVN

EVN23

USGFWIDS

FusionSphereVMware

webApp

LUN

OptiX OSN

1+1

AARPO=0RTO
=0

HyperMetro

FusionSphereVMwareHA

DWDMEVN
RHI

 OceanStor V3HyperMetro
HyperMetroAA
HyperMetro

HyperMetroAA(Active-Active)LUN
I/O
AA



HyperMetroFCIP
FCIP
FC

2+2
2


I/O

FCIP
AA

HyperMetroPair

LUNLUN
LUN

pairLUN

pair


 AI/O

APair
Pair

LUNLUNCache

LUN

PairI/O

HyperMetroPair
HyperMetroI/O
HyperMetroPair

 3DC

3DC 3

HyperMetroOceanStor HyperReplication
BCManager 3DC

+3DC+

3DCBCManager


 LUN
eDevLuneDevLun
eDevLun
LUNeDevLunLUNWWN

eDevLunLUNLUNLUN
HyperMetroLUN


COW

HyperMetroHyperSnapLUN

 HyperMirrorLUN


OceanStor V3LUN
LUN.

HyperMetroLUNPair



HyperMetro

FusionSphereVMwareHA

DWDMEVN
RHI

 HA





B/S WebAppSLB

C/S AppDC


HyperMetro

FusionSphereVMwareHA

DWDMEVN
RHI

 HTTP Web Apache
( Weblogic)Web

Web
 Web SLBF5 LTM
Web DC1
DC2

AA

DC
 C/SIPClientIP

C/S
2
 C/SIP
IPDC
 A/SActive-Standby
A/AActive-Active

Active-StandbyIBM PowerHAHP ServiceGuardMicrosoft WSFC

Veritas Cluster Server
(Failover)
IP

 Active-ActiveActive-Active

Active-ActiveOracle RAC(Real Application Cluster)
 Oracle Extended RACOracle
OracleTAF

Oracle RAC

Sub-cluster with largest number of Nodes

(Sub-cluster with lowest node

number)
 Oracle RAC2+1A2B1
A
A

Oracle RACService

Oracle RACTAFPREFERRED
AVAILABLE



HyperMetro

FusionSphereVMwareHA

DWDMEVN
RHI

 AB

100km

AB

 B/SWebWeb-App-DBWeb/App
DC DBDCOracle RAC
Web/AppDBApp/Web

Web/App3Web/App
2Web/App

DB3DB
2DB
DC

 C/SIPGSLBApp-DBApp
DBApp
DBApp

DB3DB
2DB
DC

App3App
2App

AppDCVRRP
VM

AppApp
DCDC



 ARPARP


 CSS+
CSS+CSS+

 CSS+
CSS+
EVN PEEVN PEEVNDC
ARPDC

 B/S

IPGSLBDNS

GSLBF5 GTMwindowsDNS

GSLB

Local DNS

GSLBLocal DNSRTT

C/SIP

C/S
DC
 SLBSLBF5 LTMhttp/httpsFTP
DiameterSMPPSIPSLB
IP

SLB

SLB

SLBSLBSLB
SLB
 SLBHTTPSLBIPIP
WebIP

SLBHTTP

SLBHTTP
SLBPingUDPTCPHTTPSHELL



HyperMetro

FusionSphereVMwareHA

DWDMEVN
RHI

SVNSSL
443

SVNIPIP
SSLNAT

WebIP
SVNSVNSVN

 &

USG

DeepSecurity

ESXiDeepSecurity

 I/O
A

AB

ALUN

AI/OB

BI/O

HTTPSLBIP

SLBWeb

WebHTTP
HTTP

AHTTP

 A

AWeb
B

HTTPSLBIP

SLBWebWeb

AWeb
B

AHTTP

 DCAcost10
Bcost100

ABcost100

BBAWeb

 Oracle RAC


LUN

ABLUN

BLUN

OracleBAI/O
BA

BWeb

GSLBWeb
B


ABBLUN

OracleBA

GSLBWeb
B
 FusionAccess
CPU

FusionAccessHDP
FusionSphere
PC
FusionAccessFusionAccess


FusionAccess

PC PC

(TCO)

FusionAccessGPUGPU
TCO
 FusionAccess:HuaweiHDP

HDP AgentHuaweiHDP
FusionAccess

FusionSphere:

FusionAccessPortal: FusionAccess
FusionSphereFusionManager
 FusionSphereFusionComputeFusionManager
FusionManagerFusionManager



PortalFusionManagerUHMUnified Hardware
Management

FusionComputeFusionManager
FusionComputeVRMVRM
HA

VRMFusionManager
FusionSphere

HA
IT

,


IT

 FusionAccessHDCITAHDC

ADAD

WIWIWeb
AD
SVNWIWIHDCIPWIHDC

TCMTCMTCMTC

ITAITAIT

HDCHDC

HDCITA



HDCITA
1:11NMN

HDCHDC
HDC

HDCLicense

WIHDC

ITA

LicenseLicenseLicenseLicense

License

GaussDBGaussDBITAHDC

ITACITAC

Loggetter

vAGvAG
VNC

vLBSVN5000NetScalerWIWI
IPWI
 FusionCube

//

,3SSD

2-3


 FusionCubeITFusionCube
12U

FusionCube

8/
/ITFusionCube
 FusionSphereFusionStorage
E9000+FusionStorageMCNALCNASCNACNAMCNA
LCNASCNACNA

MCNA2P *6CPU
64G128GFusionStorage

VRM4Core/8G/50GFusionManager4Core/16G/280G
FusionAccess

FusionStorageDomain01Core CPU
25GFusionStorage6~12
FusionSorage

LCNAFusionStorage
SCNALCNAFusionStorageMDC
CPU2P*2640
64G128G
 FusionStorageDomain01Core CPU
25GFusionStorage6~12
FusionSorage

SCNAFusionStorage
CPU2P*2640
64G128G

FusionStorageDomain01Core CPU
25G6~12FusionStorage

CNA
CPU2P*264064G
128G





;PC

SANNAS

HDPUSB
PC

3DCAD3DMAXUG

GPUGPU
nVidia K1
K2K2000 K40003D
 VDIWindows
Windows
VDI
IO
VDIIOPS

IOTailor
IO
C:


IOIOtailor

ITIT




()



C:\User(Windows 7)C:\Documents and Settings(Windows XP)
C:\Program Files
C

iCache

FusionAccess
Windows



ITIT

()

 OA
Windows XPWindows 7OfficeProject
VisioInternet ExplorerOutlookUSB

ITITAD
ITDHCP
IPDNS

OA11
HDP

PC


WINDOWS XP/Windows 7MS Office

Internet ExplorerAcrobat Reader(pdf)MediaPlayer
32
Java(My Ecliplse),
ALTUIM,MentorVisual StutioMatlab

11
USBU

PC

10000
8000


TC


 FusionManagerFusionsphereopenstack6.0
FusionSphereOpenStackOM1FusionSphereOpenStack
FusionManager

 DC

BOQ

 External_baseopenstackomvlanIP
 <50PM50~100PM50~100PMOMVRMIP

Internal_base20

SCOCSCOC3API3OM
 datastorglance



10GEDomain0
6GBVCPUVCPU4

IODomain0
2GBVCPUVCPU2

Domain04GB

UDomain02GB
 HADCFusionComputeHA

DCFusionComputeCPU
4

DVSDCFusionComputeDVSOpenStack

 FC66428862
 DCFusionSphereCNA

FCSANZone
 eBackupLAN-BaseLAN-FreeDCeBackup

 eBackup

eBackupGEVLAN

eBackupGEVLAN

eBackupGE10GEFusionSphere
VLANFusionSphereVLAN

eBackupGE10GEIPSANNAS
FusionSphere