Professional Documents
Culture Documents
2
Unit I INTRODUCTION
Cloud-definition, benefits, usage
scenarios, History of Cloud Computing -
Cloud Architecture - Types of Clouds -
Business models around Clouds Major
Players in Cloud Computing - issues in
Clouds - Eucalyptus - Nimbus - Open
Nebula, Cloud Sim
3
UNIT II CLOUD
SERVICES
Types of Cloud services: Software as a
Service - Platform as a Service
Infrastructure as a Service - Database as
a Service - Monitoring as a Service
Communication as services. Service
providers- Google, Amazon, Microsoft
Azure, IBM, Sales force.
4
UNIT III COLLABORATING
USING CLOUD SERVICES
5
UNIT IV VIRTUALIZATION FOR
CLOUD
6
UNIT V SECURITY, STANDARDS
AND APPLICATIONS
Superior
Proliferation
software
of devices
methodologies
Virtualization
Wider bandwidth
leveraging
for
the powerful
communication
hardware
11
Evolution of Sharing on the Internet
Cloud Computing
Services Sharing Everything as a service over the Web:
SaaS, utility computing, IT services,
Ubiquitous, always available, scalable,
The Grid
Resource Sharing Grid Computing
Standards and software for sharing of
remote resources and collaboration
Mainly used for highly scalable HPC jobs
Networking Networks
Multiple regional networks linking computers
Initially at universities and national labs
12
2010: Microsoft
1970: DARPAs TCP/IP 1999: Grid Computing Azure
Mainframes
Operating
System
Networking and
Parallel
Hardware
Hardware
Applications
User interface for presentation
Middleware
Distributed System
Operative System
Execution platform including network connectivity services
Hardware
Computer and network hardware
MPI Programming,
JMS, MSMQ, MQS
Message
Based
Communicatio
n
Paradigms /
Architectural
Models
History of Cloud systems
2010: Microsoft
1970: DARPAs TCP/IP 1999: Grid Computing Azure
Mainframes
19
RPC
Node A Node B
Network
DOF interaction
Node A Node B
Application B
21
10 16
Instance Remote
15
Instance
5: Object
1: Ask for Object Proxy Object Skeleton Activation
Reference
9 11 20 17 14 6 4
Application A
8 12 7
13
2 19 18 3
Network
Service Oriented Architectures
(SOA)
Service
Registry
find Publish
Service Service
Requestor provider
Bind
22
Service Oriented Architecture model implemented by XML Web Services
XML Web Services Foundation
Simple, Open, Broad Industry Support
Internet
Ubiquitous Communications:
(HTTP)
Container Container
WSEngine WSEngine
Transport Transport
HTTP
Response
SOAP Response SOAP Response
Header (optional)
Determines how a recipient of a SOAP message should process the
message
Adds features to the SOAP message such as authentication,
transaction management, payment, message routes, etc
Body (mandatory)
Exchanges information intended for the recipient of the message
Typical use is for RPC calls and error reporting
SOAP Elements
SOAP Encoding
Envelope package
Header/Body pattern
Similar to how HTTP works
Header
Body
Simple Example
<Envelope>
<Header>
<transId>345</transId>
</Header>
<Body>
c = Add(n1, n2)
<Add>
<n1>3</n1>
<n2>4</n2>
</Add>
</Body>
</Envelope>
SOAP Request
<SOAP-ENV:Envelope
xmlns:SOAP-ENV=http://schemas.xmlsoap.org/soap/envelope/
SOAP-ENV:encodingStyle="http://schemas.xmlsoap.org/soap/encoding/>
<SOAP-ENV:Header>
<t:transId xmlns:t=http://a.com/trans>345</t:transId>
</SOAP-ENV:Header>
<SOAP-ENV:Body>
<m:Add xmlns:m=http://a.com/Calculator>
<n1>3</n1>
<n2>4</n2>
</m:Add>
</SOAP-ENV:Body>
</SOAP-ENV:Envelope>
SOAP Request
<SOAP-ENV:Envelope
xmlns:SOAP-ENV=http://schemas.xmlsoap.org/soap/envelope/
SOAP-ENV:encodingStyle="http://schemas.xmlsoap.org/soap/encoding/>
<SOAP-ENV:Header>
Scopes the message to the SOAP
<t:transId xmlns:t=http://a.com/trans>345</t:transId>
namespace describing the SOAP
</SOAP-ENV:Header>
envelope
<SOAP-ENV:Body>
<m:Add xmlns:m=http://a.com/Calculator>
Establishes the type of encoding
<n1>3</n1> that is used within the message
<n2>4</n2> (different data types supported)
</m:Add>
</SOAP-ENV:Body>
</SOAP-ENV:Envelope>
SOAP Request
<SOAP-ENV:Envelope
xmlns:SOAP-ENV=http://schemas.xmlsoap.org/soap/envelope/
SOAP-ENV:encodingStyle="http://schemas.xmlsoap.org/soap/encoding/>
<SOAP-ENV:Header> Qualifies transaction Id
<t:transId xmlns:t=http://a.com/trans>345</t:transId>
</SOAP-ENV:Header>
<SOAP-ENV:Body> Defines the method
<m:Add xmlns:m=http://a.com/Calculator>
<n1>3</n1>
<n2>4</n2>
</m:Add>
</SOAP-ENV:Body>
</SOAP-ENV:Envelope>
SOAP Response
<SOAP-ENV:Envelope
xmlns:SOAP-ENV=http://schemas.xmlsoap.org/soap/envelope/
SOAP-ENV:encodingStyle="http://schemas.xmlsoap.org/soap/encoding
<SOAP-ENV:Header>
<t:transId xmlns:t=http://a.com/trans>345</t:transId>
</SOAP-ENV:Header>
<SOAP-ENV:Body>
<m:AddResponse xmlns:m=http://a.com/Calculator>
<result>7</result>
</m:AddResponse>
</SOAP-ENV:Body>
</SOAP-ENV:Envelope>
Response typically uses method
name with Response appended
XML-RPC vs SOAP
XML-RPC: lower common denominator form
of communication
Simple, easy to understand (only 7 pages
specification)
Describes WS functionality
Quality of Service
Static UDDI Service Discovery
Management
Direct UDDI Service Publication
Security
WSDL Service Description
SOAP
XML-based
Messaging
HTTP, FTP,e-mail, MQ, IIOP, . Network
Web Service Interaction reference
Scenario
WSDL(s
Web Web Service
)
Server
Application
Web Service
WSDL
WS Client
Application
Application
Architectural styles for
Distributed Computing
Components and connectors
Software Architectural Styles
Data Oriented architecture
Data Flow architecture
Call and return architecture
Architectural styles based on Independent
components
40
History of Distributed
Computing
System Architectural Styles
Client/Server Computing
Peer-to-peer Computing
Grid Computing
Collaborative Computing
Cloud Computing
41
Trends in computing
Cluster Computing
Grid
Peer to peer Computing
Computing
Computing
Collaborative
Computing
Cloud Computing 42
42
Client/Server Computing
Centralized Apps & Storage
43
Client-server
request
Two Tier
(Classic Model)
clien respons serve
t e r
Three Tier
clien serve
t Server/client r
N Tier
serve
r
45
P2P
peer
peer
peer
peer
peer
peer
peer
Grid Computing
Providing More Computing Power
47
Grid Computing
Distributed parallel processing across a network
Key concept: the ability to negotiate resource-
sharing arrangements
Characteristics of grid computing
Coordinates independent resources
Uses open standards and interfaces
Quality of service
Allows for heterogeneity of computers
Distribution across large geographical boundaries
Loose coupling of computers
48
48
Grid Context
Users
Job submission
Portal / CLI
Research Activities @ 49
CARE
Collaborative Computing
Working as a Group
50
Cloud Computing
51
Social Networks,
Scientific Computing,
Enterprise
Applications
Applications
(SaaS)
Frameworks for
Cloud Application
Development
Middleware (PaaS)
Virtual hardware,
networking, OS Hardware and OS
images, and storage. (IaaS)
Enabling Technologies
Bandwidth
WS
Services interface
64-bit
processor
54
Status of Grid
61
Evolutionary Development of
the Web
Web 1.0 Read Mainly - Graphical UI
63
Defining Clouds: There are many
views for what is cloud computing?
Over 20 definitions:
http://cloudcomputing.sys-con.com/read/612375_p.htm
Renting remote storage backup
Renting remote server hosting Web server
Renting remote more servers to manage large workload
Buyyas Scientific definition of Cloud Computing
Cloud is a market-oriented distributed computing system
consisting of a collection of inter-connected and virtualised
computers that are dynamically provisioned and presented as
one or more unified computing resources based on service-level
agreements (SLA) established through negotiation between the
service provider and consumers.
SLA = {negotiated and agreed QoS parameters + rewards +
penalties for violation of agreement....}
64
Definition
National Institute of Standards and Technology
Cloud computing is a model for enabling convenient,
on-demand network access to a shared pool of
configurable computing resources (e.g., networks,
servers, storage, applications, and services) that can
be rapidly provisioned and released with minimal
management effort or service provider interaction.
(NIST Definition)
This cloud model promotes availability and is composed of
five essential characteristics, three service models, and four
deployment models.
65
November 18, 2009 65
66
What is a Cloud?
SLAs
Web Services
Virtualization
67
Traditional Computing vs. Cloud
Computing
Traditional Computing Cloud Computing
PC-centric Document-centric
Own copies of software Rented copies of
on own hardware software on rented
No access outside the hardware
network Accessible anywhere
(Got to have internet
If PC crashes, you loose connectivity though!)
everything If PC crashes, you dont
loose anything
68
What Cloud Computing Isnt
Isnt network computing
Network Computing Cloud Computing
Applications/documents are Encompasses multiple
hosted on a single companys companies, multiple servers,
server and accessed and multiple networks.
over the companys network.
Access is over the companys Cloud services and storage
network only. are accessible from
anywhere in the world over
an internet connection.
69
What Cloud Computing Isnt
Isnt traditional outsourcing
Outsourcing Cloud Computing
A company farms out its Access data or applications
computing service to an anywhere via internet.
outside firm, which hosts the
companys data or
applications that can be
accessed only by the
employees via companys
network.
70
What is cloud computing?
It is document centric, but not PC centric
It is a large group of inter-conncted
The cloud of computers extends beyond a
single company or enterprise
Accessed via internet
Cross enterprise and cross paltform
Technology and infrastructure are invisible
71
What is NOT cloud computing?
NOT network computing
NOT outsourcing
Both the above cases, data or applications
are accessible only to the companys
employees via companys network, not the
entire world via internet
72
Properties of Cloud Computing
Googles Perspective
User centric
Task centric
Powerful
Accessible
Intelligent
programmable
73
Characteristics of Cloud Computing
Scalability
Elasticity
Self service provisioning
On demand resource provisioning
APIs
Billing and metering services
Supporting business agility
Reducing capital expenditure
74
Pros and cons
Lower cost computers
Improved Performance
Lower IT infrastructure cost
Free Maintenance Issues
Lower software cost
Instant Software updates
Increased computing power
Unlimited storage capacity
75
Pros and cons
Increased data safety
Improved compatibility between OS
Improved document compatibility
Easier group collaboration
Universal Access to documents
Latest version Availability
Not reliant a single computer
76
But there are issues
Constant internet facility
Low bandwidth
Economic impact (e.g. employment)
Competition
Standards
Discrepancies in legal regimes
Environmental impact
77
But there are issues
Can be slow
Features may be limited
Stored data might not be seen
Failure or Loss of data
78
Challenges
Alignment with the needs of the business / user
/ non-computer specialists / community and
society
Need to address the scalability issue: large
scale data, high performance computing,
automation, response time, rapid prototyping,
and rapid time to production
Need to effectively address (i) ever shortening
cycle of obsolescence, (ii) heterogeneity and
(iii) rapid changes in requirements
Transform data from diverse sources into
intelligence and deliver intelligence to right
people/user/systems
What about providing all this in a cost-
effective manner?
Security Services
1. Authentication
2. Authorization
3. Availability
4. Confidentiality
5. Integrity
6. Accountability
7. Privacy
80
Who benefits from Cloud
Computing?
Collaborators
Road warriors
Cost-conscious users
Cost-conscious IT departments
Users with increasing needs
81
Who shouldnt be using Cloud
Computing?
Internet-impaired
Offline workers
Security conscious
Anyone married to existing applications
82
3 Cloud Service Models
Cloud Software as a Service (SaaS)
Use providers applications over a network
Cloud Platform as a Service (PaaS)
Deploy customer-created applications to a cloud
Cloud Infrastructure as a Service (IaaS)
Rent processing, storage, network capacity, and other
fundamental computing resources
83
84
85
Cloud Architecture
Application
Platform
Unified Resource
Fabric
interactions
across
collections of
resources,
directory services
collectionresources
of specialized
that
tools, middleware
have been and
services on
abstracted/encap
top of the
discovery, negotiation,
unified resources
sulated to
monitoring, accounting and
provide a
communication payment of
development and/or
and sharing operations on
deployment platform
authentication individual resources
protocols
87
88
Cloud Applications
SaaS
Pure
Tools
PaaS
Pure
Adaptive Management
User-level Web 2.0, Mashups, Concurrent and Distributed
Middleware
Programming, Workflows , Libraries, Scripting
Autonomic Cloud
Economy
IaaS
Cloud Resources
System
Infrastructure
IaaS Architecture
Web based Management
Interface
Web Services, Portals, REST API
VM Pool
Monitoring Reservation VM Image Repository
Management
Physical Infrastructure
Desktop /
Datacenter Cluster Heterogeneous Third Party IaaS
Resources
Cloud
PaaS Architecture
User
Elasticity &
Management
Scaling
Application
Runtime
Management
94
Public, Private and Hybrid clouds
95
Private cloud Stack
Paas Dynamic
Provisionin
IaaS (M) g
Public Cloud
Datacenter Cluster Desktop Grids /
NOWs
Community Cloud
Application
Services
3rd Party
Cloud Public Cloud
Developmen
Private Cloud
t
Platforms
Public Cloud
Private Cloud
Federal and
Government
Bodies
Private
Users
Industries
Enterprises
Public Services
Private VS Public Cloud
99
5 Essential Cloud Characteristics
On-demand self-service
Broad network access
Resource pooling
Location independence
Rapid elasticity
Measured service
100
10
The NIST Cloud Definition Framework
Hybrid Clouds
Deployment
Models Private Community
Public Cloud
Cloud Cloud
On Demand Self-Service
Essential
Broad Network Access Rapid Elasticity
Characteristics
Resource Pooling Measured Service
SaaS Application
IaaS Infrastructure
Cloud Providers
103
Infrastructure Trends
Four quickly emerging infrastructure
12.3
trends:
Service-oriented architecture
Virtualization
Grid Computing
Cloud computing
BYOD
Bring your own device is gaining
popularity
Infusions of new technology
Employee buy-in to new infrastructure
Often more affordable for business
Convergence everywhere
105
Convergence in EVERYWHER
Convergence of
technology
Convergence of
business and
ecosystem
Convergence of
people, application,
things, data, devices,
etc.
Source: IDC
Convergence of IoT, big data and
cloud
For IoT, number of billions of connected devices is
an indicator of IoT. The connectivity is just an
enabler but the real value of IoT is on data
(business insight/data-driven economy)
For Big Data, data collection is one of the main
concern, and IoT can play an important roles for
data collection and data sharing
For Big Data, data is nothing without real business
value insight
Cloud offers Everything as a Service business
model for IOT and big data.
IoT is a King, Big data is a Queen and Cloud is
a Palace
Cloud-based IoT Big Data
applications
Massive
monitoring
Prescriptive and
descriptive Real-time
actionable insight
Proactive and
predictive Observation
Performance and
optimization
Key requirements of IoT-Big data
platform
Security and
privacy
Intelligent and
Scalable dynamic
Distributed and
Real-time decentralized
iKaaS-EU-Japan IoT big data platform
intelligent Knowledge as as a Service
App. App.
Query
Storage KaaS
Global Cloud
Data
Data
Knowledge Knowledge
Security Security
GW GW
Query Query
Sensors Sensors
/IoT Devices /IoT Devices
118
1. Smart Farming
119
Cloud for agriculture
Cloud based monitoring and maintenance
WSN and cloud will enable so many
applications for cultivation
Vertical / horizontal farming may be used
120
2. Smart Dresses
Dresses will be embedded with chips to
monitor the health conditions
Protection from pollution
Providing comfortable environment
Provided with communication and other
facilities
121
3. Smart Home
122
CLOUD for smart home
Child Monitoring
Auto lighting/ switch on/off a device
Supporting aged parents
Alerts for unauthorized entries
123
4 Smart Learning
124
U Learning and Smart Classroom
125
Cloud for U Learning
Cloud services enable personalized
learning
Access to context based resources
Allows experts to be contacted
Collaborative learning becomes easier
Interactive learning is feasible
Active learning may be effectively
implemented
Evaluation may be done in a standard way
126
5. Smart Health Care Systems
Smart monitoring of healthcare
Tele-operations
Collaborative Surgery operations
Intelligent Diagnosis
Bio-pharmacy
Natural Treatment
127
6. Space tourism will be common, and
40,000 humans will be working in orbit.
128
Cloud computing for Space
tourism
Communication across planets
Protocol to be developed
Once internet is reached, cloud takes care
of the communication within the planet
Information sharing across planets -
Research
129
7. Automated flying drones will
transport humans.
130
8. Smart Car :
Driverless cars will be in common place
131
Cloud with Smart Car
Possible to extend GPS services using
cloud for easier guidance and monitoring
Surveillance cameras to be connected to
cloud for smart routing during heavy traffic
Cloud services may be extended for the
benefit of drivers as well as passengers
132
How Does It Affect You?
9 Mobile Mobile is becoming a major design
point for more applications
Tablet use will explode
Mobile apps are a critical enabler
of B2C interactions
Context Aware Computing enters
your planning through location
based services
Learning a second Application delivery, management
language will no and support complexity increases
longer be The rise of the App Store 133
necessary.
Cloud and Mobile
Mobile services are easily integrated with
cloud services
Language translators for the people
Smart phones with cloud services enable
many domestic applications to users
Complex applications are possible with the
help of back end computing using cloud
134
10 Humanoids
A large number
of people will
have robot
lovers.
135
Robot and CLOUD
Cloud enables disaster management using
Robot
Controlling robots using cloud for defense
applications
Domestic applications for cleaning,
cooking and any other repetitive works
136
Major Players in Cloud
Amazon
IBM
HP
Google
Microsoft
Workday
Oracle
Cisco Webex
Salesforce.com etc., 137
Elastic Utility Computing Architecture Linking Your Programs
To Useful Systems
Web services based implementation of elastic/utility/cloud
computing infrastructure
Linux image hosting ala Amazon
Interface compatible with EC2
Works with command-line tools from Amazon w/o modification
Enables leverage of emerging EC2 value-added service venues
(e.g. Rightscale)
Functions as a software overlay
Existing installation should not be violated (too much)
One-button install using Rocks
System Administrators are people too.
138
Eucalyptus Architecture: WS-Cloud
Amazon EC2 Interface
Client-side API
Translator
Cloud Controller
Cluster Controller
Node Controller
139
Components of Eucalyptus
Node Controller
Cluster Controller
Walrus
Storage Controller
Cloud Controller
140
Components of EUCALYPTUS
141
Node Controller (NC)
Node Controller runs on each node and controls
the life cycle of instances running on the node.
It interacts with the OS and the hypervisor running
on the node and the Cluster Controller (CC).
Functions
Collection of data related to the resource availability
and utilization on the node and reporting the data to
CC
Instance life cycle management.
142
Cluster Controller (CC)
CC manages one or more Node Controllers and
deploys/manages instances on them
CC also manages the networking for the instances
running on the Nodes under certain types of
networking modes of Eucalyptus
Functions
To receive requests from Cloud controller to deploy
instances
To decide which NCs to use for deploying the instances on
To control the virtual network available to the instances
To collect information about the NCs registered with it and
report it to the Cloud controller
143
Walrus
Walrus provides a persistent simple
storage service using REST and SOAP
APIs compatible with S3 APIs.
Functions
Storing the machine images
Storing snapshots
Storing and serving files using S3 API
144
Storage Controller (SC)
SC provides persistent block storage for use
by the instances.
SC is similar to the Elastic Block Storage
(EBS) service from AWS.
Functions
Creation of persistent EBS devices
Providing the block storage over AoE or iSCSI
protocol to the instances
Allowing creation of snapshots of volumes
145
Cloud Controller (CLC)
Cloud Controller (CLC) is the front end to the entire cloud
infrastructure.
CLC provides an EC2/S3 compliant web services interface to
the client tools.
CLC interacts with all the components of the Eucalyptus in
managing the cloud infrastructure.
Functions
Monitor the availability of resources on various components of
the cloud infrastructure, including hypervisor nodes that are used
to actually provision the instances and the cluster controllers that
manage the hypervisor nodes
Deciding which clusters will be used for provisioning the
instances
Monitoring the running instances.
146
OpenNebula
Open Nebula
148
Services rendered
149
Architecture
150
Open nebula Standrds
151
OpenNebula
OpenNebula is the open-source industry
standard for data center virtualization,
offering the most feature-rich, flexible
solution for the comprehensive
management of virtualized data centers to
enable on-premise Infrastructure as a
Service Clouds.
152
Key Features
Interfaces for Cloud Consumers
Service Management and Catalog
Interfaces for Administrators and Advanced users
Appliance Marketplace
Chargeback
Capacity and Performance Management
High Availability and Business Continuity
Virtual Infrastructure management and Orchestration
External Cloud Connector
Platform
Security
Integration with Third-party Tools
Licensing
Upgrade Process
Quality Assurance
Product Support
153
Interfaces Provided
Cloud Consumers: Cloud interfaces like the OCCI
and EC2 Query and EBS interfaces, and a simple
Sunstone cloud user view that can be used as a
self-service portal.
Cloud Advanced Users and Operators:
Administration interfaces like a Unix-like command
line interface and the powerful Sunstone GUI.
Cloud Integrators: Extensible low-level APIs in
Ruby, JAVA and XMLRPC API
Appliance Builders: A Marketplace with a catalog
of virtual appliances ready to run in OpenNebula
environments
154
Interfaces Provided
155
Open Nebula Interfaces
156
Nimbus
157
OpenStack
Apache 2.0 licensed
Open Source No enterprise version
Open GitHub
Launchpad
Development
Open OpenStack foundation in 2012
Now 190+ companies, 3000+ developers, 11000+
Community members
158
Block Storage CERN Network
Provider Database
Cinder
Network
Account mgmt
Compute
system
Scheduler
Keystone Nova
Microsoft Active
Directory
Horizon Glance
CERN DB
on Demand
159
Cloud Storage
160
Cloud Storage Providers
161
References
162
163
Cloud Computing: Implementation, Management,
and Security by John W.Rittinghouse and James
F.Ransome : CRC Press 2010
164
Cloud Computing: Web-Based Applications That Change
the Way You Work and Collaborate Online by Michael
Miller : Que Publishing 2009
165
Cloud Computing Best Practices for Managing and
Measuring Processes for On-demand Computing,
Applications and Data Centers in the Cloud with
SLAs by Haley Beard: Emereo Pty Limited, July
2008.
166
Cloud Application Architectures: Building
Applications and Infrastructure in the Cloud:
Transactional Systems for EC2 and Beyond
(Theory in Practice (O'Reilly))
by George Reese: O'Reilly
167
Cloud Computing, A Practical Approach by Toby
Velte, Anthony Velte, Robert Elsenpeter: TMH,
2009
168
Kai Hwang, Geoffrey
C. Fox, Jack J.
Dongarra,
Distributed and cloud
computing, MK
Publishers
RESTful Web Services Web services for the real world
by Leonard Richardson, Sam Ruby : O'REILLY
170
Professional Web 2.0 Programming
(Wrox Professional Guides)
by Eric Van der list, Danny Ayers, Erik Bruchez, Joe
Fawcett, Alessandro Vernet : Wrox
171