You are on page 1of 45

Foundation for an agile IT Infrastructure:

Building the ultimate database container


with
Red Hat Enterprise Linux, MySQL, and
Virtualization
Security Agility Reduced Cost

Jan Mark Holzer


jmh@redhat.com
Consulting Engineer
Emerging Technology Group
CTO Office
Outline
• What is virtualization and how can it help
• Red Hat Enterprise Linux 5 & Virtualization
Red Hat Enterprise
• Database Appliances Linux
• Use Models and Deployments
• Q&A

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 2
Why virtualization ?

It’s fun.

It gets a lot of papers published.

It’s going to change everything. Eventually.

But the customer benefits boil down to just two things…

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 3
Customer Benefits
Virtualization can help to manage cost
 Virtualization enables distributed, automated system management
 Virtualization allows resources to be managed as abstract entities
 Independent of physical instantiation, location – even existence
 Physical servers host multiple virtual servers
 Virtual servers are objects that hide underlying complexity
 Presents a common interface and architecture
 Simplifies OS and system maintenance
 Hardware abstraction
 Virtual resources can be allocated and managed dynamically
 Enables more efficient use of existing resources
 Manage such things as cost, QoS, power,floor space, cooling and security
 Enhances scalability while controlling costs
 Virtualization is the fundamental enabling technology for utility computing
and utility services, both of which will reduce costs
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 4
Customer Benefits
Virtualization can help to manage risk
 Virtual servers run in secure compartments
 Isolation is comparable to separate physical servers
 Failures, even user and kernel errors, cannot propagate to other virtual servers
 Individual applications can be mapped to separate virtual servers
 Enhances security and separation
 Avoids application incompatibility problems
 Separation of virtual and physical resources facilitates availability
 Transparent hot-swap component replacement and upgrades
 Live virtual server migration for load management and maintenance
 Low-cost redundancy
 Virtualization provides a risk buffer for capacity planning
 Under-provisioning to reduce expenses
 Over-provisioning to ensure adequate capacity
 Dynamic resource management can mitigate these risks
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 5
Example: Data Center Dilemma
 Data center has physical constraints
 Fixed sized, fixed power, fixed cooling, etc
 Often physical constraints are cost prohibitive to change
 Data centers have excess capacity
 Volume servers (Intel ISS) 10-15% utilized, mid / high 30-40% (>4 socket)
 Customers comfortable with single application server
 One application per OS instance – optimal unit of management, control, etc.
 Application stacking to consolidate on a single OS viewed as higher risk and
often more expensive
 Need a new service, deploy a new server / storage (ie VM warehouse model)
 Dilemma
 Can no longer afford current paradigm
 Can’t afford the $10 million server or storage controller that translates into
a new data center or expansion
 Can’t afford continual increase in number of administrators or cost / time to
deploy new services
 Can’t afford power and thermal management
 e.g. Annual electric bill for Google’s 200K servers greater than cost of
all server hardware

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 6
Example: Server & Storage Virtualization
 Multiple Views
 One or more applications per view
 One OS per view
 Multiple OS versions per server
 Enable transparent migration of services between hardware instances –
blades, enclosures, etc.
 Benefits
 Increased hardware utilization
 Avoid the $10 million dilemma
 Reduced time to deploy new services
 Don’t need to purchase new server / storage to deliver
 Use views to validate service on existing hardware while maintaining
complete isolation and protection
 Reduced cost
 Fewer servers to buy / manage
 Lower software licensing
 Per core rather than unit of work / value delivered
 Few administrators
 Decouple hardware evolution from software
 No longer legacy software constrained
 Virtualization provides legacy view
 Change customer control point
 Virtual and physical management infrastructure drive customer purchase
decisions
 Motivated to upgrade to virtualization-capable hardware and software
 De-motivated to migrate to competitive offerings
 Those that establish beachhead will be more difficult to displace

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 7
What is Virtualization?
 Multiplex one machine into different “Virtual Machines” VMs; allows running different
isolated guest Operating Systems with different applications on same physical
hardware.
 Allows a “Guest” OS to run
under control of a supervising Hypervisor/VMM
master program that is called: Hardware

“Hypervisor” or “Virtual Machine Monitor (VMM)”.


 Hypervisor / VMM Functionality:
 Virtualizes System Resources
 Provides Scheduling of host/guests
 Intra-guest communication
 Common grounding
 'Host' also often referred as 'dom0' and/or HyperVisor
 'Guest' also known as 'domU'

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 8
Red Hat Enterprise Linux Overview

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 9
Red Hat development model
• Collaboration with partners and open source contributors to develop
technology
• Deliver complete distributions in two stages for two users
− First stage
• Fedora: The development vehicle
• New versions approximately twice each year
• Unsupported
• Fast moving, latest technology
− Second stage
• Red Hat Enterprise Linux
• New versions approximately every 18 – 22 months
• Supported and certified
• Stable, mature, commercially
focused technologies

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 10
What's new in Version 5?

• Enterprise Linux Advanced Platform


• Integrated virtualization
• Industry leading performance and price/performance
• Enhanced and easy to use security
• Improved networking and interoperability
• Enhanced development tools
• New SLAs
• Enhanced client

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 11
Red Hat Enterprise Linux Overview
2005 2006 2007 2008 2009 2010
RHEL 2.1

RHEL 3
... U7 U8 U9

RHEL 4
U3 U4 4.5 4.6 4.7 4.8

RHEL 5
RHEL 4.5 released May 2nd
5.1 5.2
Lengthened release cycle to avoid schedule overlap.
Support of RHEL4 para-virt guests on RHEL5.  RHEL 5 released March 2007
Extended full support phase of approx. 3 years  Virtualization and Advanced Platform
RHEL 4.6 in November. intergation
 Final bug-fix-only release, similar to 3.9 in August  Selinux enhancements
'08. New cluster management infrastructure
GFS2 , Statless Linux technology preview
 RHEL 3 in transition from Full Support to Maintenance
mode.
 RHEL 6 no schedule yet for next major release
 Final bug-fix-only update 9
Planning driven by customers, partners and
 Improved para-virtualized drivers planned.
technology
 Fedora 7 released and Fedora 8 in planning

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 12
RHEL Virtualization Roadmap
2007 2008 2009 2010
RHEL 5
5.1 5.2

RHEL 5.2
 Large System Support
 NUMA
 Memory
RHEL 5.1  Nested Page Table
RHEL 5.0 GA
 Core Virtualization.  HVM Improvements support planned.
 Para-Virt RHEL on  Performance  Path for CIM support
RHEL,  (Hot-) Migration on top of libvirt.
 32/32, 64/64 bit,  32 on 64 bit para-  Virtual Desktop
x86 virtualized.
& x86_64  Dom0 KDump
 Libvirt  IA64 Support
 Libvirt enhancement Post-RHEL 5.1
management  Para-VIrtualized
 RHEL 5 guests  Security
 RHEL 4 guests with drivers for HVM RHEL 3,
later 4.
4.5+  Para-Virtualized
drivers for Windows.

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 13
Red Hat Enterprise Linux 5: Product summary
• Servers:
− Red Hat Enterprise Linux Advanced Platform for mainstream
customers
• Unlimited server size and virtualization capabilities
• Maximum flexibility and value
− Red Hat Enterprise Linux available for
small environments

• Clients:
− Red Hat Enterprise Linux Desktop
− Workstation and Multi-OS
options for special environments
− High volume security and manageability

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 14
Red Hat Enterprise Linux 5 Advanced Platform
• Extends the base product to provide a complete solution for
virtualized environments
− The ideal solution for the mainstream customers
• Advanced Platform provides
− Integrated server and storage capabilities
− Unlimited guest operating systems
− Guest migration with consistent storage
− Application migration*
− Cluster Logical Volume Management &
Global File System*
− Seamless expansion across multiple systems
− Enhanced management capabilities
− Easy transition for Red Hat Enterprise Linux AS customers
• Provides significantly greater capabilities
* Previously offered as separate layered products:
Red Hat Global File System and Red Hat Cluster Suite
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 15
Red Hat virtualization architecture
• Physical computing and storage components provide a central pool
of resources
• Virtual systems with appropriate compute, memory, and data can
be dynamically allocated, provisioned, and managed

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 16
Development Approach
• Requirements: Stability, reliability, effectiveness
• Release focus is on foundational elements
− Innovation rate is high in virtualization technologies
− Stable platform with stable APIs for easy enhancement

• Support for x86, x86_64, UP and SMP at GA


− Support for IA64, PPC tech preview in RHEL5 GA

• Focus is on foundational elements


− Priority is to deliver hooks, APIs to enable continued development of rich management &
monitoring tools
• At a minimum, will include:
− libvirt – local Virtual Machine (VM) management API
• create, destroy, start, stop, suspend, resume
• basic support for hot and cold migration
− iSCSI, GFS2 (tech preview in RHEL5 GA), NFS containers
− Virtual block, network
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 17
libvirt: Stable and Open API

Management of hypervisor(s)

Hypervisor agnostic

Stable API for application developers

Isolation from Xen HV instability

Isolation from XenD protocol changes

Formalized error reporting/handling

XML definitions for Vms

Distributed in FC4/FC5/FC6/F7/RHEL5/Debian/OpenSolaris

Core API in C, Python/Perl bindings

CLI access via virsh

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 18
Database
Appliances

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 19
High Level Xen Architecture

Domain 1 Domain 2
Domain 0
Front end Front end

Back End

Device Driver Virtual CPU &


Memory

Hypervisor

Hardware

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 20
MySQL Database Appliances
• Virtual Appliances
− One or more virtual machines packaged and tailored for distribution
and deployment
− Pre-defined function and packaging
− Pre-configured and optimized for specific use case
• MySQL and OS configuration/tuning
• Benefits of appliances
− Ease of Installation, configuration and deployment
− Tested as a whole by vendor/supplier
− Can be easily replicated
− Long term storage and archival
− Hardware agnostic and independence
− Application isolation (performance, security)
− Dynamic workload management
− Ability to move workloads online throughout the environment

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 21
MySQL Database Appliances
• Dynamic Management of Virtual Appliances
− Integrated Virtualization will allow use of live migration and/or failover to
relocate/move appliances throughout the infrastructure
− Live migration automatically used by underlying clustering framework
− Can trigger relocation/movement via scripts/API
− Dynamic (re)allocation of resources based on workload needs
• Hot-add of virtual CPUs
• Resizing of memory footprint
• Add I/O and network capacity on demand
• “Dixie Cup” model for deployments
• Automated provisioning based on profiles
− Fast recreation of VMs for DR/DT
− Quick (re)provisioning of new/additional appliances
• Agnostic to underlying hardware infrastructure (storage, server, network)
− Can move between different hardware vendors and processors

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 22
Virtual SMP combined with
sub-CPU granularity
All available in one offering on RHEL5
Virtual machine scalability and Higher resource utilization

VMn == domUn
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 23
Memory ballooning
 Guest can be configured to balloon/grow their current memory
footprint
 Allows for online expansion and growth
 Can use virt-manager or CLI interface for management

VMn == domUn
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 24
Memory ballooning
 Growing guest VM2 to 1GB using memory ballooning
 Now both guests have increased their available memory online
 Resize database SGA
 Increase available VM for applications etc...

VMn == domUn
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 25
I/O virtualization

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 26
Dynamic I/O Sharing

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 27
Dynamic Network I/O Sharing

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 28
High
Availability

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 29
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage

Gues
t Guest running as a RHCS service
Guest 1 Guest X

Guest 2

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 30
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage

Gues
t Guest running as a RHCS service
Guest 1 Guest X

Guest 2 Automatic failover upon Hypervisor failure

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 31
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage

Gues
App

t Guests running as independent cluster


Guest 1 Guest X
Guest 2

Hypervisor clustered via RHCS

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 32
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage

App
Guests running as independent cluster
Guest 1 Guest X
Guest 2

Hypervisor clustered via RHCS


Application failover upon hosts/guest failure
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 33
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage

Gues App

t Guests running as independent cluster


Guest 1 Guest X
Guest 2

Hypervisor clustered via RHCS


Application failover upon hosts/guest failure
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 34
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5

Host A Host B
Shared
Storage

App
Guests running as independent cluster

Guest 1 Guest 2 Guest X

RHEL5
Guest X
Host C

Hypervisor and bare metal host clustered via RHCS


RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 35
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5

Host A Host B
Shared
Storage

Guests running as independent cluster

Guest 1 Guest 2 MySQL can migrate to another Guest/VM Guest X

RHEL5
Guest X
Host C

Hypervisor and bare metal host clustered via RHCS


RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 36
Highly Available RHEL5 Host and MySQL
instance
RHEL5 RHEL5
Host A Host B
Shared
Storage

Guests running as independent cluster

Guest 1 Guest 2 Guest X

RHEL5
Guest X
Host C

MySQL can migrate to a bare metal system


Hypervisor and bare metal host clustered via RHCS
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 37
RHEL5 Disaster Recovery
RHEL5 RHEL5
Site A Site B

Shared
Storage

Guest 1 Guest X
Guest Guest
Image Image
Guest 2
Guest Guest
Image Image

Guest Guest
Image XP/CA, EVA/CA Image

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 38
RHEL5 Disaster Recovery
RHEL5 RHEL5
Site A Site B

Shared
Storage

Guest 1 Guest X
Guest Guest
Image Image
Guest 2
Guest Guest
Image Image

Guest Guest
Image Image

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 39
RHEL5 Disaster Recovery
RHEL5 RHEL5
Site A Site B

Shared
Storage

Guest X

Guest Guest 1
Image

Guest 2
Guest
Image

Guest
XP/CA, EVA/CA Image

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 40
Solving real business problems
Live Migration

 Virtual Machine relocation enables


 High Availability:
machine maintenance
 Load Balancing:
statistical multiplexing gain

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 41
Consider the possibilities...

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 42
Resources
• MySQL
− http://www.mysql.com/
• Red Hat
− http://www.redhat.com/
• Virtualization Infocenter
− http://www.openvirtualization.com/
• libvirt
− http://www.libvirt.org/
• virt-Manager
− http://virt-manager.et.redhat.com/
• Red Hat Cluster Suite
− http://www.redhat.com/solutions/gfs/
• Red Hat Emerging Technology Group
− http://et.redhat.com/
RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 43
Questions?

Thanks
Jan Mark Holzer
jmh@redhat.com

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 44
Advanced Platform benefits
• Designed for mainstream customers who seek the advantages of
virtualization without complexity or risk
• Provides a full virtualization infrastructure in one complete package
• Eliminates the need to create a solution using multiple products
from different vendors
• Reduced solution cost
• Reduced deployment time
• Integrated installation and
management
• Extensive documentation
• Training services
• Installation and maintenance services

RHEL5 & MySQL Database Appliances / August 15th 2007
Product features subject to change prior to availability 45

You might also like