You are on page 1of 25

Exadata for

Oracle DBAs
Why this Session?
Im an Oracle DBA
Familiar with RAC, 11gR2 and ASM
About to become a Database Machine Administrator
(DMA)
H h d I h t l ? How much do I have to learn?
How much of my own prior knowledge I can apply?
Wh t diff t i E d t ? Whats different in Exadata?
What makes it special, fast, efficient?
Do I have to go through a lot of training? Do I have to go through a lot of training?
Ar up Nanda
2
What is Exadata
Is an appliance containing
Storage
Flash Disks
Database Servers
Infiniband Switches Infiniband Switches
Ethernet Switches
KVM(some models) KVM (some models)
But is not an appliance. Why?
It contains additional software to make it a better
database machine
Thats why Oracle calls it a Database Machine (DBM)
A d DMA D b M hi Ad i i
Ar up Nanda
And DMA Database Machine Administrator
3
Anatomy of an Oracle Database
Instance
C bi ti f
SELECT NAME
FROM CUSTOMERS
Combination of
Memory Areas
Background Processes
FROM CUSTOMERS
WHERE STATUS ='ANGRY'
UPDATE
datafile1
UPDATE
CUSTOMERS
SET BONUS = 1M
WHERE STATUS ='ANGRY'
Storage
datafile1
datafile2
Ar up Nanda
4
Query Processing
JILL
SELECT NAME
FROM CUSTOMERS
JILL
FROM CUSTOMERS
WHERE STATUS ='ANGRY'
datafile1
Database Block
Storage
datafile1
datafile2
Ar up Nanda
5
RAC Database
Storage
datafile1
datafile2
Ar up Nanda
6
Storage
Components for Performance
CPU CPU
Memory
Storagehasbeenand
y
Network
Storage has been and
will continue to be the
bane of all databases.
Simplyput lessI/O
I/O Controller
Simply put, less I/O
better performance
Disk
Ar up Nanda
7
What about SAN Caches?
Success of SAN caches is built upon predictive analytics
They work well, if a small percentage of disk is accessed
t ft most often
The emphasis is on disk; not data
Most database systems Most database systems
are way bigger than caches
need to get the data to the memory to process g y p
I/O at the disk level is still high
Caches are excellent for filesystems
or very small databases
Ar up Nanda
8
What about In-Memory DBs
Memory is still more expensive
How much memory is enough?
You have a 100 MB database and 100 MB buffer cache
The whole database will fit in the memory, right?
NO! NO!
Oracle database fills up to 7x DB size buffer cache
http://arup.blogspot.com/2011/04/can-i-fit-80mb-database-completely-in.html
Ar up Nanda
9
The Solution
A typical query may:
Select 10% of the entire storage
Use only 1% of the data it gets
To gain performance, the DB needs to shed weight
It has to get less fromthe storage It has to get less from the storage
Filtering at the storage level
The storage must be cognizant of the data
CPU
The storage must be cognizant of the data
CPU
Memory
SELECT NAME
FROM CUSTOMERS
WHERE STATUS ='ANGRY'
Network
I/O Controller
Filtering
should be
Applied Here
Ar up Nanda
10
Disk
pp
The Magic #1
The
CPU
The
communication
between CPU
iDB
CPU
Memory
and Disk carries
the information
th
iDB
y
Network
on the query
columns and
predicates This
I/O Controller
predicates. This
occurs as a result
of a special
Disk
p
protocol called
iDB.
Ar up Nanda
11
Magic #2 Storage Cell Server
Cells are Sun Blades
iDB
Run Oracle Enterprise
Linux
iDB
Software called Exadata
Storage Server (ESS) g ( )
which understands iDB
Disk1 Disk2 Disk3
Ar up Nanda
12
Magic #3 Storage Indexes
Storage Indexes store in memory
of theCell Server theareason
Disk1 Disk2 Disk3
of the Cell Server the areas on
the disk and the MIN/MAX value
of the column and whether NULL
MIN=3 MIN=4 MIN=3 MIN=1
exists. They eliminate disk I/O.
SELECT
MIN 3
MAX = 5
MIN 4
MAX = 5
MIN 3
MAX = 5
MIN 1
MAX = 2
SELECT
FROM TABLE
WHERE COL1 = 1
Disk4
Storage Index
Ar up Nanda
13
Magic #4 Flash Cache
These are flash cards
presentedasdisks; not presented as disks; not
memory to the Storage Cells.
They are similar to SAN cache;
but Oracle controls what goes
on there and how long it stays.
datafile1
Storage
datafile1
datafile2
Ar up Nanda
14
Components
CPU
DatabaseNode
CPU
Memory
Database Node
(Sun Blade. OEL)
Oracle 11gR2 RAC
y
Network InfiniBandSwitch
I/O Controller
Storage Cell
Disk
Exadata Storage Server
Disks, Flash
Ar up Nanda
15
Put Together: One Full Rack
Database
Database
Database
Node1
Database
Node 1
Database
Node 8
RAC Cluster
Database
Node 1
Node 1
Node 1
InfiniBand
Switch
Network Switch
Clients
connect to
thedatabase
Cell 1
Cell 1
Cell 1 Cell 14
Switch the database
nodes.
Cell 1
Cell 1
Ar up Nanda
16
Disk Layout
Disks(hardandflash) are
Compute
Disks (hard and flash) are
connected to the cells.
Thedisksarepartitionedat the
Compute
Nodes
The disks are partitioned at the
cell
S titi t d
Storage Cell
Some partitions are presented
as filesystems
The rest are used for ASM
diskgroups
All these disks/partitions are
presented to the compute nodes
Ar up Nanda
17
Disk Presentation
e
N
o
d
e
filesystem
filesystem
l
C
e
l
l
Ar up Nanda
18
Command Components
Compute
Linux Commands vmstat, mpstat, fdisk, etc.
ASMC d SQL*Pl ASMCMD ASMCA
Compute
Nodes
ASM Commands SQL*Plus, ASMCMD, ASMCA
ClusterwareCommands CRSCTL SRVCTL etc
Database Commands startup, alter database, etc.
Storage Cell
LinuxCommands vmstat, mpstat, fdisk, etc.
ClusterwareCommands CRSCTL, SRVCTL, etc.
Linux Commands vmstat, mpstat, fdisk, etc.
CellCLI command line tool to manage the Cell
5-part Linux Commands article series
http://bit.ly/k4mKQS
4-part Exadata Command Reference article
Ar up Nanda
19
p
series http://bit.ly/lljFl0
One Cluster?
One Cluster
QA1 QA2 QA3 Prod1 Prod2 Prod3 Dev1 Int1 QA1 QA2 QA3 Prod1 Prod2 Prod3 Dev1 Int1
QA1 QA2 Prod4 Prod1 Prod2 Prod3 Dev1 Int1
QA1 QA2 QA3 Prod1 Prod2 Prod3 Dev1 Int1
Ar up Nanda
20
Dev2
Many Clusters?
QA Cluster Prod Cluster
Dev Int
QA1 QA2 QA3 Prod1 Prod2 Prod3 Dev1 Int1 QA1 QA2 QA3 Prod1 Prod2 Prod3 Dev1 Int1
QA Cluster
Prod Cluster
Dev Int
Ar up Nanda
21
Disk Failures
Datafile Datafile
block1
Cell 1 Cell 2
block1 block1
Ar up Nanda
22
Other Questions
Q: Do clients have to connect using Infiniband?
A: No; Ethernet is also available
Q: How do you back it up?
A: Normal RMAN Backup, just like an Oracle Database
Q: Howdo you create DR? Q: How do you create DR?
A: Data Guard is the only solution
Q: Can I install any other software? Q: Can I install any other software?
A: Nothing on Cells. On nodes yes
Q: How do I monitor it?
A: Enterprise Manager, CellCLI, SQL Commands
Ar up Nanda
23
Summary
Exadata is an Oracle Database running 11.2
The storage cells have added intelligence about data
l t placement
The compute nodes run Oracle DB and Grid Infra
Nodes communicate with Cells using iDB which can Nodes communicate with Cells using iDB which can
send more information on the query
Smart Scan, when possible, reduces I/O at cells even for
full table scans
Cell is controlled by CellCLI commands
DMA kill 60%RAC DBA 15%Li 20%C llCLI DMA skills = 60% RAC DBA + 15% Linux + 20% CellCLI +
5% miscellaneous
Ar up Nanda
24
Thank You! Thank You!
Arup Nanda p
Blog: Arup.Blogspot.com
Twitter: arupnanda
Ar up Nanda
Email: arup@proligence.com
25

You might also like