THESE eKIT MATERIALS ARE FOR YOUR USE IN THIS CLASSROOM ONLY.

COPYING eKIT MATERIALS FROM THIS COMPUTER IS STRICTLY PROHIBITED

D71669
Edition 2.0
January 2011
D67016GC20
Student Guide
Administration Workshop
Exadata and Database Machine

Oracle University and Fors training&Consulting use only

THESE eKIT MATERIALS ARE FOR YOUR USE IN THIS CLASSROOM ONLY. COPYING eKIT MATERIALS FROM THIS COMPUTER IS STRICTLY PROHIBITED

Authors Copyright © 2010, Oracle and/or it affiliates. All

rights reserved.
Peter Fusek
Disclaimer
Jean-Francois Verrier
Mark Fuller This document contains proprietary information and is
protected by copyright and other intellectual property
Dave Winter laws. You may copy and print this document solely for
your own use in an Oracle training course. The
document may not be modified or altered in any way.
Technical Contributors Except where your use constitutes "fair use" under
and Reviewers copyright law, you may not use, share, download,
upload, copy, print, display, perform, reproduce, publish,
Andrew Babb Sue Lee license, post, transmit, or distribute this document in
whole or in part without the express authorization of
Bharat Baddepudi Juan Loaiza
Oracle.

Oracle University and Fors training&Consulting use only

Maria Billings Barb Lundhild
The information contained in this document is subject to
Robert Carlin Varun Malhotra change without notice. If you find any problems in the
Michael Cebulla Louis Nagode document, please report them in writing to: Oracle
University, 500 Oracle Parkway, Redwood Shores,
Nilesh Choudhury Dan Norris California 94065 USA. This document is not warranted
Christian Craft Michael Nowak to be error-free.

Ravindra Dani Sriram Palapudi Restricted Rights Notice

Aslam Edah-Tally Umesh Panchaksharaiah If this documentation is delivered to the United States
Boris Erlikhman Sugam Pandey Government or anyone using the documentation on
behalf of the United States Government, the following
Amit Ganesh Robert Pastijn notice is applicable:
Ed Gilowski Marshall Presser
U.S. GOVERNMENT RIGHTS
Joel Goodman Georg Schmidt The U.S. Government’s rights to use, modify, reproduce,
release, perform, display, or disclose these training
Scott Gossett Akshay Shah
materials are restricted by the terms of the applicable
Jim Hall Kam Shergill Oracle license agreement and/or the applicable U.S.
Government contract.
Roger Hansen Tim Shelter
James He Eric Siglin Trademark Notice

David Hitchcock Sundararaman Sridharan Oracle and Java are registered trademarks of Oracle
Bill Hodak Vijay Sridharan and/or its affiliates. Other names may be trademarks of
their respective owners.
Vimala Jacob Mahesh Subramaniam
Martin Jensen Lawrence To
Kevin Jernigan Alex Tsukerman
Caroline Johnston Kodi Umamageswaran
Larry Justice Douglas Utzig
Vikram Kapoor Harald van Breederode
Bruce Kyro Mark Van de Wiel
Sumeet Lahorani Dave Winter

Publishers
Sujatha Nagendra
Giri Venugopal
THESE eKIT MATERIALS ARE FOR YOUR USE IN THIS CLASSROOM ONLY. COPYING eKIT MATERIALS FROM THIS COMPUTER IS STRICTLY PROHIBITED

Contents

1 Introduction
Course Objectives 1-2
Audience and Prerequisites 1-3

Oracle University and Fors training&Consulting use only

Course Scope 1-4
Course Contents 1-5
Terminology 1-6
Additional Resources 1-7
Practice 1 Overview: Introducing the Laboratory Environment 1-8

2 Exadata Overview
Objectives 2-2
Traditional Enterprise Database Storage Deployment 2-3
Exadata Storage Deployment 2-4
Exadata Implementation Architecture Overview 2-6
Introducing Exadata 2-7
Exadata Hardware Details (Sun Fire X4270 M2) 2-8
Exadata Specifications 2-9
InfiniBand Network 2-10
Classic Database I/O and SQL Processing Model 2-11
Exadata Smart Scan Model 2-12
Exadata Smart Storage Capabilities 2-13
Exadata Smart Scan Scale-Out Example 2-16
Exadata Hybrid Columnar Compression 2-19
Exadata Hybrid Columnar Compression Architecture Overview 2-20
Exadata Smart Flash Cache 2-21
Exadata Storage Index 2-23
Storage Index with Partitions Example 2-25
Database File System 2-26
I/O Resource Management 2-27
Benefits Multiply 2-28
Exadata Key Benefits for Data Warehousing 2-29
Exadata Key Benefits for OLTP 2-31
Quiz 2-32
Summary 2-34

iii
THESE eKIT MATERIALS ARE FOR YOUR USE IN THIS CLASSROOM ONLY. COPYING eKIT MATERIALS FROM THIS COMPUTER IS STRICTLY PROHIBITED

Additional Resources 2-35

Practice 2 Overview: Introducing Exadata Features 2-36

3 Exadata Architecture
Objectives 3-2
Exadata Software Architecture Overview 3-3
Exadata Software Architecture Details 3-5
Exadata Smart Flash Cache Architecture 3-7
Exadata Monitoring Architecture 3-9

Oracle University and Fors training&Consulting use only

Disk Storage Entities and Relationships 3-10
Interleaved Grid Disks 3-12
Flash Storage Entities and Relationships 3-13
Disk Group Configuration 3-14
Quiz 3-15
Summary 3-17
Additional Resources 3-18
Practice 3 Overview: Introducing Exadata Cell Architecture 3-19

4 Exadata Configuration
Objectives 4-2
Exadata Installation and Configuration Overview 4-3
Initial Network Preparation 4-4
Configuration of New Exadata Servers 4-6
Answering Questions During the Initial Boot Sequence 4-7
Exadata Administrative User Accounts 4-11
Configuring a New Exadata Cell 4-12
Important I/O Metrics for Oracle Databases 4-13
Testing Performance Using CALIBRATE 4-14
Configuring the Exadata Cell Server Software 4-15
Creating Cell Disks 4-16
Creating Grid Disks 4-17
Creating Flash-Based Grid Disks 4-18
Configuring Hosts to Access Exadata Cells 4-19
Configuring ASM and Database Instances for Exadata 4-20
Configuring ASM Disk Groups for Exadata 4-21
Optional Configuration Tasks 4-22
Exadata Storage Security Overview 4-23
Exadata Storage Security Implementation 4-24
Quiz 4-26
Summary 4-29

iv
THESE eKIT MATERIALS ARE FOR YOUR USE IN THIS CLASSROOM ONLY. COPYING eKIT MATERIALS FROM THIS COMPUTER IS STRICTLY PROHIBITED

Additional Resources 4-30

Practice 4 Overview: Configuring Exadata 4-31

5 Exadata Performance Monitoring and Maintenance

Objectives 5-2
Monitoring Overview 5-3
Exadata Metrics and Alerts Architecture 5-4
Monitoring Exadata with Metrics 5-6
Monitoring Exadata with Metrics: Example 5-8

Oracle University and Fors training&Consulting use only

Monitoring Exadata with Alerts 5-9
Displaying Alert Examples 5-11
Monitoring Exadata with Active Requests 5-13
Monitoring SQL Execution Plans 5-14
Smart Scan Execution Plan Example 5-15
Predicate Offloading Considerations 5-16
Monitoring Exadata from Your Database 5-17
Monitoring Exadata with Wait Events 5-18
Monitoring Exadata with Enterprise Manager 5-19
Additional Monitoring Tools and Utilities 5-20
Cell Maintenance Overview 5-21
Automated Cell Maintenance Operations 5-23
Replacing a Damaged Physical Disk 5-24
Replacing a Damaged Flash Card 5-26
Moving All Disks from One Cell to Another 5-27
Using the Exadata Software Rescue Procedure 5-28
Quiz 5-30
Summary 5-32
Additional Resources 5-33
Practice 5 Overview: Monitoring Exadata 5-34

6 Exadata and I/O Resource Management

Objectives 6-2
I/O Resource Management Overview 6-3
I/O Resource Management Concepts 6-5
I/O Resource Management Plans 6-6
IORM Architecture 6-7
I/O Resource Management Plans Example 6-8
Enabling Intradatabase Resource Management 6-11
Intradatabase Plan Example 6-12
Enabling IORM for Multiple Databases 6-13
Interdatabase Plan Example 6-14

v
THESE eKIT MATERIALS ARE FOR YOUR USE IN THIS CLASSROOM ONLY. COPYING eKIT MATERIALS FROM THIS COMPUTER IS STRICTLY PROHIBITED

Category Plan Example 6-16

Complete Example 6-17
Using Database I/Os Metrics 6-20
Quiz 6-21
Summary 6-25
Additional Resources 6-26

7 Optimizing Database Performance with Exadata

Objectives 7-2

Oracle University and Fors training&Consulting use only

Optimizing Performance 7-3
Flash Memory Usage 7-4
Compression Usage 7-6
Index Usage 7-8
ASM Allocation Unit Size 7-9
Minimum Extent Size 7-10
Quiz 7-11
Summary 7-13
Additional Resources 7-14
Practice 7 Overview: Optimizing Database Performance with Exadata 7-15

8 Database Machine Overview and Architecture

Objectives 8-2
Introducing Database Machine 8-3
Database Machine X2-2 Full Rack 8-4
X2-2 Database Server Hardware Details (Sun Fire X4170 M2) 8-5
Start Small and Grow 8-6
Database Machine X2-8 Full Rack 8-7
X2-8 Database Server Hardware Details (Sun Fire X4800) 8-8
Database Machine Capacity 8-9
Database Machine Performance 8-10
Database Machine X2-2 Architecture 8-11
InfiniBand Network Architecture 8-13
X2-2 Leaf Switch Topology 8-14
Full Rack Spine and Leaf Topology 8-15
Scale Performance and Capacity 8-16
Scaling Out to Multiple Full Racks 8-17
Quiz 8-18
Summary 8-20

vi
THESE eKIT MATERIALS ARE FOR YOUR USE IN THIS CLASSROOM ONLY. COPYING eKIT MATERIALS FROM THIS COMPUTER IS STRICTLY PROHIBITED

9 Database Machine Configuration

Objectives 9-2
Database Machine Implementation Overview 9-3
Configuration Worksheet Overview 9-5
Getting Started 9-6
Configuration Worksheet Example 9-7
Configuring ASM Disk Groups with Configuration Worksheet 9-11
Generating the Configuration Files 9-13
Other Pre-Installation Tasks 9-14

Oracle University and Fors training&Consulting use only

The Result After Installation and Configuration 9-15
Supported Additional Configuration Activities 9-17
Unsupported Configuration Activities 9-18
Quiz 9-20
Summary 9-22
Additional Resources 9-23

10 Migrating Databases to Database Machine

Objectives 10-2
Migration Best Practices Overview 10-3
Performing Capacity Planning 10-4
Database Machine Migration Considerations 10-5
Choosing the Right Migration Path 10-6
Logical Migration Approaches 10-7
Physical Migration Approaches 10-9
Other Approaches 10-11
Post-Migration Best Practices 10-12
Quiz 10-13
Summary 10-15
Additional Resources 10-16
Practice 10 Overview: Migrating to Databases Machine using Transportable
Tablespaces 10-18

11 Bulk Data Loading with Database Machine

Objectives 11-2
Bulk Data Loading Overview 11-3
Preparing the Data Files 11-4
Staging the Data Files 11-5
Configuring the Staging Area 11-6
Configuring the Staging Area 11-7
Configuring the Target Database 11-10
Loading the Target Database 11-11

vii
THESE eKIT MATERIALS ARE FOR YOUR USE IN THIS CLASSROOM ONLY. COPYING eKIT MATERIALS FROM THIS COMPUTER IS STRICTLY PROHIBITED

Quiz 11-13
Summary 11-15
Additional Resources 11-16
Practice 11 Overview: Bulk Data Loading with Database Machine 11-17

12 Backup and Recovery with Database Machine

Objectives 12-2
Backup and Recovery Overview 12-3
Using RMAN with Database Machine 12-4

Oracle University and Fors training&Consulting use only

General Recommendations for RMAN 12-5
Disk Based Backup Strategy 12-7
Disk Based Backup Configuration 12-8
Tape Based Backup Strategy 12-10
Tape Based Backup Configuration 12-11
Hybrid Backup Strategy 12-15
Restore and Recovery Recommendations 12-16
Backup and Recovery of Database Machine Software 12-17
Quiz 12-18
Summary 12-20
Additional Resources 12-21
Practice 12 Overview: Using RMAN Optimizations for Database Machine 12-22

13 Monitoring and Maintaining Database Machine

Objectives 13-2
Monitoring Tools Overview 13-3
ILOM Overview 13-4
ILOM Example 13-6
DCLI Overview 13-7
DCLI Examples 13-8
InfiniBand Diagnostic Utilities 13-9
Database Machine Support Overview 13-11
Patching and Updating Overview 13-12
Maintaining Exadata Software 13-13
Maintaining Database Server Software 13-14
Maintaining Other Software 13-15
Quiz 13-16
Summary 13-18
Additional Resources 13-19
Practice 13 Overview: Using the distributed command line utility (dcli) 13-20

viii
THESE eKIT MATERIALS ARE FOR YOUR USE IN THIS CLASSROOM ONLY. COPYING eKIT MATERIALS FROM THIS COMPUTER IS STRICTLY PROHIBITED

A New Features in Update Release 11.2.1.3.1

Objectives A-2
New Features Overview A-3
Auto Service Request (ASR) A-4
The ASR Process A-5
ASR Requirements A-6
Oracle Linux 5.5 A-7
Enhanced Operating System Security A-8
Pro-active Disk Quarantine A-9

Oracle University and Fors training&Consulting use only

Other New Features A-10
Summary A-11

ix
THESE eKIT MATERIALS ARE FOR YOUR USE IN THIS CLASSROOM ONLY. COPYING eKIT MATERIALS FROM THIS COMPUTER IS STRICTLY PROHIBITED

Oracle University and Fors training&Consulting use only