SPARC: Oracle Solaris Cluster Data

Service for Oracle VM Server for SPARC

Guide

Part No: E56924

October 2015
Part No: E56924
Copyright 2008, 2015, Oracle and/or its affiliates. All rights reserved.
This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except
as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform,
publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is
prohibited.
The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.
If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable:
U.S. GOVERNMENT END USERS. Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered
to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As
such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or
documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.
This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous
applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all
appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this
software or hardware in dangerous applications.
Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.
Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of
SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered
trademark of The Open Group.
This software or hardware and documentation may provide access to or information about content, products, and services from third parties. Oracle Corporation and its affiliates are
not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services unless otherwise set forth in an applicable agreement
between you and Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content,
products, or services, except as set forth in an applicable agreement between you and Oracle.
Documentation Accessibility

For information about Oracle's commitment to accessibility, visit the Oracle Accessibility Program website at http://www.oracle.com/pls/topic/lookup?ctx=acc&id=docacc.
Access to Oracle Support

Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?
ctx=acc&id=info or visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.
Rfrence: E56924
Copyright 2008, 2015, Oracle et/ou ses affilis. Tous droits rservs.
Ce logiciel et la documentation qui laccompagne sont protgs par les lois sur la proprit intellectuelle. Ils sont concds sous licence et soumis des restrictions dutilisation et
de divulgation. Sauf stipulation expresse de votre contrat de licence ou de la loi, vous ne pouvez pas copier, reproduire, traduire, diffuser, modifier, breveter, transmettre, distribuer,
exposer, excuter, publier ou afficher le logiciel, mme partiellement, sous quelque forme et par quelque procd que ce soit. Par ailleurs, il est interdit de procder toute ingnierie
inverse du logiciel, de le dsassembler ou de le dcompiler, except des fins dinteroprabilit avec des logiciels tiers ou tel que prescrit par la loi.
Les informations fournies dans ce document sont susceptibles de modification sans pravis. Par ailleurs, Oracle Corporation ne garantit pas quelles soient exemptes derreurs et vous
invite, le cas chant, lui en faire part par crit.
Si ce logiciel, ou la documentation qui laccompagne, est concd sous licence au Gouvernement des Etats-Unis, ou toute entit qui dlivre la licence de ce logiciel ou lutilise pour
le compte du Gouvernement des Etats-Unis, la notice suivante sapplique:
U.S. GOVERNMENT END USERS. Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered
to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As
such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or
documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.
Ce logiciel ou matriel a t dvelopp pour un usage gnral dans le cadre dapplications de gestion des informations. Ce logiciel ou matriel nest pas conu ni nest destin
tre utilis dans des applications risque, notamment dans des applications pouvant causer des dommages corporels. Si vous utilisez ce logiciel ou matriel dans le cadre d
applications dangereuses, il est de votre responsabilit de prendre toutes les mesures de secours, de sauvegarde, de redondance et autres mesures ncessaires son utilisation dans des
conditions optimales de scurit. Oracle Corporation et ses affilis dclinent toute responsabilit quant aux dommages causs par lutilisation de ce logiciel ou matriel pour ce type
dapplications.
Oracle et Java sont des marques dposes dOracle Corporation et/ou de ses affilis. Tout autre nom mentionn peut correspondre des marques appartenant dautres propritaires
quOracle.
Intel et Intel Xeon sont des marques ou des marques dposes dIntel Corporation. Toutes les marques SPARC sont utilises sous licence et sont des marques ou des marques
dposes de SPARC International, Inc. AMD, Opteron, le logo AMD et le logo AMD Opteron sont des marques ou des marques dposes dAdvanced Micro Devices. UNIX est une
marque dpose dThe Open Group.
Ce logiciel ou matriel et la documentation qui laccompagne peuvent fournir des informations ou des liens donnant accs des contenus, des produits et des services manant de
tiers. Oracle Corporation et ses affilis dclinent toute responsabilit ou garantie expresse quant aux contenus, produits ou services manant de tiers, sauf mention contraire stipule
dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affilis ne sauraient tre tenus pour responsables des pertes subies, des cots occasionns ou des
dommages causs par laccs des contenus, produits ou services tiers, ou leur utilisation, sauf mention contraire stipule dans un contrat entre vous et Oracle.
Accessibilit de la documentation

Pour plus dinformations sur lengagement dOracle pour laccessibilit la documentation, visitez le site Web Oracle Accessibility Program, ladresse http://www.oracle.com/
pls/topic/lookup?ctx=acc&id=docacc.
Accs au support lectronique

Les clients Oracle qui ont souscrit un contrat de support ont accs au support lectronique via My Oracle Support. Pour plus dinformations, visitez le site http://www.oracle.com/
pls/topic/lookup?ctx=acc&id=info ou le site http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs si vous tes malentendant.
Contents

Using This Documentation................................................................................. 9

1 SPARC: Installing and Configuring HA for Oracle VM Server........................11

SPARC: Installing and Configuring HA for Oracle VM Server.............................. 11
SPARC: HA for Oracle VM Server Overview.................................................... 12
SPARC: Planning the HA for Oracle VM Server Installation and Configuration......... 13
Configuration Guidelines........................................................................ 13
SPARC: How to Configure Oracle VM Server for SPARC to Reset for
Control Domain Failures........................................................................ 14
SPARC: Installing and Configuring Oracle VM Server for SPARC......................... 15
SPARC: How to Install the Oracle VM Server for SPARC Software........... 15
SPARC: How to Enable the Oracle VM Server for SPARC Instances to Run
in a Cluster.......................................................................................... 15
Installing the HA for Oracle VM Server Package................................................ 16
How to Install the HA for Oracle VM Server Package............................. 16
SPARC: Registering and Configuring HA for Oracle VM Server............................ 17
SPARC: How to Configure HA for Oracle VM Server............................ 17
SPARC: How to Remove an HA for Oracle VM Server Resource From a
Failover Resource Group........................................................................ 20
SPARC: Verifying the Installation and Configuration of Oracle VM Server for
SPARC........................................................................................................ 20
SPARC: How to Verify the HA for Oracle VM Server Installation and
Configuration........................................................................................20
SPARC: Tuning the HA for Oracle VM Server Fault Monitor................................ 21
Resource Properties............................................................................... 21
Probing Algorithm and Functionality........................................................ 21
Operations of the Oracle VM Server for SPARC Probe................................ 22
SPARC: Debugging HA for Oracle VM Server...................................................23
SPARC: How to Activate Debugging for HA for Oracle VM Server........... 23

Index..................................................................................................................25

5
6 Oracle Solaris Cluster Data Service for Oracle VM Server for SPARC Guide October 2015
Tables

TABLE 1-1 Tasks for Installing and Configuring HA for Oracle VM Server................ 12

7
8 Oracle Solaris Cluster Data Service for Oracle VM Server for SPARC Guide October 2015
 Using This Documentation

Overview Introduces the Oracle Solaris Cluster HA for Oracle VM Server for SPARC
software.
Audience Experienced system administrators with extensive knowledge of Oracle
software and hardware.
Required knowledge Knowledge of the Oracle Solaris operating system, of Oracle
Solaris Cluster software, and expertise with the volume manager software that is used with
Oracle Solaris Cluster software.

This document is not to be used as a planning or presales guide.

Product Documentation Library

Documentation and resources for this product and related products are available at http://www.
oracle.com/pls/topic/lookup?ctx=E56676.

Feedback
Provide feedback about this documentation at http://www.oracle.com/goto/docfeedback.

Using This Documentation 9

10 Oracle Solaris Cluster Data Service for Oracle VM Server for SPARC Guide October 2015
 1
C H A P T E R 1

SPARC: Installing and Configuring HA for

Oracle VM Server

This chapter explains how to install and configure Oracle Solaris Cluster HA for Oracle VM
Server for SPARC (HA for Oracle VM Server) software and contains the following sections:

Installing and Configuring HA for Oracle VM Server on page 11

HA for Oracle VM Server Overview on page 12
Planning the HA for Oracle VM Server Installation and Configuration on page 13
Installing and Configuring Oracle VM Server for SPARC on page 15
Installing the HA for Oracle VM Server Package on page 16
Registering and Configuring HA for Oracle VM Server on page 17
Verifying the Installation and Configuration of Oracle VM Server for
SPARC on page 20
Tuning the HA for Oracle VM Server Fault Monitor on page 21
Debugging HA for Oracle VM Server on page 23

Note - You can also use the Oracle Solaris Cluster Manager browser interface to configure this
data service. In the Tasks panel of Oracle Solaris Cluster Manager, click Oracle VM Server
for SPARC to start the configuration wizard. For log-in instructions, see Chapter 13, Using
the Oracle Solaris Cluster Manager Browser Interface, in Oracle Solaris Cluster 4.3 System
Administration Guide .

This wizard requires that all cluster nodes have the same root password.

SPARC: Installing and Configuring HA for Oracle VM Server

The following table summarizes the tasks for installing and configuring HA for Oracle VM
Server and provides cross-references to detailed instructions for performing these tasks.
Perform the tasks in the order that they are listed in the table.

Chapter1 Installing and Configuring HA for Oracle VM Server 11

HA for Oracle VM Server Overview

TABLE 1-1 Tasks for Installing and Configuring HA for Oracle VM Server

Task
Plan the installation.
Install and configure the Oracle VM Server
for SPARC software.
Install HA for Oracle VM Server packages.
Register and configure HA for Oracle VM
Server resources.
Verify the HA for Oracle VM Server
installation and configuration.
Tune the HA for Oracle VM Server fault
monitor.
Debug HA for Oracle VM Server.
Instructions
Planning the HA for Oracle VM Server Installation and
Configuration on page 13
Installing and Configuring Oracle VM Server for
SPARC on page 15
Installing the HA for Oracle VM Server Package on page 16
Registering and Configuring HA for Oracle VM
Server on page 17
Verifying the Installation and Configuration of Oracle VM Server
for SPARC on page 20
Tuning the HA for Oracle VM Server Fault
Monitor on page 21
Debugging HA for Oracle VM Server on page 23

SPARC: HA for Oracle VM Server Overview

The Oracle Solaris Cluster HA for Oracle VM Server for SPARC (HA for Oracle VM Server)
data service provides the ability to split a single physical system into multiple, independent
virtual systems. This is archived by an additional software application in the firmware layer,
interposed between the operating system and the hardware platform called the hypervisor. It
abstracts the hardware and can expose or hide various resources, allowing for the creation of
resource partitions that can operate as discrete systems, complete with virtual CPU, memory,
and I/O devices.

You create the logical domain on any one of the nodes of the cluster. However the services
configuration must be identical on all the potential primary nodes. The domain configuration
is retrieved by the ldm list-constraints -x ldom command and stored in the CCR. This
globally accessible information is used by the HA for Oracle VM Server agent to create or
destroy the domain on the node where the resource group is brought online or offline.

HA for Oracle VM Server provides a mechanism for orderly startup and shutdown, fault
monitoring, and automatic failover of the Oracle VM Server for SPARC logical domain service.
The Oracle VM Server for SPARC component is protected by the HA for Oracle VM Server
data service.

Note the following points regarding support for the SR-IOV device in the HA for Oracle VM
Server data service:

An SR-IOV device is not supported for live migration of the HA for Oracle VM Server data
service. This restriction exists as of initial release of the Oracle Solaris Cluster 4.2 software.
Contact your Oracle support representative to learn whether support for the SR-IOV feature
becomes available.

12 Oracle Solaris Cluster Data Service for Oracle VM Server for SPARC Guide October 2015
 Planning the HA for Oracle VM Server Installation and Configuration

An SR-IOV device is supported for normal migration of the HA for Oracle VM Server
data service. This support requires that the SR-IOV device path is identical on all potential
primaries of the data service's resource group.

SPARC: Planning the HA for Oracle VM Server Installation

and Configuration

This section contains the information you need to plan your HA for Oracle VM Server
installation and configuration.

Configuration Guidelines

Observe the following configuration guidelines that apply only to HA for Oracle VM Server.

For restrictions that apply to all data services, see the Oracle Solaris Cluster 4.3 Release Notes .

HA for Oracle VM Server configuration Oracle VM Server for SPARC can be

configured only as a failover data service and not as a scalable data service. It can be
configured only in the global zone.
HA for Oracle VM Server virtual disks The Oracle VM Server for SPARC virtual disk
back end can be of any storage or file system that is supported by Oracle Solaris Cluster
software. This includes cluster file systems, NFS, iSCSI, and SAN LUNs. The back end is
exported through the virtual disk server of the control domain to a domain as a full disk and
is visible to the Oracle Solaris installation software inside the logical domain. Virtual disks
from non-control domains are not supported.
Live migration and warm migration HA for Oracle VM Server software supports
Oracle VM Server for SPARC live migration and warm migration. For more information,
see your Oracle VM Server for SPARC documentation.
In some cases where the cluster cannot determine the target node to which the HA
for Oracle VM Server resource group is migrating, it uses an ordinary resource group
switchover instead of using live migration. In such cases, the logical domain shuts down
on its current node and then boots on its new node. To achieve live migration, relocate
the HA for Oracle VM Server resource group by using the clresourcegroup switch
command explicitly on the resource group, rather than depending on node evacuation or
strong resource group affinities to move the resource group.
Live migration is supported only for cluster file systems (UFS or raw disk), NFS, iSCSI,
or SAN LUNs, as live migration requires that storage is accessible to all potential primary
nodes simultaneously.

Chapter1 Installing and Configuring HA for Oracle VM Server 13

How to Configure Oracle VM Server for SPARC to Reset for Control Domain Failures

SPARC: How to Configure Oracle VM Server for

SPARC to Reset for Control Domain Failures

The failure policy settings on the primary domain determine the action to be taken on the
logical domain when there is a primary domain failures. When configured to failure-
policy=reset, the logical domain would panic when the primary domain fails. If the failure
policy is not set to reset on all the primary domains, the resource creation would fail. You
must set the master-slave domain dependency and auto-boot? variable to appropriate values.
Perform the following steps on the node where the ldg0 logical domain is created:

1. Set the domain failure policy to reset.

# ldm set-domain failure-policy=reset primary

# ldm list -o domain primary
NAME STATE FLAGS UTIL
primary active -n-cv- 0.6%

SOFTSTATE
Solaris running

HOSTID
0x84d4a2ce

CONTROL
failure-policy=reset

DEPENDENCY
master=

2. Configure the master-slave domain dependency.

# ldm set-domain master=primary ldg0

3. Set the auto-boot? variable to false.

# ldm set-var auto-boot?=false ldg0

# ldm list -o domain ldg0
NAME STATE FLAGS UTIL
ldg0 active n--- 0.1%

SOFTSTATE
Solaris running

HOSTID
0x84f8a040

CONTROL
failure-policy=reset

14 Oracle Solaris Cluster Data Service for Oracle VM Server for SPARC Guide October 2015
 Installing and Configuring Oracle VM Server for SPARC

DEPENDENCY
master=primary

VARIABLES
auto-boot?=false
boot-device=vdisk1
keyboard-layout=US-English

SPARC: Installing and Configuring Oracle VM Server for

SPARC

This section contains the procedures you need to install and configure an Oracle VM Server for
SPARC logical domain.

SPARC: How to Install the Oracle VM Server for

SPARC Software
1. On a cluster member, assume the root role or assume a role that provides
solaris.cluster.modify authorization.

2. Go to http://www.oracle.com/technetwork/server-storage/vm/downloads/index.html?
ssSourceSiteId=ocomen.
Follow instructions to download and install Oracle VM Server for SPARC software.

SPARC: How to Enable the Oracle VM Server for

SPARC Instances to Run in a Cluster
1. Become superuser or assume a role that provides solaris.cluster.admin
authorization on one of the nodes in the cluster that will host the Oracle VM
Server for SPARC logical domain.

2. Register the SUNW.HAStoragePlus resource type.

# clresourcetype register SUNW.HAStoragePlus

3. Create a failover resource group.

# clresourcegroup create LDom-failover-rg

Chapter1 Installing and Configuring HA for Oracle VM Server 15

Installing the HA for Oracle VM Server Package

4. (If using a cluster file system or a highly available local file system) Create an
HAStoragePlus resource for the logical domain Virtual Disk Storage.
# clresource create -g LDom-failover-rg \
-t SUNW.HAStoragePlus \
-p FileSystemMountPoints=LDom-mount-points \
LDom-has-resource

5. Enable the failover resource group that now includes the logical domain disk
storage resources.
# clresourcegroup online -M -n current-node LDom-failover-rg

Installing the HA for Oracle VM Server Package

If you did not install the HA for Oracle VM Server package during your initial Oracle Solaris
Cluster installation, perform this procedure to install the package.

How to Install the HA for Oracle VM Server

Package
Perform this procedure on each cluster node where you want the HA for Oracle VM Server
software to run.

1. On the cluster node where you are installing the data service package, assume
the root role.

2. Ensure that the data service package is available from the configured publisher
and that the solaris and ha-cluster publishers are valid.
# pkg list -a ha-cluster/data-service/ha-ldom
# pkg publisher
PUBLISHER TYPE STATUS P LOCATION
solaris origin online F solaris-repository
ha-cluster origin online F ha-cluster-repository

For information about setting the solaris publisher, see Adding, Modifying, or Removing
Package Publishers in Adding and Updating Software in Oracle Solaris 11.3.

Tip - Use the -nv options whenever you install or update to see what changes will be made, such
as which versions of which packages will be installed or updated and whether a new BE will be
created.

16 Oracle Solaris Cluster Data Service for Oracle VM Server for SPARC Guide October 2015
 Registering and Configuring HA for Oracle VM Server

If you do not get any error messages when you use the -nv options, run the command again
without the -n option to actually perform the installation or update. If you do get error
messages, run the command again with more -v options (for example, -nvv) or more of the
package FMRI pattern to get more information to help you diagnose and fix the problem. For
troubleshooting information, see Appendix A, Troubleshooting Package Installation and
Update, in Adding and Updating Software in Oracle Solaris 11.3.

3. Install the HA for Oracle VM Server software package.

# pkg install ha-cluster/data-service/ha-ldom

4. Verify that the package installed successfully.

$ pkg info ha-cluster/data-service/ha-ldom

Installation is successful if output shows that State is Installed.

5. Perform any necessary updates to the Oracle Solaris Cluster software.

For instructions on updating your software, see Chapter 11, Updating Your Software, in
Oracle Solaris Cluster 4.3 System Administration Guide .

SPARC: Registering and Configuring HA for Oracle VM

Server

SPARC: How to Configure HA for Oracle VM

Server
Before You Begin Install the data service packages during your initial Oracle Solaris Cluster installation.

If you did not install the HA for Oracle VM Server packages as part of your initial
Oracle Solaris Cluster installation, go to Installing the HA for Oracle VM Server
Package on page 16.

1. Assume the root role or a role that provides solaris.cluster.modify and solaris.
cluster.admin authorization on the node in the cluster that hosts the Oracle VM
Server for SPARC logical domain.

2. Register the SUNW.ldom resource type.

# clresourcetype register SUNW.ldom

Chapter1 Installing and Configuring HA for Oracle VM Server 17

How to Configure HA for Oracle VM Server

3. (Optional) If you plan to use live migration, configure the password.

For the resource type version 6 or later, create a private string named
resourcegroup_resource_ldompasswd to store the target host password that is
required for guest domain migration.
Type the following command on any one node in the cluster:

# /usr/cluster/bin/clpstring create b resource-name \

-t resource resourcegroup_resource_ldompasswd
Enter string value:
Enter string value again:

where resourcegroup and resource are the resource group and resource name for the SUNW.
ldom resource that is created.

For resource type version 5 or earlier, the Password_file property is required

during resource creation. Create a password file owned by root with read
only permission to store the target host password required for guest domain
migration.
Type the following command on each of the Oracle Solaris Cluster nodes that would host
the logical domain resource:

# echo password > /var/cluster/.ldg1_passwd

# /usr/bin/chown root:root /var/cluster/.ldg1_passwd
# /usr/bin/chmod 400 /var/cluster/.ldg1_passwwd

where /var/cluster/.ldg1_passwd is the password file for guest domain ldg1. password
is the target node root password used for live migration.

4. Create an Oracle VM Server for SPARC logical domain resource in the failover
resource group.

If you are not using live migration, set Migration_type=NORMAL during resource
creation and do not specify the Password_file property.

# clresource create -g ldg1-rg \

-t SUNW.ldom \
-p Domain_name=ldg1 \
-p Miration_type=NORMAL \
-p Resource_dependencies_offline_restart=ldg1-hasp-rs \
ldg1

If you are using live migration, set Migration_type=MIGRATE during resource

creation and specify Password_file for resource type version 5 or earlier.

Note - The Password_file property is obsolete for resource type version 6 or later.

18 Oracle Solaris Cluster Data Service for Oracle VM Server for SPARC Guide October 2015
 How to Configure HA for Oracle VM Server

For resource type version 5 or earlier, type the following command:

# clresource create -g ldg1-rg \

-t SUNW.ldom \
-p Domain_name=ldg1 \
-p Miration_type=MIGRATE \
-p Password_file=/var/cluster/.ldg1_passwd \
-p Resource_dependencies_offline_restart=ldg1-hasp-rs \
ldg1

For resource type version 6 or later, type the following command:

# clresource create -g ldg1-rg \

-t SUNW.ldom \
-p Domain_name=ldg1 \
-p Miration_type=MIGRATE \
-p Resource_dependencies_offline_restart=ldg1-hasp-rs \
ldg1

5. For resource type version 5 or earlier, if an encrypted password is required for

the logical domain migration, you must do the following:

a. Insert the word encrypted into the file you specify with the Password_file
extension property when creating the resource.

# echo "encrypted" > /var/cluster/.ldg1_passwd

b. Assume the root role and create an encrypted password.

In the following example, the root password for the primary domain, password, is being
encrypted and ldg1 reflects the logical domain name.

node1# dd if=/dev/urandom of=/var/cluster/ldom_key bs=16 count=1

node1# chmod 400 /var/cluster/ldom_key
node1# echo password | /usr/sfw/bin/openssl enc -aes128 -e \
-pass file:/var/cluster/ldom_key -out /opt/SUNWscxvm/.ldg1_passwd
node1# chmod 400 /opt/SUNWscxvm/.ldg1_passwd

c. Verify that the encrypted password can be decrypted.

node1# /usr/sfw/bin/openssl enc -aes128 -d -pass file:/var/cluster/ldom_key \

-in /opt/SUNWscxvm/.ldg1_passwd

d. Repeat the preceding steps on all Oracle Solaris Cluster nodes that host the
logical domain service.

e. Create or update the resource and set the Password_file property to the path
provided in Step a.

Chapter1 Installing and Configuring HA for Oracle VM Server 19

How to Remove an HA for Oracle VM Server Resource From a Failover Resource Group

Note - You can perform this step only when the resource is disabled.

# clresource set -p Password_file=/var/cluster/.ldg1_passwd LDom-guest-domain-

resource

6. Enable each logical domain resource.

Repeat this step for each logical domain instance, if multiple instances were created.

# clresource status
# clresource enable logical-guest-domain-resource

SPARC: How to Remove an HA for Oracle VM

Server Resource From a Failover Resource Group
1. Assume the root role or assume a role that provides solaris.cluster.modify and
solaris.cluster.admin RBAC authorizations.

2. Disable and remove the resource that is used by the HA for Oracle VM Server
data service.
# clresource disable resource
# clresource delete resource

SPARC: Verifying the Installation and Configuration of

Oracle VM Server for SPARC

SPARC: How to Verify the HA for Oracle VM Server

Installation and Configuration
1. As the root role, log in to the node that currently hosts the resource group that
contains the Oracle VM Server for SPARC logical domain resource.

2. Switch the logical domain resource group to another cluster member.

# clresourcegroup switch -n node logical-domain

3. Verify the status of the logical domain instance.

20 Oracle Solaris Cluster Data Service for Oracle VM Server for SPARC Guide October 2015
 Tuning the HA for Oracle VM Server Fault Monitor

# ldm list-domain logical-domain

NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
ldg active n--- 5000 4 2G 25% 2s

4. Repeat the preceding steps until you have tested all the potential nodes on
which the logical domain can run.

SPARC: Tuning the HA for Oracle VM Server Fault Monitor

This section describes the HA for Oracle VM Server fault monitor's probing algorithm or
functionality, and states the conditions, messages, and recovery actions associated with
unsuccessful probing.

Note - For any maintenance or modification activities on the domain, you must disable
monitoring, perform maintenance tasks, and then re-enable the resource monitor.

For conceptual information about fault monitors, see the Oracle Solaris Cluster 4.3 Concepts
Guide .

Resource Properties

The HA for Oracle VM Server logical domain fault monitor uses the resource properties
specified in the resource type SUNW.ldom. Refer to the SUNW.ldom(5) man page for a complete
list of resource properties used.

Probing Algorithm and Functionality

HA for Oracle VM Server is controlled by the extension properties that control the probing
frequency. The default values of these properties determine the preset behavior of the fault
monitor and are suitable for most Oracle Solaris Cluster installations. You can modify this
preset behavior by performing the following actions:
Setting the interval between fault monitor probes (Thorough_probe_interval)
Setting the timeout for fault monitor probes (Probe_timeout)
Setting the number of times the fault monitor attempts to restart the resource (Retry_count)

The HA for Oracle VM Server fault monitor checks the domain status within an infinite loop.
During each cycle, the fault monitor checks the domain state and reports either a failure or
success.

Chapter1 Installing and Configuring HA for Oracle VM Server 21

Tuning the HA for Oracle VM Server Fault Monitor

If the fault monitor is successful, it returns to its infinite loop and continues the next cycle of
probing and sleeping.

If the fault monitor reports a failure, a request is made to the cluster to restart the resource. If
the fault monitor reports another failure, another request is made to the cluster to restart the
resource. This behavior continues whenever the fault monitor reports a failure. If successive
restarts exceed the Retry_count within the Thorough_probe_interval, a request is made to fail
over the resource group onto a different node.

Operations of the Oracle VM Server for SPARC

Probe

The probe checks the domain state every 60 seconds by using the ldm list-domain
command.
The ldm list-domain command produces a status line for the domain and is accurate at the
instant that the command executes.
The status modes that are considered to be normal operational modes are as follows: active,
suspending, resuming, suspended, and starting. Whenever the ldm command reports these
status modes, the probe considers that the domain is operating in an acceptable mode.
The status modes that are considered to be restartable modes are as follows: inactive
and stopping. These modes are not considered acceptable and if one of these modes is
encountered, the probe requests a restart of the resource.
The probe also requests a resource to restart if any unknown status modes are reported by
the ldm command.
If the logical domain configuration has changed, the probe updates this information to the
CCR in the next probe cycle. Alternatively, you can perform the following steps to update
the changed configuration to the CCR immediately:

1. Make a dummy update to the resource. For example:

# clresource set \
-p R_DESCRIPTION="Oracle Solaris Cluster HA for Oracle VM Server SPARC Guest
Domains - Modified" \
ldg1-rs
2. Verify whether the configuration change was successfully done.
From the node where the guest domain is online, type the following commands, where
ld1-rs is the logical domain resource name and ldg1 is the guest domain name:

# (/usr/cluster/lib/sc/ccradm showkey --key xml_ldg1-rs ldom_domain_config | \

xmllint --format -) > /var/tmp/ldg1_ccr.xml
# ldm list-constraints -x ldg1 > /var/tmp/ldg1_current.xml
# diff /var/tmp/ldg1_current.xml /var/tmp/ldg1_ccr.xml

22 Oracle Solaris Cluster Data Service for Oracle VM Server for SPARC Guide October 2015
 Debugging HA for Oracle VM Server

The probe runs the user-supplied script or binary provided for plugin_probe. If this
process fails, then the probe will restart the logical domain resource. The exit status of the
plugin_probe command is used to determine the severity of the failure of the application.
This exit status, called the plugin_probe status, must be an integer between 0 (for success)
and 100 (for complete failure). The plugin_probe status can also be a special value of 201
which results in immediate failover of the application unless Failover_enabled is set to
FALSE.
If the logical domain resource is repeatedly restarted and subsequently exhausts the
Retry_count within the Retry_interval, then a failover is initiated for the resource group
onto another node if Failover_enabled is set to TRUE.

SPARC: Debugging HA for Oracle VM Server

HA for Oracle VM Server has a extension property named Debug_level that enables you to
activate debugging for Oracle VM Server for SPARC logical domain resources.

SPARC: How to Activate Debugging for HA for

Oracle VM Server
1. Determine whether debugging for HA for Oracle VM Server is active.
# grep daemon /etc/syslog.conf
*.err;kern.debug;daemon.notice;mail.crit /var/adm/messages
*.alert;kern.err;daemon.err operator
#

If debugging is active, daemon.debug is set in the file /etc/syslog.conf.

If debugging is inactive, daemon.notice is set in the file /etc/syslog.conf of the appropriate
node.

2. If debugging is inactive, edit the /etc/syslog.conf file in the appropriate node to

change daemon.notice to daemon.debug.

3. Confirm that debugging for HA for Oracle VM Server is active.

# grep daemon /etc/syslog.conf
*.err;kern.debug;daemon.debug;mail.crit /var/adm/messages
*.alert;kern.err;daemon.err operator
#

4. Restart the syslogd daemon in the global zone.

Chapter1 Installing and Configuring HA for Oracle VM Server 23

How to Activate Debugging for HA for Oracle VM Server

# svcadm refresh svc:/system/system-log:default

5. Set the property Debug_level to level 2.

# clresource set -p Debug_level=2 logical-domain-resource

For more information about the Debug_level extension property and permissible values, see the
SUNW.ldom(5) man page.

Note - To deactivate debugging, repeat these steps, changing daemon.debug to daemon.notice

and changing the Debug_level property to 0.

24 Oracle Solaris Cluster Data Service for Oracle VM Server for SPARC Guide October 2015
Index

C O
configuration restrictions,13 operations
configuring Oracle VM Server for SPARC probe,22
HA for Oracle VM Server Oracle Solaris Cluster Manager
using the Oracle Solaris Cluster Manager configuration wizard,11
wizard,11 Oracle Solaris Cluster software
publisher,16, 16
overview
HA for Oracle VM Server,12
D installation,11
debugging
HA for Oracle VM Server,23

P
package,16
F planning
functionality,21 HA for Oracle VM Server,13
probing algorithm,21
publisher
Oracle Solaris Cluster software,16, 16
H
HA for Oracle VM Server
debugging,23
installing,16 R
overview,12 registering and configuring,17
software package, installing,16 reset for control domain failures
configuration,14
resource properties,21
resources
I Oracle VM Server for SPARC application
installing debugging,23
HA for Oracle VM Server,16
Oracle VM Server for SPARC software,15

S
software installation
L Oracle VM Server for SPARC,15
live migration,13 software package,16

25
Index

T
tuning fault monitor,21

V
verifying
Oracle VM Server for SPARC configuration,20

W
warm migration,13, 18
wizard
Oracle Solaris Cluster Manager,11

26 Oracle Solaris Cluster Data Service for Oracle VM Server for SPARC Guide October 2015