Professional Documents
Culture Documents
Document Change Control Who Date Comment Version Andreas Knzig 07-Sep-2010 Initial draft 0.9 Bruno Annaheim 18-Feb-2011 First released version 1.0
Table of Contents
1 INTRODUCTION .............................................................................................................................. ............1 1.1 P URPOSE ................................................................................................................................. 1.2 SCOPE ..................................................................................................................................... ...........1 ...........1 1.3 A SSUMPTIONS ............................................................................................................................ ..........1 2 PREPARATION................................................................................................................................. ............2 2.1 ONE WEEK PRIOR TO THE UPGRADE .................................................................................................. 2.2 ONE DAY PRIOR TO THE UPGRADE .................................................................................................... .......2 ........4 2.2.1 SW d ep loyment for PB and IB Switzerland only .................................................................................5 rn 2.2.2 SW d ep loyment for IB inte ational and AM on ly................................................................................5 SERVERS ONLY ................................................. 2.3 P REPARATION STEPS FOR THE UPGRADE OF NBU M ASTER ...6 2.4 COMMON PREPARATION STEPS FOR THE UPGRADE OF NBU MASTER AND MEDIA SERVERS .............................. 2.5 FALLBACK PREPARATION FOR NBU MASTER S ERVERS ONLY ................................................................... .8 2.6 DOING THE UPGRADE OF NBU MASTER AND M .................................................................. EDIA SERVERS ..10 ..11 3 POST INSTALL TASKS ..............................................................................................................................25 3.1 V NBU MASTER SERVER UPGRADE ................................................... ERIFICATION OF FUNCTIONALITY AFTER 3.2 V NBU MEDIA SERVER UPGRADE ..................................................... .25 ERIFICATION OF FUNCTIONALITY AFTER .25 4 FALLBACK PROCEDURE...........................................................................................................................26 4.1 SCENARIO 1 - ROLL -BACK THE ROOTDISK TO THE ROOTMIRROR 'S STATE ..................................................... 4.2 SCENARIO 2 - ROLL -BACK OF THE NET BACKUP APPLICATION TO VERSION .26 6.5.4........................................... 28 I ADDENDUM POLICY DEACTIVATION/ACTIVATION SCRIPT.................................................................32 II ADDENDUM NETBACKUP LICENSES INSTAL LATION...........................................................................34 III ADDENDUM CUSTOMIZED NETBACKUP START UP.........................................................................36 IV ADDENDUM NBU JAVA CONSOLE 7.0.1 INSTALLATION ..................................................................38 V ADDENDUM NBU JAVA CONSOLE 7.0.1 UNINSTALLATION .................................................................40
6.5.4 TO 7.0.1
1 INTRODUCTION
1.1 Purpose
The purpose of this document is to provide a step-by-step procedure for an upgrade of a NetBackup 6.5.4 Master/Media Server to version 7.0.1.
1.2 Scope
The scope of this document is limited to the standard CREDIT SUISSE data center and branch offices backup environment running on NetBackup version 6.5.4.
1.3 Assumptions
This document is written for backup administrators well experienced in NetBackup and Solaris. Commands not specified with their full absolute pathname are to be found either under '/usr/bin' or '/usr/sbin'.
18/02/2011 page
6.5.4 TO 7.0.1
2 PREPARATION
2.1 One week prior to the upgrade
1. Check that the NBU Server to be upgraded is already on version 6.5.4 The NetBackup Server module version is 6.5.4
# cat /usr/openv/netbackup/version HARDWARE SOLARIS VERSION NetBackup 6.5.4 RELEASEDATE Fri May 01 06:32:40 CDT 2009 BUILDNUMBER 20090430
The NetBackup Options for NDMP and Vault are on version 6.5.4
# grep -h NetBackup /usr/openv/share/version_* NetBackup-NDMP-SOLARIS 6.5.4 NetBackup-VAULT-SOLARIS 6.5.4
The pack summary shows all the NetBackup options properly patched with version 6.5.4
# cat /usr/openv/pack/pack.summary # DO NOT EDIT THIS FILE ! # * means installed patch was preceded by this patch. # + means that the installed patch installed this patch as a dependency. NB_CLT_6.5.4 installed. +NB_6.5.4 +NB_JAV_6.5.4 NB_6.5.4 installed. *NB_CLT_6.5.4 NB_JAV_6.5.4 installed. *NB_CLT_6.5.4 NB_VLT_6.5.4 installed. NB_DMP_6.5.4 installed. *NB_6.5.4
Check the revisions of the ORACLE Solaris 10 patches required for Netbackup 7.0 (139555-08 and 119963-21).
# csb distname stage region SunOS.5.10-CSS3.0-PB PROD Zurich # showrev -p|egrep "(^Patch: 139555|^Patch: 119963)"|cut -c1-16 Patch: 13955508 Patch: 119963-12 Patch: 11996319
NOTICE: According to the recommendation by GPS Storage Engineering (see SymcRecSolarisPatches_NBU7.pdf ), current patch levels in CSS 3.x and 2.x are ok, as the expected performance impact of bug ID 6815915, referenced for patch 119963-21 by Symantec in the NetBackup 7.0 release notes, is not given on the one hand and the bug is fixed by already 119963-14 on the other.
1 NDMP
Option is only valid for non-Swiss Media Servers and Vault Option is only valid for non-Swiss Master Servers
18/02/2011 page
2. If the NBU Server to be upgraded is not a Master Server, go to step 5, else download and run the latest NetBackup Catalog Consistency Check package ( TECH140582 ) and extract file "solaris\NBCC" from "7.0.1_nbcc.zip" archive and copy it to "/usr/openv/netbackup/bin/support" directory on the NBU Master Server to be upgraded 3. Run the NetBackup Catalog Consistency Check in upgrade mode and deliver the resulting support package under "/root/output/nbcc/" to Symantec support for analysis.
# cd /root # /usr/openv/netbackup/bin/support/NBCC -upgrade 1.0 Gathering initial NBCC information 1.1 Querying configured network interfaces 1.2 Building hostname services information 1.3 Obtaining initial NetBackup configuration information NBCC is being run on NetBackup master server su83sr26 If NBCC DOES NOT detect any catalog inconsistencies, would you like NBCC to create a support package? [Y/y,N/n] 2.0 Gathering required NetBackup configuration information Is the master server or any media server in a fail-over cluster? [Y/y,N/n] Would you like NBCC to update the /usr/openv/netbackup/bin/support/config/nbcc-server-aliases file with additional hostnames and/or IP addresses that are detected during processing? [Y/y,N/n] y Would you like to verify each addition prior to the update? [Y/y,N/n] n If NBCC is unable to determine the NetBackup version for ANY detected media server, is there a SINGLE version of NetBackup that you would like associated to these media servers? [Y/y,N/n] After NBCC has completed gathering the NetBackup database information, if there are any media servers that NBCC was unable to determine the NetBackup version, you will be prompted for the version to associate with each media server.
2.1 Reading the initial list of IP addresses and associated hostnames from the /usr/openv/netbackup/bin/support/config/nbcc-server-aliases file 2.2 Verifying the IP addresses and hostnames contained in the . . . 6.7 Cleaning up output files... 6.8 Compressing the bkpuh10en1_NBCC_20110217_212815.tar support package using gzip... NBCC has successfully created a support package named bkpuh10en1_NBCC_20110217_212815.tar.gz This file is located in the directory ./output/nbcc/bkpuh10en1_NBCC_20110217_212815 Please deliver it to Symantec NetBackup Support for analysis.
4. Order the necessary changes for adding the NBU Master Server to your regional OpsCenter (replacement for Aptare in terms of backup reporting), if not already included and have Ramazan Cakir, GG CH Backup Central Server (KIDK remove it from Aptare. 43)
18/02/2011 page
SwanXP
Content
CSNET700C CS_NET_700_CODEP.pkg 2.0.0.001 1.6 /cs/saubernbu7xy/nbu700/nbu70GA/NB_7.0_Solaris_Sparc64_GA CSNET701C CS_NET_701_CODEP.pkg 2.0.0.001 1.06 /cs/saubernbu7xy/up701/nbu701GA/NB_701_ICS_1.5.5.0_Solaris /cs/saubernbu7xy/up701/nbu701GA/NB_update.install /cs/saubernbu7xy/up701/nbu701GA/VrtsNB_7.0.1.* /cs/saubernbu7xy/up701/nbu701GA/VrtsNB_CLT_7.0.1.* /cs/saubernbu7xy/up701/nbu701GA/VrtsNB_JAV_7.0.1.*
Table 1 Solaris SystemV Packages for NetBackup 7.0.1 Master/Media Server (SDSS NET 2.0.0_8_0)
6. Check existing NBU Client versions in order to decide on the handling of versions older than 6.x. 7. Order a Shadow Image of your NBU Master Server's SAN storage (i.e. if any) at your local Storage team in order to prepare for a potential fallback needed on a failing NBU upgrade. RDO 8. Check for availability of root privileges on the NBU Server to be upgraded 9. Check if you have access to the Global Blackout Facility: https://gbf.csintra.net:8000
10. Inform the stakeholders of the NetBackup domain to be upgraded, about the actions planned and the expected impact as well as who to contact in case of urgency.
2. Check if a recent full file system backup of the NBU Server is available
# /usr/openv/netbackup/bin/admincmd/bpimagelist -U -hoursago 168 -client <master/media server name> -option COMPLETE_COPIES -pt Standard -st FULL Backed Up Expires Files KB C Sched Type Policy ---------------- ---------- -------- -------- - ----------------------- 23:14 01/13/2010 276450 19348093 N Full Backup unix_smr_uh_00_bz 12/03/2009
18/02/2011 page
/cs shall have enough space for the 2.66GB (1.6GB+1.06GB) of the packages to be installed, plus an additional temporary space of 1.06GB for the CS_NET_701_CODEP.pkg package under /cs/gsds/ep/pkg during either the SDSS deployment to PB and IB Switzerland systems or the HTTP-download to IB internatio nal or AM systems (i.e. 3.72GB in total under /cs). 2.2.1 SW deployment for PB and IB Switzerland only the UNIX administrator of the NBU Server to be upgraded deploy the NET 2.0.0 component via SDSS: Have https://swd.csintra.net/servlet/SDSS?link=switchdeploy Komponenten-ID: NET Komponenten-Version (Release): 2.0.0 Systeme oder Stufe - Schiene: <name of NBU Server to be upgraded> 2.2.2 SW deployment for IB international and AM only HTTP-download of the 7.0.1 packages from the TIS Storage Engineering software repository and installation onto the NetBackup Server to be upgraded
2
# cd /cs/gsds/ep/pkg # /usr/sfw/bin/wget --tries=2 --timeout=20 --user=pkguser --password=pkguser http://storage.csintra.net/pkg/NET/2.0.0_8_0/CS_NET_700_CODEP.pkg --16:55:31-- http://storage.csintra.net/pkg/NET/2.0.0_8_0/CS_NET_700_CODEP.pkg => `CS_NET_700_CODEP.pkg' Resolving storage.csintra.net... 159.8.18.39 Connecting to storage.csintra.net|159.8.18.39|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 1,717,969,408 (1.6G) [application/octet-stream] 100% [======================================================================================>] 1,717,969,408 11.71M/s ETA 00:00 16:57:43 (12.15 MB/s) - `CS_NET_700_CODEP.pkg' saved [1717969408/1717969408] # pkgadd -d CS_NET_700_CODEP.pkg The following packages are available: 1 CSNET700C CS NetBackup for Master & Media - Servers Version 700 (sparc) 2.0.0.001 Select package(s) you wish to process (or 'all' to process all packages). (default: all) [?,??,q]: all Processing package instance <CSNET700C> from </cs/CS_NET_700_CODEP.pkg> CS NetBackup for Master & Media - Servers Version 700 (sparc) 2.0.0.001 The selected base directory </cs/saubernbu7xy> must exist before installation is attempted. Do you want this directory created now [y,n,?,q] y # rm CS_NET_700_CODEP.pkg
# /usr/sfw/bin/wget --tries=2 --timeout=20 --user=pkguser --password=pkguser http://storage.csintra.net/pkg/NET/2.0.0_8_0/CS_NET_701_CODEP.pkg --17:39:19-- http://storage.csintra.net/pkg/NET/2.0.0_8_0/CS_NET_701_CODEP.pkg => `CS_NET_701_CODEP.pkg' Resolving storage.csintra.net... 159.8.18.39 Connecting to storage.csintra.net|159.8.18.39|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 1,136,222,208 (1.1G) [application/octet-stream]
2 NOTE:
If the NBU Server to be upgraded is located behind a firewall, it might be necessary to download the packages to another server in your location and transfer them to the NBU Server to be upgraded using SCP (Secure Copy based on SSH)
of 40 GPS Storage Engineering 5
18/02/2011 page
100% [======================================================================================>] 1,136,222,208 8.77M/s ETA 00:00 17:41:37 (9.02 MB/s) - `CS_NET_701_CODEP.pkg' saved [1136222208/1136222208] # pkgadd -d CS_NET_701_CODEP.pkg The following packages are available: 1 CSNET701C CS NetBackup for Master & Media - Servers (sparc) 2.0.0.001 Select package(s) you wish to process (or 'all' to process all packages). (default: all) [?,??,q]: # rm CS_NET_701_CODEP.pkg
all
2.3 Preparation steps for the upgrade of NBU Master Servers only
1. Contact colleagues to have them close their Java Console sessions
Copy/paste the whole text block in bold
# pgrep -fl bpjava-susvc|awk '{print $3}'|sort|uniq|while read uid do grep ${uid} /etc/passwd|cut -d":" -f5 done Ara Hagopian, SAA Ramazan Cakir, SAA Bruno Annaheim, SAA
4. Deactivate policies marking down those that were previously inactive (see the content of this script in section I "Addendum Policy Deactivation/Activation Script")
# cd /usr/openv/netbackup # ./set_policy_active_flag.sh inactive number of policies found: 117 deactivating policy Hot_Catalog_Backup. deactivating policy OneCMS_ET_File_Backup. deactivating policy OneCMS_ET_Flash_Backup. deactivating policy OneCMS_ET_Flash_Backup2. deactivating policy U_SMR_hg_marimba. deactivating policy U_SMR_uh_gsds. deactivating policy W_SMR_uh_ev_index. deactivating policy exc_smr_uh_00_bz. policy "flash_smr_uh_00_bz" is already inactive => adding to list of inactive policies. deactivating policy ora_smr_hg_00_bz. . . . policy "win_smr_uh_00_bz_quorum" is already inactive => adding to list of inactive policies. deactivating policy win_smr_uh_00_tesz. deactivating policy win_smr_uh_00_tesz_sql. deactivating policy win_smr_uh_01_bz. deactivating policy win_smr_uh_01_tesz. deactivating policy win_sqr_hg_00_bz.
18/02/2011 page
deactivating policy win_sqr_hg_00_tesz. deactivating policy win_sqr_uh_00_bz. deactivating policy win_sqr_uh_00_tesz. deactivating policy win_sqr_uh_00_tesz_sql. deactivating policy win_squ_uh_00_bz. deactivating policy win_syr_uh_00_bz. deactivating policy win_syr_uh_00_tesz.
5. Run an upgrade NetBackup Catalog Consistency Check in non-interactive mode additionally checking for abandoned tape media.
# cd /root # /usr/openv/netbackup/bin/support/NBCC -batch idar -upgrade 1.0 Gathering initial NBCC information 1.1 Querying configured network interfaces 1.2 Building hostname services information 1.3 Obtaining initial NetBackup configuration information NBCC is being run on NetBackup master server . . . NBCC did not detect any NetBackup catalog inconsistencies. 6.2 Preparing to create support package... 6.3 Analyzing available bundling programs... Utilizing tar Utilizing gzip 6.4 Identifying output files to include in support package... 6.5 Cleaning up output files... The output files were successfully removed.
6. Check for the remaining active jobs and cancel them if possible
# /usr/openv/netbackup/bin/admincmd/bpdbjobs -report |awk '{print $1,$2,$3,$4,$5,$6,$7}'|egrep '(^JobID|Active)' JobID Type State Status Policy Schedule Client 8045388 Backup Active OneCMS_ET_Flash_Backup Full su88sr106en3.csintra.net bkpuh101en1.csintra.net 8045387 Backup Active OneCMS_ET_Flash_Backup - su88sr106en3.csintra.net bkpuh101en1.csintra.net 8029140 Backup Active unix_smr_hg_00_tesz unix_smr_hg_00_tesz_d_incr chvj002ps101en3.csintra.net bkphg106en1.csintra.net 8028992 Backup Active unix_smr_uh_04_tesz unix_smr_uh_04_tesz_d_incr su180sr605en3.csintra.net bkpuh103en1.csintra.net
18/02/2011 page
2.4 Common preparation steps for the upgrade of NBU Master and Media Servers
1. On the respective Master Server of the NBU Server to be upgraded, deactivate the Media Servers affected by this upgrade ( i.e. if upgrading a NBU Master Server, deactivate all Media Servers listed, else only deactivate the Media Server to be upgraded)
Copy/paste the whole text block in bold
# /usr/openv/netbackup/bin/admincmd/nbemmcmd -listhosts|grep ^media|awk '{print $NF}'|while read media do /usr/openv/volmgr/bin/vmoprcmd -hoststatus -h ${media}|grep ^Host|awk '{print $2,$NF}' done bkpuh101en1.csintra.net ACTIVE bkpuh103en1.csintra.net ACTIVE bkphg105en1.csintra.net ACTIVE bkphg106en1.csintra.net ACTIVE # /usr/openv/volmgr/bin/vmoprcmd -deactivate_host -h bkpuh103en1.csintra.net # /usr/openv/netbackup/bin/admincmd/nbemmcmd -listhosts|grep ^media|awk '{print $NF}'|while read media do /usr/openv/volmgr/bin/vmoprcmd -hoststatus -h ${media}|grep ^Host|awk '{print $2,$NF}' done bkpuh101en1.csintra.net ACTIVE bkpuh103en1.csintra.net DEACTIVATED bkphg105en1.csintra.net ACTIVE bkphg106en1.csintra.net ACTIVE
2. Put the NBU Server to be upgraded into maintenance mode via the Global Blackout Facility (Monitoring shall be switched off during the upgrade) https://gbf.csintra.net:8000 Click < Search > Node Name search criteria [ bkpuh10en1.csintra.ne ] # hostname of the NBU Server to be upgraded t Click < OK Click < >Maintenance > Change to Maintenance [ Upgrade to NetBackup 7.0.1< OK ] Click > 3. Start logging of the SSH session with the NBU Server to be upgraded 4. Stop all NetBackup processes
# /etc/init.d/netbackup stop stopping the NetBackup Service Monitor stopping the NetBackup Service Layer stopping the NetBackup Remote Monitoring Management System stopping the NetBackup Storage Service Manager stopping the NetBackup Policy Execution Manager stopping the NetBackup Job Manager stopping nbproxy... stopping the NetBackup compatibility daemon stopping the NetBackup database daemon stopping the Media Manager volume daemon stopping the NetBackup Resource Broker stopping the NetBackup Enterprise Media Manager stopping the NetBackup Event Manager stopping the NetBackup Database Server
18/02/2011 page
MM Processes ------------
Stop PBX
# /opt/VRTSpbx/bin/vxpbx_exchanged stop
Make a backup copy of the existing start up script (starting NBU in its own project, see section III "Addendum Customized NetBackup Start up") as it will be overwritten during the upgrade
# cp /etc/init.d/netbackup /etc/init.d/netbackup_proj
1. Have your UNIX system administrator split the local disk's mirror. Verify that the root disk and root mirror aliases are correctly set
# eeprom nvramrc |egrep '(rootdisk|rootmirror)'|cut -d"=" -f2 devalias rootdisk /pci@780/pci@0/pci@9/scsi@0/disk@0,0 devalias rootmirror /pci@780/pci@0/pci@9/scsi@0/disk@1,0 # ls -dl /dev/rdsk/*|grep "`eeprom nvramrc |grep rootdisk|awk '{print $NF}'|sed 's/disk/sd/'`"|head -1|awk '{print $9}'|cut -d"/" -f4|cut -c1-6 c1t0d0 # ls -dl /dev/rdsk/*|grep "`eeprom nvramrc |grep rootmirror|awk '{print $NF}'|sed 's/disk/sd/'`"|head -1|awk '{print $9}'|cut -d"/" -f4|cut -c1-6 c1t1d0
18/02/2011 page
# metastat -p d15 -m d16 1 d16 1 1 c1t0d0s6 d9 -m d10 1 d10 1 1 c1t0d0s4 d6 -m d7 1 d7 1 1 c1t0d0s3 d3 -m d4 1 d4 1 1 c1t0d0s1 d0 -m d1 1 d1 1 1 c1t0d0s0 d12 -m d13 1 d13 1 1 c1t0d0s5 d17 1 1 c1t1d0s6 d14 1 1 c1t1d0s5 d11 1 1 c1t1d0s4 d8 1 1 c1t1d0s3 d5 1 1 c1t1d0s1 d2 1 1 c1t1d0s0
Verify that the system is currently booted from the root disk
# prtconf -vp | grep bootpath bootpath: '/pci@0/pci@0/pci@2/scsi@0/disk@0,0:a' # eeprom nvramrc|grep `prtconf -vp | grep bootpath | cut -d"'" -f2,3,4,5,6|cut -d":" -f1`|awk '{print $2,$3}' rootdisk /pci@0/pci@0/pci@2/scsi@0/disk@0,0
18/02/2011 page
10
Symantec Installation Script Copyright 1993 - 2010 Symantec Corporation, All Rights Reserved.
NetBackup installs to the running root environment, by default. Are you installing to the running root environment? [y,n] (y) Looking for NetBackup processes that need to be terminated. The following processes are still active root 1583 1 0 15:06:11 ? 0:00 /usr/openv/netbackup/bin/bpjava-susvc f219376 -1 -1 de_CH /usr/openv/java/auth. root 1585 1583 0 15:06:12 ? 0:00 /usr/openv/netbackup/bin/bpjava-susvc f219376 -1 -1 de_CH /usr/openv/java/auth. Do you want this script to attempt to kill them? [y,n] (y) Killing remaining processes... Looking for Media Manager processes that need to be terminated. y y
Looking for VxDBMS processes that need to be terminated. Please verify that any OpenStorage plugins located in directory /usr/openv/lib/ost-plugins have been certified for use with NetBackup 7.0 or later. Starting with NetBackup 7.0, binaries are 64-bit; therefore, it is required that any OpenStorage plugin also be 64-bit. Warning for NetBackup 7.0 or later media servers: if the OpenStorage plugin is not 64-bit, NetBackup will not be able to access the OpenStorage device to perform backups or restores.
You have the following optional NetBackup products installed: SYMCnbdmp SYMCnbvlt Starting with NetBackup 7.0, the previously listed addon products have been folded into the NetBackup server or NetBackup client package. These
18/02/2011 page
11
old packages must be removed prior to upgrading to NetBackup 7.0. Removing these packages after the NetBackup server has been upgraded to 7.0 or later will destroy part of your NetBackup installation. Do you want this script to attempt to run pkgrm on these packages? [y,n] (y) Removal of <SYMCnbdmp> was successful. Removal of <SYMCnbvlt> was successful. The following old package is currently installed on your system and should be removed prior to an upgrade: SYMCnetbp *********************************************************************** It is highly recommended that older packages be removed before doing an upgrade. *********************************************************************** Do you want to exit this script so you can remove packages now? [y,n] (y) y y
File /usr/openv/tmp/install_trace.4080 contains a trace of this install. That file can be deleted after you are sure the install was successful. You have new mail in /var/mail/root
Do the requested manual removal of the NetBackup and Media Manager package
# pkgrm SYMCnetbp The following package is currently installed: SYMCnetbp NetBackup and Media Manager (sparc) 6.5,REV=2007.07.24.02.54 Do you want to remove this package? [y,n,?,q] ## Removing installed package instance <SYMCnetbp> This package contains scripts which will be executed with super-user permission during the process of removing this package. Do you want to continue with the removal of this package [y,n,?,q] ## Verifying package <SYMCnetbp> dependencies in global zone ## Processing package information. ## Executing preremove script. NetBackup and Media Manager processes cannot be running when this package is removed. Do you want to stop the NetBackup and Media Manager processes? (y) [y,n,?,q] Looking for NetBackup processes that need to be terminated. The following processes are still active root 7001 1 0 15:45:39 ? 0:00 /usr/openv/netbackup/bin/bpjava-susvc f219376 -1 -1 de_CH /usr/openv/java/auth. root 7003 7001 0 15:45:39 ? 0:00 /usr/openv/netbackup/bin/bpjava-susvc f219376 -1 -1 de_CH /usr/openv/java/auth. Do you want this script to attempt to kill them? [y,n] (y) Killing remaining processes... Looking for Media Manager processes that need to be terminated. y y y
Looking for VxDBMS processes that need to be terminated. Are you doing this pkgrm as a step in an upgrade process? [y,n,?,q] Removing sg files from /kernel/drv/ and /kernel/drv/sparcv9. ## Removing pathnames in class <NBclass> /cs/openv/volmgr/misc/README /cs/openv/volmgr/misc <non-empty directory not removed> /cs/openv/volmgr/help/vmadm_vault_menu y
18/02/2011 page
12
Nothing to update in registration. ## Updating system information. Removal of <SYMCnetbp> was successful.
Symantec Installation Script Copyright 1993 - 2010 Symantec Corporation, All Rights Reserved. Installing NetBackup Server Software Do you wish to continue? [y,n] (y) y
NetBackup installs to the running root environment, by default. Are you installing to the running root environment? [y,n] (y) Processing package instance <SYMCnetbp> from </cs/netbackup/nbu70GA/NB_7.0_Solaris_Sparc64_GA/solaris> NetBackup and Media Manager(sparc) 7.0,REV=2010.01.06.21.06 Copyright 1993 - 2010 Symantec Corporation, All Rights Reserved. NetBackup and Media Manager binaries will be installed in /cs/openv and a link will be created from /usr/openv to /cs/openv, if it does not exist. Is this okay? (y) [y,n,?,q] NetBackup and Media Manager 7.0 will be installed. Using </cs> as the package base directory. ## Processing package information. ## Processing system information. 50 package pathnames are already properly installed. ## Verifying disk space requirements. ## Checking for conflicts with packages already installed. The following files are already installed on the system and are being used by another package: * /cs/openv/db/bin/dbadm * /cs/openv/man/man1m/NBCC.1m * /cs/openv/man/man1m/NBCCR.1m * /cs/openv/man/man1m/bpclimagelist.1m * /cs/openv/man/man1m/bpclusterutil.1m * /cs/openv/man/man1m/nbkmsutil.1m * /cs/openv/netbackup/bin/admincmd/nbkmsutil * /cs/openv/netbackup/bin/bpclusterkill * /cs/openv/netbackup/bin/goodies/man/NBCC.1m * /cs/openv/netbackup/bin/goodies/man/NBCCR.1m * /cs/openv/netbackup/bin/goodies/man/bpclimagelist.1m * /cs/openv/netbackup/bin/goodies/man/bpclusterutil.1m * /cs/openv/netbackup/bin/goodies/man/nbkmsutil.1m * /cs/openv/netbackup/bin/goodies/streamsfile_update * /cs/openv/netbackup/bin/nbkms * /cs/openv/netbackup/bin/support/NBCC * /cs/openv/netbackup/bin/support/NBCCR * /cs/openv/resources/nbkms_root.res * - conflict with a file which does not belong to any package. y y
18/02/2011 page
13
Installing NetBackup and Media Manager as <SYMCnetbp> ## Executing preinstall script. Moving pack history to /cs/openv/pack.6.5.4 Creating link from /usr/openv to /cs/openv. ## Installing part 1 of 1. /cs/openv/NB-Java.tar.gz /cs/openv/db/bin/create_nbdb . . ## Executing postinstall script.
The NetBackup and Media Manager binaries are installed. Read the release notes carefully. If you ran pkgadd instead of <cdrom_path>/install, you must run /usr/openv/netbackup/bin/install_bp to initiate NetBackup.
Installation of <SYMCnetbp> was successful. Running /usr/openv/netbackup/bin/install_bp Copying Solaris10 Client Binaries x openv, 0 bytes, 0 tape blocks x openv/lib, 0 bytes, 0 tape blocks . . Terminating NetBackup and/or Media Manager processes. Installing NB-Java. + /bin/cp ./nbj.conf /usr/openv/java Copying /usr/openv/netbackup/nblog.conf to /usr/openv/netbackup/nblog.conf.09-08-10.15:55:18 for future reference. Any local modifications to /usr/openv/netbackup/nblog.conf should be re-evaluated.
Installing PBX... + Extracting PDDE agent package (/cs/openv/netbackup/client/Solaris/Solaris10/pddeagent.tar.gz)... Creating /etc/pdregistry.cfg. Copying pdregistry.cfg file to /usr/openv/pdde/pdconfigure/cfg/userconfigs/pdregistry.cfg. Starting setup for PDDE script Done setup for PDDE script PDDE install finished successfully.
Copying /etc/init.d/netbackup to /etc/init.d/netbackup.09-29-10.11:20:09 for future reference. Any local modifications to /etc/init.d/netbackup should be re-evaluated.
The following automatic startup and shutdown scripts (respectively) have been installed. They will cause the NetBackup daemons to be automatically shut down and restarted each time the system boots. /etc/rc2.d/S77netbackup /etc/rc0.d/K01netbackup /etc/rc1.d/K01netbackup Installation of Java LiveUpdate agent succeeded. Refer to file
18/02/2011 page
14
Checking LiveUpdate registration for the following products: JAV NB This may take a few minutes. Product JAV is installed and will be registered. Product NB is installed and will be registered.
NetBackup Evaluation Enterprise Server is the active NetBackup. Do you want to continue the installation with the current active NetBackup license key? [y,n] (y) All additional keys should be added at this time. Do you want to add additional license keys now? [y,n] (y) Use /usr/openv/netbackup/bin/admincmd/get_license_key to add, delete or list license keys at a later time. Installing NetBackup Enterprise Server version: 7.0 Removing bpcd from /etc/inetd.conf. Removing vnetd from /etc/inetd.conf. Removing bpjava-msvc from /etc/inetd.conf. Removing vopied from /etc/inetd.conf. Original /etc/inetd.conf saved as /etc/inetd.conf.NB_090810.15:55:18. Sending SIGHUP to inetd process.
Copied files to /kernel/drv/sparcv9. Doing add_drv of the sg driver Leaving existing sg configuration. If you wish to update the configuration you need to rm -f /kernel/drv/sg.conf and rerun /usr/openv/volmgr/bin/driver/sg.install.
Converting STREAMS files. This may take a few minutes. STREAMS files conversion is complete.
Successfully updated the session cache parameters. Starting the NetBackup network daemon. Starting the NetBackup client daemon. Starting the NetBackup SAN Client Fibre Transport daemon. x bin, 0 bytes, 0 tape blocks x bin/dbsupport, 1189008 bytes, 2323 tape blocks . . Installed SQL Anywhere Version 11.0.1.2222 Installation completed successfully Database server is NB_bkpuh10en1 NetBackup database already exists in /usr/openv/db/data/NBDB.db Making a copy of the existing database files in /usr/openv/db/staging Rebuilding the NetBackup database [NBDB]. This will take some time. SQL Anywhere Unload Utility Version 11.0.1.2222 Connecting and initializing Unloading user and group definitions Unloading table definitions Unloading index definitions Unloading functions Unloading view definitions Unloading procedures Unloading triggers Unloading SQL Remote definitions Unloading MobiLink definitions Creating new database
18/02/2011 page
15
Unloading "EMM_MAIN"."EMM_AllocationStatus" (0 rows) . . Creating indexes Creating indexes for (1/65) "EMM_MAIN"."EMM_AllocationStatus" Creating indexes for (2/65) "EMM_MAIN"."EMM_Allocations" . . Starting the NetBackup database server [NB_bkpuh10en1]. Creating the NetBackup database files. Verifying the running version of NBDB ... NBDB version 6.5.4.0 verified. Upgrading NBDB (6.5.4.0) to (7.0.0.0) ... Re-verification of NBDB at new version, 7.0.0.0 Verification succeeded. Successfully upgraded NBDB to version 7.0.0.0 Database [NBDB] validation successful. Database [NBDB] is alive and well on server [NB_bkpuh10en1]. Starting the NetBackup Event Manager. Starting the NetBackup Deduplication Manager. Starting the NetBackup Deduplication Engine. Starting the NetBackup database manager process (bpdbm). Creating Directive Set for Enterprise_Vault_7.5 Creating Directive Set for Enterprise_Vault_8.0 Converting snapshot policies: Policy conversion summary: Number of original policies: 0 Number of non-snapshot policies skipped: Number of policies not needing conversion: Number of policies converted to 'auto' snapshot method: 0 Number of policies converted: 0 Updating client hardware definitions: Hardware update conversion summary: Number of policies processed: 0 Number of policies with affected clients: 0 Number of clients processed: 0 Number of clients converted: 0 Number of Disaster Recovery flags cleared: 0 Starting the NetBackup compatibility daemon. Starting the NetBackup Enterprise Media Manager. Starting the NetBackup Resource Broker. Populating the database tables. This will take some time. Starting the Media Manager device daemon processes. Do you want to start the NetBackup bprd process so backups and restores can be initiated? [y,n] (y) Starting the NetBackup request daemon process (bprd). Starting the NetBackup Job Manager. Starting the NetBackup Policy Execution Manager. Starting the NetBackup Storage Lifecycle Manager. Starting the NetBackup Remote Monitoring Management System. Starting the NetBackup Key Management daemon. Starting the NetBackup Service Layer. Starting the NetBackup Agent Request Server. Starting the NetBackup Bare Metal Restore daemon. Starting the NetBackup Vault daemon. Starting the NetBackup Service Monitor. Starting the NetBackup Bare Metal Restore Boot Server daemon. OpsCenter is the next-generation monitoring, reporting and administrative solution designed to centrally manage one or
0 0
18/02/2011 page
16
more NetBackup installations from a web browser. Existing NetBackup Operations Manager or Veritas Backup Reporter installations can be upgraded to OpsCenter. If an OpsCenter server already exists in your environment or you plan to install one, enter the real hostname of that OpsCenter server here. Do not use a virtual name. If you do not want this local machine to be an OpsCenter server, enter NONE. Enter the OpsCenter server (default: NONE):
NetBackup server installation complete. File /usr/openv/tmp/install_trace.8626 contains a trace of this install. That file can be deleted after you are sure the install was successful. You have new mail in /var/mail/root
There are 3 packs available in /cs/netbackup/nbu701FA: (* denotes installed pack) NB_7.0.1 NB_CLT_7.0.1 NB_JAV_7.0.1 Enter pack name (or q) [q]: NB_7.0.1
Pack NB_7.0.1 requires pack NB_CLT_7.0.1 or a later. Pack NB_7.0.1 requires the following pack levels(s) : NB_CLT_7.0.1. Pack NB_7.0.1 will not be installed at this time. Installing required pack, NB_CLT_7.0.1, now.
3 The
18/02/2011 page
NB_7.0.1 NB_JAV_7.0.1. Install pack NB_CLT_7.0.1 Thu Sep 9 08:48:49 MEST 2010 Rev. 1.39.2.3 Can not install pack when NetBackup daemons are running. Do you want to kill all NetBackup daemons? [y,n] (y) Looking for NetBackup processes that need to be terminated. Stopping nbsvcmon... Stopping nbvault... Stopping nbars... Stopping nbsl... Stopping nbrmms... Stopping nbstserv... Stopping nbpem... Stopping nbjm... Stopping nbproxy... Suspending or cancelling selective jobs... Stopping bprd... Stopping bpcompatd... Stopping bpdbm... Looking for Media Manager processes that need to be terminated. Stopping vmd... Looking for more NetBackup processes that need to be terminated. Stopping nbrb... Stopping nbemm... Stopping nbevtmgr... Stopping VxDBMS database server ... Stopping bpcd... Stopping vnetd... Pack install will continue. Performing install of Solaris/Solaris10 client binaries locally. Running preinstall script. See /usr/openv/pack/pack.history for more details. Saving pre-existing binaries. This may take a few minutes. Saved binaries successfully. Using gzip to compress saved files in /usr/openv/pack/NB_CLT_7.0.1/save/pre_NB_CLT_7.0.1Solaris.090910_085813.tar. Extracting files out of /cs/netbackup/nbu701FA/VrtsNB_JAV_7.0.1.tar.gz. Tar extraction successful. See /usr/openv/pack/pack.history for more details. Running postinstall script. See /usr/openv/pack/pack.history for more details. /cs/netbackup/nbu701FA/VrtsNB_JAV_7.0.1.postinstall: Running. Hardware/OS Type=Solaris/Solaris10 Uncompressing /usr/openv/NB-Java.tar.gz file. -----------------------------------------------Installation of pack NB_JAV_7.0.1 completed Thu Sep 9 08:58:13 MEST 2010 Rev. 1.39.2.3. -----------------------------------------------Checking LiveUpdate registration for the following products: JAV NB This may take a few minutes. Product JAV is installed and will be registered. Product NB is installed and will be registered. Updating LiveUpdate registration now...this may take some time. There are 3 packs available in /cs/netbackup/nbu701FA: (* denotes installed pack) NB_7.0.1 * NB_CLT_7.0.1 * NB_JAV_7.0.1 * Enter pack name (or q) [q]: q
There are stopped daemons. Do you want to restart all NetBackup daemons? [y,n] (y) Exiting NB_update.install 18/02/2011 page of 40 GPS Storage Engineering 18
7. Check the success of the Netbackup upgrade to 7.0.1 The NetBackup Server module version is 7.01
# cat /usr/openv/netbackup/version HARDWARE SOLARIS VERSION NetBackup 7.0.1 RELEASEDATE Thu Jul 08 00:13:47 CDT 2010 BUILDNUMBER 20100707
The pack summary shows all the NetBackup options properly patched with 7.0.1
# cat /usr/openv/pack/pack.summary # DO NOT EDIT THIS FILE ! # * means installed patch was preceded by this patch. # + means that the installed patch installed this patch as a dependency. NB_CLT_7.0.1 installed. +NB_7.0.1 +NB_JAV_7.0.1 NB_7.0.1 installed. *NB_CLT_7.0.1 NB_JAV_7.0.1 installed. *NB_CLT_7.0.1
8. If the NBU Server just upgraded is a NBU Master Server, start DBMS Server, verify the NetBackup and check the EMM DB server, else go to step 9. databse
# /usr/openv/db/bin/nbdbms_start_server # /usr/openv/db/bin/create_nbdb Database server is NB_bkpuh10 NetBackup database already exists in /usr/openv/db/data/NBDB.db Creating the NetBackup database files. Verifying the running version of NBDB ... NBDB version 7.0.1.0 verified. Nothing to upgrade. Version unchanged. Database [NBDB] validation successful. Database [NBDB] is alive and well on server [NB_bkpuh10]. # /usr/openv/netbackup/bin/nbemm # /usr/openv/netbackup/bin/bprd # /usr/openv/netbackup/bin/admincmd/nbemmcmd -getemmserver NBEMMCMD, Version:7.0.1 These hosts were found in this domain: bkpuh10en1.csintra.net Checking with the host "bkpuh10en1.csintra.net"... Server Type MASTER Host Version Host Name 7.0 bkpuh10en1.csintra.net EMM Server bkpuh10en1.csintra.net
9. Decision: if upgrade and verification were successful go to step 10. else go to 4 "Fallback Procedure"
4 The
18/02/2011 page
10. Have your UNIX system administrator join the local disk's mirror again. Re -attach all detached submirrors
# metastat -p d15 -m d16 1 d16 1 1 c1t0d0s6 d9 -m d10 1 d10 1 1 c1t0d0s4 d6 -m d7 1 d7 1 1 c1t0d0s3 d3 -m d4 1 d4 1 1 c1t0d0s1 d0 -m d1 1 d1 1 1 c1t0d0s0 d12 -m d13 1 d13 1 1 c1t0d0s5 d17 1 1 c1t1d0s6 d14 1 1 c1t1d0s5 d11 1 1 c1t1d0s4 d8 1 1 c1t1d0s3 d5 1 1 c1t1d0s1 d2 1 1 c1t1d0s0 # metattach d15 d17 d15: submirror d17 is attached # metattach d9 d11 d9: submirror d11 is attached # metattach d6 d8 d6: submirror d8 is attached # metattach d3 d5 d3: submirror d5 is attached # metattach d0 d2 d0: submirror d2 is attached # metattach d12 d14 d12: submirror d14 is attached
18/02/2011 page
20
11. Stop the NetBackup processes Stop PBX and check all NetBackup processes are stopped
# cd / # /opt/VRTSpbx/bin/vxpbx_exchanged stop Stopped Symantec Private Branch Exchange # bp.kill_all # /usr/openv/netbackup/bin/bpps -x NB Processes ------------
MM Processes ------------
12. Start the NetBackup processes Restore the previous (customized) NetBackup start up script
# cp /etc/init.d/netbackup_proj /etc/init.d/netbackup
18/02/2011 page
21
root 11642 1 0 10:16:08 ? 0:00 /usr/openv/netbackup/bin/bpdbm root 11514 1 0 10:16:00 ? 0:01 /usr/openv/netbackup/bin/nbaudit root 11664 1 0 10:16:12 ? 0:01 /usr/openv/netbackup/bin/nbrmms root 11616 1 0 10:16:05 ? 0:02 /usr/openv/netbackup/bin/nbemm root 11633 1 0 10:16:07 ? 0:00 /usr/openv/netbackup/bin/bprd root 11508 1 0 10:15:56 ? 0:04 /usr/openv/db//bin/NB_dbsrv @/usr/openv/var/global/server.conf @/usr/openv/var/ root 11644 1 0 10:16:08 ? 0:00 /usr/openv/netbackup/bin/nbjm root 11683 1 0 10:16:14 ? 0:00 /usr/openv/netbackup/bin/nbsl root 11639 1 0 10:16:08 ? 0:00 /usr/openv/netbackup/bin/bpcompatd root 11647 11644 0 10:16:09 ? 0:01 /usr/openv/netbackup/bin/nbproxy dblib nbjm root 11646 11642 0 10:16:09 ? 0:01 /usr/openv/netbackup/bin/bpjobd root 11455 1 0 10:15:54 ? 0:00 /usr/openv/netbackup/bin/vnetd -standalone root 11718 1 0 10:16:19 ? 0:00 /usr/openv/netbackup/bin/nbsvcmon root 11699 1 0 10:16:16 ? 0:01 /usr/openv/netbackup/bin/nbars
0:00 vmd -v
0:03 /opt/VRTSpbx/bin/pbx_exchange
Verification of the variance of all relevant parame ters for all Ne tBackup processes in `bpps a`:
(Copy/paste the whole text block in bold ) # bpps -a|egrep -v '(^NB|^MM|^--|^$)'|awk '{print $2}'|while read pid do prctl -P -t privileged -i process ${pid}|egrep '(project.max-shm-ids|project.max-semids|project.max-msg-ids|project.max-shm-memory)' done|sort|uniq project.max-msg-ids privileged 256 - deny project.max-sem-ids privileged 1024 - deny project.max-shm-ids privileged 256 - deny project.max-shm-memory privileged 17179869184 - deny
13. Upgrade the existing NetBackup 6.5 licenses to 7.0 (If the script is not available, see section II "Addendum NetBackup Licenses Installation" on how to create it)
# /usr/openv/netbackup/cs_goodies/installCSNetBackup_license.sh
18/02/2011 page
22
# /usr/openv/netbackup/bin/admincmd/nbemmcmd -listhosts|grep ^media|awk '{print $NF}'|while read media do /usr/openv/volmgr/bin/vmoprcmd -hoststatus -h ${media}|grep ^Host|awk '{print $2,$NF}' done bkpuh101en1.csintra.net ACTIVE bkpuh103en1.csintra.net DEACTIVATED bkphg105en1.csintra.net ACTIVE bkphg106en1.csintra.net ACTIVE # /usr/openv/volmgr/bin/vmoprcmd -activate_host -h bkpuh103.csintra.net # /usr/openv/netbackup/bin/admincmd/nbemmcmd -listhosts|grep ^media|awk '{print $NF}'|while read media do /usr/openv/volmgr/bin/vmoprcmd -hoststatus -h ${media}|grep ^Host|awk '{print $2,$NF}' done bkpuh101en1.csintra.net ACTIVE bkpuh103en1.csintra.net ACTIVE bkphg105en1.csintra.net ACTIVE bkphg106en1.csintra.net ACTIVE
18/02/2011 page
23
16. Comment NetBackup entries in /etc/hosts.allow, as NetBackup 7.x does not run these daemons under the Solaris 10 SMF, launched via inetd service, anymore. They are all independent now
See below example for vnetd under NBU 6.5.4, where vnetd is under SMF control and run via inetd # svcprop -p inetd_start/exec svc:/network/vnetd/tcp:default /usr/openv/bin/vnetd and the same printout under NBU 7.0.1, where vnetd is independent from SMF and inetd. # svcprop -p inetd_start/exec svc:/network/vnetd/tcp:default svcprop: Pattern 'svc:/network/vnetd/tcp:default' doesn't match any entities # vi /etc/hosts.allow # bpcd : ALL : allow # bpjava-msvc : ALL : allow # vnetd : ALL : allow
17. Put the NBU Server into life mode via the Global Blackout Facility (Reactivation of monitoring) https://gbf.csintra.net:8000 Click < Search > Node Name search criteria [ bkpuh10en1.csintra.ne ] Hostname of the NBU Server to be upgraded t # Click < OK > Click < Life > Change to Life [ Upgrade finished Click < OK > ]
18. Have your local Storage RDO delete the Shadow Image of your NBU Master Server's SAN storage.
18/02/2011 page
24
18/02/2011 page
25
4 FALLBACK PROCEDURE
4.1 Scenario 1 - Roll-back the rootdisk to the rootmirror's state
Have your UNIX system administrator remove the rootmirror disk from Sun Volume Manager control, reboot the system from the rootmirror disk, synchronize the rootdisk back to the rootmirror's state (i.e. the state prior to the NetBackup upgrade), reactivate Sun Volume Manager on the rootdisk, reboot from the rootdisk again and re-attach the detached submirrors, to fully synchronize under Sun Volume Manager control. Mount the mirror's slice 0 as /mnt and ch ange to /mnt/etc dire ctory
# mount /dev/dsk/c1t1d0s0 /mnt # cd /mnt/etc
Make a backup copy of both its Solaris Volume Manager system and vfstab files
# cp system system_md # cp vfstab vfstab_md
Comment the md entry in order to remove Solaris Volume Manager con trol
# vi system * Begin MDD root info (do not edit) * rootdev:/pseudo/md@0:0,0,blk * End MDD root info (do not edit)
Re vert the md device entries in /etc/vfstab to the roo tmirror's normal "c1t1d0" entries
# ls -dl /dev/rdsk/*|grep "`eeprom nvramrc |grep rootmirror|awk '{print $NF}'|sed 's/disk/sd/'`"|head -1|awk '{print $9}'|cut -d"/" -f4|cut -c1-6 c1t1d0 # vi vfstab # /dev/md/dsk/d0 /dev/md/rdsk/d0 / ufs /dev/dsk/c1t1d0s0 /dev/rdsk/c1t1d0s0 # /dev/md/dsk/d3 swap no /dev/dsk/c1t1d0s1 swap # - /dev/md/dsk/d6 /dev/md/rdsk/d6 /var ufs /dev/dsk/c1t1d0s3 /dev/rdsk/c1t1d0s3 # /dev/md/dsk/d9 /dev/md/rdsk/d9 /tmp ufs /dev/dsk/c1t1d0s4 /dev/rdsk/c1t1d0s4 # /dev/md/dsk/d12 /dev/md/rdsk/d12 /dev/dsk/c1t1d0s5 /dev/rdsk/c1t1d0s5 # /dev/md/dsk/d15 /dev/md/rdsk/d15 /dev/dsk/c1t1d0s6 /dev/rdsk/c1t1d0s6
1 / -
no ufs
logging 1 no
logging
no 1 no logging /var ufs 1 no logging 2 yes logging /tmp ufs 2 yes logging /export/home ufs 3 yes logging /export/home ufs 3 yes logging /cs ufs 4 yes logging /cs ufs 4 yes logging
Login as root and stop the NetBackup processes and verify they are stopped
# /etc/init.d/netbackup stop # bpps -a NB Processes -----------# if not successful, /usr/openv/netbackup/bin/bp.kill_all
MM Processes ------------
18/02/2011 page
26
Mount the rootdisk's slice 0 as /mnt, change to that directory and remove all files
# mount /dev/dsk/c1t0d0s0 /mnt # cd /mnt # rm -rf *
Change to / directory and restore the rootmirror's slice 0 to /mnt (i.e. the rootdisk's slice 0) and repeat this step for slices 3, 4, 5 and 6
# cd / # ufsdump 0f - /dev/dsk/c1t1d0s0 | (cd /mnt; ufsrestore xf -) DUMP: Date of this level 0 dump: Wed Feb 16 21:54:09 2011 DUMP: Date of last level 0 dump: the epoch DUMP: Dumping /dev/rdsk/c1t1d0s0 (su83sr27:/) to standard output. DUMP: Mapping (Pass I) [regular files] DUMP: Mapping (Pass II) [directories] DUMP: Writing 32 Kilobyte records DUMP: Estimated 12002060 blocks (5860.38MB). DUMP: Dumping (Pass III) [directories] DUMP: Dumping (Pass IV) [regular files] set owner/mode for '.'? [yn] y DUMP: 12002046 blocks (5860.37MB) on 1 volume at 5726 KB/sec DUMP: DUMP IS DONE # ufsdump 0f - /dev/dsk/c1t1d0s3 | (cd /mnt; ufsrestore xf -) set owner/mode for '.'? [yn] y # ufsdump 0f - /dev/dsk/c1t1d0s4 | (cd /mnt; ufsrestore xf -) set owner/mode for '.'? [yn] y
# ufsdump 0f - /dev/dsk/c1t1d0s5 | (cd /mnt; ufsrestore xf -) set owner/mode for '.'? [yn] y # ufsdump 0f - /dev/dsk/c1t1d0s6 | (cd /mnt; ufsrestore xf -) set owner/mode for '.'? [yn] y
Reactivate the rootdisk's original vfstab_md and system_md files with Solaris Volume Manager entries
# cp system_md system # cp vfstab_md vfstab
18/02/2011 page
27
d2 1 1 c1t1d0s0 # metattach d15 d17 d15: submirror d17 is attached # metattach d9 d11 d9: submirror d11 is attached # metattach d6 d8 d6: submirror d8 is attached # metattach d3 d5 d3: submirror d5 is attached # metattach d0 d2 d0: submirror d2 is attached # metattach d12 d14 d12: submirror d14 is attached
4.2 Scenario 2 - Roll-back of the NetBackup application to version 6.5.4 some reason the roll-back procedure 4.1 "Scenario 1 - Roll-back the rootdisk to the rootmirror's state" fails, If for
execute the following steps, in order to roll-back the NetBackup upgrade on application level. 1. Stop all NetBackup processes
# netbackup stop stopping the NetBackup Service Monitor stopping the NetBackup Service Layer stopping the NetBackup Remote Monitoring Management System stopping the NetBackup Storage Service Manager stopping the NetBackup Policy Execution Manager stopping the NetBackup Job Manager stopping nbproxy... stopping the NetBackup compatibility daemon stopping the NetBackup database daemon stopping the Media Manager volume daemon stopping the NetBackup Resource Broker stopping the NetBackup Enterprise Media Manager
18/02/2011 page
28
stopping the NetBackup Event Manager stopping the NetBackup Database Server
MM Processes ------------
Stop PBX
# /opt/VRTSpbx/bin/vxpbx_exchanged stop
Installing NetBackup Server Software NOTE: To install only NetBackup Client software locally on this machine or to load additional UNIX client software on this server, insert the NetBackup UNIX Clients cdrom. Do you wish to continue? [y,n] (y) . . y
18/02/2011 page
29
There are 13 packs available in /cs/saubernbu65x/nbu654: (* denotes installed pack) NB_6.5.4 NB_CLT_6.5.4 NB_DB2_6.5.4 NB_DMP_6.5.4 NB_ENC_6.5.4 NB_INX_6.5.4 NB_JAV_6.5.4 NB_LOT_6.5.4 NB_ORA_6.5.4 NB_SAP_6.5.4 NB_SNC_6.5.4 NB_SYB_6.5.4 NB_VLT_6.5.4 Enter pack name (or q) [q]: NB_6.5.4
18/02/2011 page
30
stopping the NetBackup Event Manager stopping the NetBackup Database Server stopping the NetBackup client daemon stopping the NetBackup network daemon # netbackup NetBackup network daemon started. NetBackup client daemon started. NetBackup SAN Client Fibre Transport daemon started. NetBackup Database Server started. NetBackup Event Manager started. NetBackup Audit Manager started. NetBackup Deduplication Manager started. NetBackup Deduplication Engine started. NetBackup Enterprise Media Manager started. NetBackup Resource Broker started. Media Manager daemons started. NetBackup request daemon started. NetBackup compatibility daemon started. NetBackup Job Manager started. NetBackup Policy Execution Manager started. NetBackup Storage Lifecycle Manager started. NetBackup Remote Monitoring Management System started. NetBackup Key Management daemon started. NetBackup Service Layer started. NetBackup Agent Request Server started. NetBackup Bare Metal Restore daemon not started. NetBackup Vault daemon started. NetBackup Service Monitor started. NetBackup Bare Metal Restore Boot Server daemon started.
18/02/2011 page
31
# cd /usr/openv/netbackup # /usr/sfw/bin/wget --tries=2 --timeout=20 --user=pkguser --password=pkguser http://storage.csintra.net/pkg/Scripts/set_policy_active_flag.sh --15:14:26-- http://storage.csintra.net/pkg/Scripts/set_policy_active_flag.sh => `set_policy_active_flag.sh' Resolving storage.csintra.net... 159.8.18.39 Connecting to storage.csintra.net|159.8.18.39|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 2,346 (2.3K) [application/x-sh] 100% [========================================================================================>] 2,346 --.--K/s 15:14:26 (39.58 MB/s) - `set_policy_active_flag.sh' saved [2346/2346] # chmod u+x set_policy_active_flag.sh
Content script:
#!/bin/ksh
of
the
NBUHOME=/usr/openv/netbackup; PATH=$PATH:${NBUHOME}/bin:${NBUHOME}/bin/admincmd; export PATH; INACTF=/usr/openv/INACTIVE_POLICIES; NOPOLF=/usr/openv/NUMBER_OF_POLICIES; set -A policies `bppllist`; case $1 in inactive) >$INACTF; >$NOPOLF; set -A activeflags; echo "number of policies found: ${#policies[*]}"; echo "${#policies[*]}" >$NOPOLF; let cpolicy=0; while (( $cpolicy < ${#policies[*]} )); do policy="${policies[$cpolicy]}"; activeflags[$cpolicy]=`bpplinfo $policy -L | egrep "^Active:.*[yes|no]$" | awk '{print $2}'`; sleep 1; let cpolicy=$cpolicy+1; done let cpolicy=0; while (( $cpolicy < ${#policies[*]} )); do policy="${policies[$cpolicy]}"; activeflag=${activeflags[$cpolicy]};
18/02/2011 page
32
if [ "$activeflag" = no ]; then echo "policy \"${policy}\" is already inactive => adding to list of inactive policies."; echo "${policy}" >>$INACTF; else echo "deactivating policy $policy."; bpplinfo $policy -modify -inactive; if [ $? -ne 0 ]; then echo "deactivating policy $policy failed. please retry manually." fi sleep 1; fi let cpolicy=$cpolicy+1; done ;; active) if [ ! -f $INACTF ] ; then echo "ERROR: file containing inactive policies ${INACTF} does not exist, aborting!"; exit 1; fi nopol=`cat $NOPOLF` >/dev/null 2>&1; echo "number of policies found on old server: $nopol"; echo "number of policies found on this server: ${#policies[*]}"; echo " ** these numbers may differ if you created test policies on the new server **"; let cpolicy=0; while (( $cpolicy < ${#policies[*]} )); do policy="${policies[$cpolicy]}"; grep ^$policy$ $INACTF >/dev/null 2>&1; if [ $? -eq 0 ]; then echo "policy $policy was already inactive on old server, will not activate."; else echo "activating policy $policy."; bpplinfo $policy -modify -active; if [ $? -ne 0 ]; then echo "deactivating policy $policy failed. please retry manually." fi sleep 1; fi let cpolicy=$cpolicy+1; done ;; *) echo "USAGE: $0 inactive|active" ;; esac
18/02/2011 page
33
1. Create the cs_goodies directory and then add the NetBackup licensing script
# /usr/ucb/whoami root # mkdir -p /usr/openv/netbackup/cs_goodies # vi /usr/openv/netbackup/cs_goodies/installCSNetBackup_license.sh #!/bin/sh # # add license keys for NBU 651 # echo "OEXN-RTL4-BOWC-PPZO-8PPP-PR3R-RCPP-PPO4-WCPP-C OEXR-3DZ4-ERU7-GOSH-SVPP-PPCC-6NPP-PPPP-PPPP-P OEXR-W2VX-2IRZ-6NOP-BPPP-PPRC-P6PP-PCPP-PPPP-6 OEXD-RSSN-TBYP-63XC-VPPP-PPC6-NPPN-PPPP-PPPN-P OEXD-RSSD-TBYP-63XC-UPPC-PPC6-NPPP-PPPP-PPPN-P OEXD-RY4D-TBXD-43PP-6PPP-PRC6-NPPP-PP34-CPPN-P OEXC-RTVY-ZDKD-PP83-4CNN-PP3B-PI4O-43PP-PPPP-P OEXR-32RG-ERUT-CP3X-PRP6-PP8I-P8F4-ONOP-PPDC-P OEXN-PTVM-LNJD-ZPNC-8O6C-PPCX-63G9-4P4P-PPRZ-P OEXP-62ZY-SPYB-9PPZ-ONPR-P3XC-UNLG-O6O6-PP3O-P OEXR-W2KV-2IRZ-6NCX-36PP-83RC-P6PP-PPNO-ZPPP-6" > /tmp/nbu651Lic # for lic in `cat /tmp/nbu651Lic` do echo "Installing Veritas License NBU 651 $lic" /usr/openv/netbackup/bin/admincmd/bpminlicense -add_keys $lic done # # echo "Veritas License for NBU Netbackup 651 installed" # # rm /tmp/nbu651Lic # # # # add upgrade license keys for NBU 701 # echo "OEXP-W28A-8J2T-OXO4-3PPP-PPN3-PRRP-P8CP-3P8P-R OEXD-RS8X-SBIN-4C6C-UPPP-PPC6-NNPP-N9PP-PNCN-P OEXD-RYAD-HBYD-4PP3-XPPP-PRC6-NNPP-PP34-CPPN-P OEXC-RTDF-Z2KD-8C4O-4CPP-PPCX-P33P-PPP8-O6PP-P OEXD-RVOA-4B9D-RPNN-PPPP-PN3P-RPPR-PPPP-PPPR-C OEXD-RYAX-SBIN-4C63-4PX6-PPD6-N6N3-XPPP-6PPN-P OEXD-RYAN-HBYD-4PP3-ZPPP-PRC6-NNPP-PP34-CPPN-P OEXR-WO2I-LO8B-OXP6-UPPP-PPXP-33PP-IZPP-P363-R OEXR-WOEK-EK8T-OPPE-PPPP-P6XP-3PPP-PPPP-PPP3-R OEXP-WDAM-8J2T-9XOZ-OZPP-PPN3-PRRP-P8CP-3P8P-R OEXD-RY8X-SBIN-4C6C-NPX6-PPD6-N6N3-XPPP-6PPN-P OEXP-3NZY-LJ3E-94C4-OX3N-P6PO-BPKS-OZ3Z-PNPW-6 OEXR-3DZG-E8UT-OZO4-O4PP-PPPC-6XNP-PPNO-SVPP-P OEXW-F2SM-8J2T-OXO4-PZPP-PPN3-PRRP-P8CP-3P8P-R OEXC-RWKY-Z2KD-8OPP-N3PP-PPCX-P33P-PPP8-O6PP-P OEXC-RWFY-Z2KD-8OPP-P3PP-PPCX-P33P-PPP8-O6PP-P OEXT-K2T4-E8UT-OZO4-O6PP-PPPC-6XNP-PPNO-SVPP-P OEXP-WDSA-8J2T-9XOZ-OPPP-PPN3-PRRP-P8CP-3P8P-R
18/02/2011 page
34
OEXN-RWEG-AOWD-8CPP-6CRR-PPCU-PL4O-ZCPP-RPPP-C OEXD-RSAD-HBYD-4PPO-UPPP-PCC6-NPPP-PPPP-PPPN-P OEXR-WLJK-EK8T-9PP6-9PP6-PPXP-3PPP-PPPP-PPP3-R OEXR-3DB4-E8UT-O4PP-PRPP-PPPC-6XNP-PPNO-SVPP-P OEXR-WOHK-EK8T-OPPX-WPPP-PCXP-3PPP-PPPP-NPP3-R OEXC-RWKF-Z2KD-4OPP-POPP-PPPX-P33P-P3ZP-NP36-P OEXR-WDDV-MIRT-O6PR-OPPP-PPRC-C66P-PP4K-E6PP-6 OEXC-RWDF-Z2KD-8OPP-NCPP-PPCX-P33P-PPP8-O6PP-P OEXP-WDAA-8J2T-9ZPP-OP3P-PPRJ-PAO4-ORPP-ORPP-R OEXR-WOLK-EK8T-9PPZ-WPPP-PPXP-3PP3-PPPP-PPP3-R OEXR-WOHI-EK8T-OPPX-9PPP-P6XP-3PPP-PPPP-PPP3-R OEXR-WOGI-LO8B-OXP6-PNPP-PP3P-IP38-3PPN-PPP3-R OEXR-WDKX-MIRT-O8OR-3PPP-PPRC-P66P-P4PP-CPZP-6 OEXW-F2AM-8JM7-MH4K-GZPP-PNN3-PRPP-PPPP-PPPP-R OEXW-K8ZF-LJ3E-94C4-O6CN-P6PO-BPKS-OZ3Z-PNPW-6 OEXR-WLLI-EK8T-OPP6-UPPP-PCXP-3PPP-PPPP-NPP3-R OEXW-F24M-8J2T-9ZPN-PR33-PPRJ-PAO4-ORPP-3PPP-R OEXD-RS4N-HBYD-4PPO-VPPP-PPPP-NPPP-PPPP-P6PN-P OEXP-WDAA-8JM7-MH4K-76PP-PNN3-PRPP-PPPP-PPPP-R OEXC-RWKF-Z2KD-8OPP-NPPP-PPCX-P33P-PPP8-O6PP-P OEXT-K2ZG-E8UT-OZO4-OXPP-PPPC-6XNP-PPNO-SVPP-P OEXR-WDVV-MIRT-96PN-PPPP-PPRC-C66P-PP4K-E6PP-6 OEXC-RWFF-Z2KD-8OPP-PPPP-PPCX-P33P-PPP8-O6PP-P OEXR-WOEK-EK8T-OPPZ-UPPP-PPPP-3PPP-PPPP-NPP3-R OEXP-3NBF-LJ3E-94C4-OXON-P6P3-BPKS-OZ3Z-PNPW-6 OEXR-3DR4-E8UT-9ZO4-ORPP-PPPC-6XNP-PPNO-SVPP-P OEXC-RWDY-Z2KD-8OPP-NOPP-PPCX-P33P-PPP8-O6PP-P OEXP-3NZY-LJ3E-94C4-OXCN-P6P3-BPKS-OZ3Z-PNPW-6 OEXP-R3D8-GCAX-8OXO-4PP3-NPPR-JPSL-4C8C-P3N8-P OEXP-WDAM-8J2T-9ZPP-CZ3P-PPRJ-PAO4-ORPP-ORPP-R OEXW-F2SM-8J2T-9ZPP-OZ33-PPRJ-PAO4-ORPP-3PPP-R OEXP-WD4A-8J2T-9XOZ-O6PP-PPN3-PRRP-P8CP-3P8P-R OEXP-WD8M-8J2T-9XO4-PRPP-PPN3-PRRP-P8CP-3P8P-R OEXP-R3K8-GCAX-8OXO-ZOR3-NPPZ-JPSL-4C8C-P3N8-P OEXD-RYSN-HBYD-4PP3-RPPP-PRC6-NNPP-PP34-CPPN-P OEXR-WO7I-LO8B-OXP8-CNPP-PP3P-IP38-3PPN-PPP3-R OEXD-RS8N-HBYD-4PPL-4PPP-PCC6-NPPP-PPPP-PPPN-P OEXF-2SSX-SBIN-8C6C-8PX6-PPD6-N6N3-XPPP-6PPN-P OEXP-3NRF-LJ3E-94C4-OZ3N-P6P3-BPKS-OZ3Z-PNPW-6 OEXP-3NRF-LJ3E-94C4-OZPN-P6PO-BPKS-OZ3Z-PNPW-6 OEXR-WLJI-EK8T-9PPX-6PP6-PPXP-3PPP-PPPP-PPP3-R OEXT-K2TG-E8UT-OZO4-O8PP-PPPC-6XNP-PPNO-SVPP-P" > /tmp/nbu701Lic # for lic in `cat /tmp/nbu701Lic` do echo "Installing Veritas License NBU 701 $lic" /usr/openv/netbackup/bin/admincmd/bpminlicense -add_keys $lic done # # echo "Veritas License for NBU Netbackup 701 installed" # # rm /tmp/nbu701Lic
2. Add execute permission for root, make sure NetBackup is running and execute the script
# chmod u+x /usr/openv/netbackup/cs_goodies/installCSNetBackup_license.sh # /usr/openv/netbackup/cs_goodies/installCSNetBackup_license.sh Installing Veritas License NBU 651 OEXN-RTL4-BOWC-PPZO-8PPP-PR3R-RCPP-PPO4-WCPP-C <16>bpminlicense main: Key <OEXN-RTL4-BOWC-PPZO-8PPP-PR3R-RCPP-PPO4-WCPP-C> already exists. the entity already exists . . . Installing Veritas License NBU 701 OEXT-K2TG-E8UT-OZO4-O8PP-PPPC-6XNP-PPNO-SVPP-P Veritas License for NBU Netbackup 701 installed
18/02/2011 page
35
3. Set maximum shared memory IDs available to the "NetBackup" project to 256
# /usr/sbin/projmod -a -K 'project.max-shm-ids=(privileged,256,deny)' NetBackup
5. Set maximum message queue IDs available to the "NetBackup" project to 256
# projmod -a -K 'project.max-msg-ids=(privileged,256,deny)' NetBackup
6. Set maximum shared memory for the NetBackup project to 50% of the system memory size Verify size: system memory
System memory size is 32GB, shared memory for the NetBackup project shall be 16GB (=17179869184B):
# projmod -a -K 'project.max-shm-memory=(privileged,17179869184,deny)' NetBackup
18/02/2011 page
36
7. Stop and restart all NetBackup processes in order to activate above settings
# /etc/init.d/netbackup stop # bpps -a NB Processes -----------# if not successful, /usr/openv/netbackup/bin/bp.kill_all
MM Processes ------------
8. Verify above settings are active now Verification of the parameters set for the NetBackup project
# projects -l NetBackup NetBackup projid : 1000 comment: "NetBackup resource project" users : root groups : (none) attribs: project.max-msg-ids=(privileged,256,deny) project.max-sem-ids=(privileged,1024,deny) project.max-shm-ids=(privileged,256,deny) project.max-shm-memory=(privileged,17179869184,deny)
Verification of a sp ecific parameter for a specific process (in this case max shared memory for nbsl):
# prctl -P -t privileged -n project.max-shm-memory -i process `pgrep nbsl` process: 15398: /usr/openv/netbackup/bin/nbsl project.max-shm-memory privileged 17179869184 - deny -
Verification of the variance of all relevant parame ters for all Ne tBackup processes in `bpps a`:
(Copy/paste the whole text block in bold ) # bpps -a|egrep -v '(^NB|^MM|^--|^$)'|awk '{print $2}'|while read pid do prctl -P -t privileged -i process ${pid}|egrep '(project.max-shm-ids|project.max-semids|project.max-msg-ids|project.max-shm-memory)' done|sort|uniq project.max-msg-ids privileged 256 - deny project.max-sem-ids privileged 1024 - deny project.max-shm-ids privileged 256 - deny project.max-shm-memory privileged 17179869184 - deny
18/02/2011 page
37
WinZip
Extract to here
2. Run the installation of the NetBackup Java Console 7.0 start Run.. . . . Run Open: [ cmd ] <OK > . C:\WINDOWS\system32\cmd.exe
bold
C:\> %SystemRoot%\System32\msiexec.exe /i "C:\Temp\JavaConsole_7.0.1\x86\Symantec NetBackup Java.msi" TRANSFORMS="Symantec_NetBackup_7_0_TSE_ENG.mst" REBOOT=ReallySuppress ALLUSERS=1 SILENTINSTALL=1 INSTALLDIR="C:\Program Files\Symantec\NetBackupJava_7_0_1_ENG" /l*v C:\Temp\JavaConsole_7.0.1\InstallVeritas_NetBackup_Java_7_0_0_TSE_EN_v1.00.Log /qb!"
18/02/2011 page
38
3. Run the installation of the NetBackup Java Console 7.0.1 patch . C:\WINDOWS\system32\cmd.exe .
bold
C:\> %SystemRoot%\System32\msiexec.exe /i "C:\Temp\JavaConsole_7.0.1\x86\Patch\NetBackup Update.msi" TRANSFORMS="Symantec_NetBackup_Java_Console_7_0_1_TSE_ENG.mst" REBOOT=ReallySuppress ALLUSERS=1 SILENTINSTALL=1 INSTALLDIR="C:\Program Files\Symantec\NetBackupJava_7_0_1_ENG" /l*v C:\Temp\JavaConsole_7.0.1\InstallVeritas_NetBackup_Java_7_0_1_TSE_EN_v1.00.Log /qb! C:\> copy C:\Temp\JavaConsole_7.0.1\x86\"NetBackup Java Console 7.0.1.lnk" C:\"Documents and Settings"\"All Users"\Desktop 1 file(s) copied.
Check log file " C:\Temp\JavaConsole_7.0.1\InstallVeritas_NetBackup_Java_7_0_1_TSE_EN_v1.00.Log" 4. Launch the NetBackup Java Console 7.0.1 start All Programs VERITAS . NetBackup Administration NetBackup Console NetBackup - Java Version 7.0 .
18/02/2011 page
39
bold
Check log " C:\Temp\JavaConsole_7.0.1\UninstallSymantec_NetBackup_Java_Patch_7_0_1_TSE_EN_v1.00.Log" 2. Run the uninstallation of the NetBackup Java Console 7.0 . C:\WINDOWS\system32\cmd.exe .
bold
18/02/2011 page
40