Oracle 18c ASM Data-guard Upgrade From 12.1.0.2 to 18.3.0.0.0 - Manual

In this article we will be performing Oracle 12g to 18c database upgrade with data guard and ASM configured.

Below are the steps we are going to follow to perform the database upgrade:

1. Upgrade GRID_HOME on standby

2. Upgrade GRID_HOME on primary

Upgrade GRID_HOME on Standby

DISABLE DG BROKER (only on primary)

1. Disable fast-start failover: As part of upgrade, you must disable DG Broker. Disable fast-start failover if it is enabled

DGMGRL> DISABLE FAST_START FAILOVER;

2. Disable DG BROKER configuration

DGMGRL> DISABLE CONFIGURATION;

3. Disable DG BROKER START via sqlplus

SQL> ALTER SYSTEM SET DG_BROKER_START=FALSE;

4. Take backup of broker configuration files: At this stage, it’s good to take backup of dg broker configuration files.

SQL> show parameter dg_broker_config_file;

>> Make a copy of broker configuration files into some backup location /u01 or /u02

ON STANDBY:

12c Grid Home location :

1. Stop MRP or Log Apply Services:

We must stop MRP. Note, we are not stopping log shipping from primary. Log shipping will continue.

SQL> alter database recover managed standby database cancel;

SQL> shutdown immediate;

2. Disable oracle restart (srvctl):

We must remove database from srvctl utility as it might auto restart database during upgrade process which we do not want. Once upgrade is done, we will re-register database with 12c srvctl utility

3. Download and upgrade oracle 18c grid software (as grid user):

We will now download and upgrade oracle 18c grid software in a new grid home location. Note, you cannot have two grid softwares on a server. Hence, you can only upgrade any previous version of grid.

4. Unzip linux 18c grid software

Preparation:

Keep following detail for later

[grid@rac7 ~]$ srvctl config asm

ASM home: <CRS home>

Password file: +DATA/orapwasm

ASM listener: LISTENER

Spfile: +DATA/ASM/ASMPARAMETERFILE/registry.253.1034431969

ASM diskgroup discovery string:

Create NEW directory for NEW Oracle Grid home:

Stop ASM and DB (Standby Server) :

SHUTDOWN DB FROM ASM HOME

grid@rac7] srvctl stop listener -l LISTENER

$] sqlplus '/as sysasm'

SQL> shut immediate;

grid@rac7] crsctl stop has

As root user Standby Server install rpm cvuqdisk-1.0.10-1.rpm:

[root@rac7 ~]# cd /u02/app/18.3.0/grid

[root@rac7 grid]#

[root@rac7 grid]# cd cv/rpm

[root@rac7 rpm]# ls -lrt

total 12

-rw-r--r-- 1 grid oinstall 8860 Jul 14 2018 cvuqdisk-1.0.10-1.rpm

[root@rac7 rpm]#

[root@rac7 rpm]# rpm -Uvh cvuqdisk-1.0.10-1.rpm

Preparing... ################################# [100%]

Updating / installing...

1:cvuqdisk-1.0.10-1 ################################# [100%]

STARTING with Upgrade at Standby Server:

I am using MobaXterm for X display

unset ORACLE_BASE

unset ORACLE_HOME

unset ORACLE_SID

[grid@rac7 OPatch]$ ./opatch version

OPatch Version: 12.2.0.1.19

OPatch succeeded.

[grid@rac7 OPatch]$

[grid@rac7 OPatch]$ ./opatch lsinventory

Oracle Interim Patch Installer version 12.2.0.1.19

Oracle Home : /u02/app/12.1.0/grid

Central Inventory : /u01/app/oraInventory

from : /u02/app/12.1.0/grid/oraInst.loc

OPatch version : 12.2.0.1.19

OUI version : 12.1.0.2.0

Log file location : /u02/app/12.1.0/grid/cfgtoollogs/opatch/opatch2020-03-08_17-24-35PM_1.log

Lsinventory Output file location : /u02/app/12.1.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2020-03-08_17-24-35PM.txt

--------------------------------------------------------------------------------

Local Machine Information::

Hostname: rac7.samik.com

ARU platform id: 226

ARU platform description:: Linux x86-64

Installed Top-level Products (1):

Oracle Grid Infrastructure 12c 12.1.0.2.0

There are 1 products installed in this Oracle Home.

There are no Interim patches installed in this Oracle Home.

--------------------------------------------------------------------------------

OPatch succeeded.

[grid@rac7 OPatch]$ opatch lsinventory -detail

Oracle Interim Patch Installer version 12.2.0.1.19

Oracle Home : /u02/app/12.1.0/grid

Central Inventory : /u01/app/oraInventory

from : /u02/app/12.1.0/grid/oraInst.loc

OPatch version : 12.2.0.1.19

OUI version : 12.1.0.2.0

Log file location : /u02/app/12.1.0/grid/cfgtoollogs/opatch/opatch2020-03-08_18-16-58PM_1.log

Lsinventory Output file location : /u02/app/12.1.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2020-03-08_18-16-58PM.txt

--------------------------------------------------------------------------------

Local Machine Information::

Hostname: rac7.samik.com

ARU platform id: 226

ARU platform description:: Linux x86-64

Installed Top-level Products (1):

Oracle Grid Infrastructure 12c 12.1.0.2.0

There are 1 products installed in this Oracle Home.

Installed Products (101):

Assistant Common Files 12.1.0.2.0

Automatic Storage Management Assistant 12.1.0.2.0

Buildtools Common Files 12.1.0.2.0

Cluster Ready Services Files 12.1.0.2.0

Cluster Verification Utility Common Files 12.1.0.2.0

Cluster Verification Utility Files 12.1.0.2.0

Database Configuration and Upgrade Assistants 12.1.0.2.0

Database Migration Assistant for Unicode 12.1.0.2.0

Database SQL Scripts 12.1.0.2.0

DB TOOLS Listener 12.1.0.2.0

Deinstallation Tool 12.1.0.2.0

Expat libraries 2.0.1.0.2

Hadoopcore Component 12.1.0.2.0

HAS Common Files 12.1.0.2.0

HAS Files for DB 12.1.0.2.0

Installation Common Files 12.1.0.2.0

Installation Plugin Files 12.1.0.2.0

Installer SDK Component 12.1.0.2.0

Java Development Kit 1.6.0.75.0

LDAP Required Support Files 12.1.0.2.0

OLAP SQL Scripts 12.1.0.2.0

Oracle Advanced Security 12.1.0.2.0

Oracle Bali Share 11.1.1.6.0

Oracle Clusterware RDBMS Files 12.1.0.2.0

Oracle Configuration Manager Deconfiguration 10.3.1.0.0

Oracle Containers for Java 12.1.0.2.0

Oracle Core Required Support Files 12.1.0.2.0

Oracle Core Required Support Files for Core DB 12.1.0.2.0

Oracle Database 12c 12.1.0.2.0

Oracle Database 12c Multimedia Files 12.1.0.2.0

Oracle Database Deconfiguration 12.1.0.2.0

Oracle Database User Interface 11.0.0.0.0

Oracle Database Utilities 12.1.0.2.0

Oracle DBCA Deconfiguration 12.1.0.2.0

Oracle Extended Windowing Toolkit 11.1.1.6.0

Oracle Globalization Support 12.1.0.2.0

Oracle Globalization Support For Core 12.1.0.2.0

Oracle Grid Infrastructure 12c 12.1.0.2.0

Oracle Grid Infrastructure Bundled Agents 12.1.0.2.0

Oracle Grid Management Database 12.1.0.2.0

Oracle Help for Java 11.1.1.7.0

Oracle Help Share Library 11.1.1.7.0

Oracle Ice Browser 11.1.1.7.0

Oracle Internet Directory Client 12.1.0.2.0

Oracle Java Client 12.1.0.2.0

Oracle Java Layout Engine 11.0.0.0.0

Oracle JDBC/OCI Instant Client 12.1.0.2.0

Oracle JDBC/THIN Interfaces 12.1.0.2.0

Oracle JFC Extended Windowing Toolkit 11.1.1.6.0

Oracle JVM 12.1.0.2.0

Oracle JVM For Core 12.1.0.2.0

Oracle LDAP administration 12.1.0.2.0

Oracle Locale Builder 12.1.0.2.0

Oracle Multimedia 12.1.0.2.0

Oracle Multimedia Client Option 12.1.0.2.0

Oracle Multimedia Java Advanced Imaging 12.1.0.2.0

Oracle Multimedia Locator 12.1.0.2.0

Oracle Multimedia Locator Java Required Support Files 12.1.0.2.0

Oracle Multimedia Locator RDBMS Files 12.1.0.2.0

Oracle Net 12.1.0.2.0

Oracle Net Java Required Support Files 12.1.0.2.0

Oracle Net Listener 12.1.0.2.0

Oracle Net Required Support Files 12.1.0.2.0

Oracle Netca Client 12.1.0.2.0

Oracle Notification Service 12.1.0.2.0

Oracle Notification Service (eONS) 12.1.0.2.0

Oracle Notification Service for Instant Client 12.1.0.2.0

Oracle One-Off Patch Installer 12.1.0.1.2

Oracle Quality of Service Management (Client) 12.1.0.2.0

Oracle Quality of Service Management (Server) 12.1.0.2.0

Oracle RAC Deconfiguration 12.1.0.2.0

Oracle RAC Required Support Files-HAS 12.1.0.2.0

Oracle Recovery Manager 12.1.0.2.0

Oracle Security Developer Tools 12.1.0.2.0

Oracle Text Required Support Files 12.1.0.2.0

Oracle Universal Connection Pool 12.1.0.2.0

Oracle Universal Installer 12.1.0.2.0

Oracle USM Deconfiguration 12.1.0.2.0

Oracle Wallet Manager 12.1.0.2.0

oracle.swd.oui.core.min 12.1.0.2.0

Parser Generator Required Support Files 12.1.0.2.0

Perl Interpreter 5.14.1.0.0

Perl Modules 5.14.1.0.0

PL/SQL 12.1.0.2.0

PL/SQL Embedded Gateway 12.1.0.2.0

Platform Required Support Files 12.1.0.2.0

Precompiler Required Support Files 12.1.0.2.0

RDBMS Required Support Files 12.1.0.2.0

RDBMS Required Support Files for Instant Client 12.1.0.2.0

RDBMS Required Support Files Runtime 12.1.0.2.0

Required Support Files 12.1.0.2.0

Secure Socket Layer 12.1.0.2.0

SQL*Plus 12.1.0.2.0

SQL*Plus Files for Instant Client 12.1.0.2.0

SQL*Plus Required Support Files 12.1.0.2.0

SSL Required Support Files for InstantClient 12.1.0.2.0

Tracle File Analyzer 12.1.0.2.0

Universal Storage Manager Files 12.1.0.2.0

XDK Required Support Files 12.1.0.2.0

XML Parser for Java 12.1.0.2.0

There are 101 products installed in this Oracle Home.

There are no Interim patches installed in this Oracle Home.

--------------------------------------------------------------------------------

OPatch succeeded.

[grid@rac7 OPatch]$

Patching Issue:

[grid@rac7 ~]$ /u02/app/12.1.0/grid/OPatch/opatch apply -oh /u02/app/12.1.0/grid -local /backup/soft/21255373/21255373

Oracle Interim Patch Installer version 12.2.0.1.19

Oracle Home : /u02/app/12.1.0/grid

Central Inventory : /u01/app/oraInventory

from : /u02/app/12.1.0/grid/oraInst.loc

OPatch version : 12.2.0.1.19

OUI version : 12.1.0.2.0

Log file location : /u02/app/12.1.0/grid/cfgtoollogs/opatch/opatch2020-03-08_18-32-03PM_1.log

OPatch failed to lock and get an Inventory Session for the given Oracle Home /u02/app/12.1.0/grid

Possible causes are:

No read or write permission to $ORACLE_HOME, cannot create $ORACLE_HOME/.patch_storage

No read or write permission to $ORACLE_HOME/.patch_storage

OPatch cannot proceed further because system will not be able to backup files, or read the backup area for rollback/restore.

OPatchSession cannot load inventory for the given Oracle Home /u02/app/12.1.0/grid. Possible causes are:

No read or write permission to ORACLE_HOME/.patch_storage

Central Inventory is locked by another OUI instance

No read permission to Central Inventory

The lock file exists in ORACLE_HOME/.patch_storage

The Oracle Home does not exist in Central Inventory

UtilSession failed: IPMRWServices::verifyPatchStorageDirectory() cannot read or write to /u02/app/12.1.0/grid/.patch_storage

Log file location: /u02/app/12.1.0/grid/cfgtoollogs/opatch/opatch2020-03-08_18-32-03PM_1.log

OPatch failed with error code 73

Solution:

[root@rac7 install]# cd /

[root@rac7 /]#

[root@rac7 /]# find . -name Env.pm -print

./u01/app/oracle/product/12.1.0.2/db_1/perl/lib/5.14.1/Env.pm

./u01/app/oracle/product/12.2.0.1/db_1/perl/lib/5.22.0/Env.pm

./u01/app/oracle/product/12.2.0.1/db_1/perl/lib/5.22.0/TAP/Harness/Env.pm

./u02/app/12.1.0/grid/perl/lib/5.14.1/Env.pm

./u02/app/18.3.0/grid/perl/lib/5.22.0/Env.pm

./u02/app/18.3.0/grid/perl/lib/5.22.0/TAP/Harness/Env.pm

./u02/PostgreSQL/pl-languages/Perl-5.26/lib/Env.pm

./u02/PostgreSQL/pl-languages/Perl-5.26/lib/TAP/Harness/Env.pm

[root@rac7 /]#

[root@rac7 /]# cd /usr/lib64/perl5/vendor_perl/

[root@rac7 vendor_perl]#

[root@rac7 vendor_perl]# ls -lrt

total 564

-rw-r--r--. 1 root root 21761 Jan 16 2013 Cwd.pm

-rw-r--r--. 1 root root 20519 Apr 30 2013 encoding.pm

-rw-r--r--. 1 root root 311474 May 17 2013 DBI.pm

-rw-r--r--. 1 root root 35311 May 29 2013 threads.pm

-rw-r--r--. 1 root root 36326 Jun 25 2013 Socket.pm

-rw-r--r--. 1 root root 43133 Jul 13 2013 Storable.pm

-rwxr-xr-x. 1 root root 1542 May 3 2014 dbixs_rev.pl

-rw-r--r--. 1 root root 32947 May 3 2014 Encode.pm

drwxr-xr-x. 7 root root 4096 Aug 3 2019 Encode

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Scalar

drwxr-xr-x. 3 root root 4096 Aug 3 2019 List

drwxr-xr-x. 3 root root 4096 Aug 3 2019 Filter

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Time

drwxr-xr-x. 2 root root 4096 Aug 3 2019 threads

drwxr-xr-x. 3 root root 4096 Aug 3 2019 File

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Data

drwxr-xr-x. 3 root root 4096 Aug 3 2019 Compress

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Bundle

drwxr-xr-x. 8 root root 4096 Aug 3 2019 DBI

drwxr-xr-x. 5 root root 4096 Aug 3 2019 DBD

drwxr-xr-x. 15 root root 4096 Aug 3 2019 auto

[root@rac7 vendor_perl]# cd

[root@rac7 ~]#

[root@rac7 ~]# cp /u02/app/12.1.0/grid/perl/lib/5.14.1/Env.pm /usr/lib64/perl5/vendor_perl/

[root@rac7 ~]#

[root@rac7 ~]# cd /usr/share/perl5/vendor_perl/

[root@rac7 vendor_perl]#

[root@rac7 vendor_perl]# ls -lrt

total 120

-rw-r--r--. 1 root root 2206 Jul 9 2010 newgetopt.pl

-rw-r--r--. 1 root root 2902 Mar 8 2011 parent.pm

-rw-r--r--. 1 root root 20408 Jun 18 2012 Carp.pm

-rw-r--r--. 1 root root 8448 Jan 28 2013 perldoc.pod

-rw-r--r--. 1 root root 18752 Mar 27 2013 Exporter.pm

-rw-r--r--. 1 root root 13353 May 1 2014 constant.pm

drwxr-xr-x. 2 root root 4096 Aug 3 2019 HTTP

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Text

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Exporter

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Time

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Carp

drwxr-xr-x. 2 root root 4096 Aug 3 2019 File

drwxr-xr-x. 5 root root 4096 Aug 3 2019 Pod

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Getopt

drwxr-xr-x. 3 root root 4096 Aug 3 2019 Net

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Bundle

drwxr-xr-x. 4 root root 4096 Aug 3 2019 RPC

[root@rac7 vendor_perl]# cd

[root@rac7 ~]#

[root@rac7 ~]# cp /u02/app/12.1.0/grid/perl/lib/5.14.1/Env.pm /usr/share/perl5/vendor_perl/

[root@rac7 ~]#

[root@rac7 ~]# cd /usr/share/perl5/vendor_perl/

[root@rac7 vendor_perl]# ls -lrt

total 128

-rw-r--r--. 1 root root 2206 Jul 9 2010 newgetopt.pl

-rw-r--r--. 1 root root 2902 Mar 8 2011 parent.pm

-rw-r--r--. 1 root root 20408 Jun 18 2012 Carp.pm

-rw-r--r--. 1 root root 8448 Jan 28 2013 perldoc.pod

-rw-r--r--. 1 root root 18752 Mar 27 2013 Exporter.pm

-rw-r--r--. 1 root root 13353 May 1 2014 constant.pm

drwxr-xr-x. 2 root root 4096 Aug 3 2019 HTTP

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Text

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Exporter

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Time

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Carp

drwxr-xr-x. 2 root root 4096 Aug 3 2019 File

drwxr-xr-x. 5 root root 4096 Aug 3 2019 Pod

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Getopt

drwxr-xr-x. 3 root root 4096 Aug 3 2019 Net

drwxr-xr-x. 2 root root 4096 Aug 3 2019 Bundle

drwxr-xr-x. 4 root root 4096 Aug 3 2019 RPC

-rwxr-x--- 1 root root 5531 Mar 8 18:45 Env.pm

[root@rac7 vendor_perl]# cd

[root@rac7 ~]#

[root@rac7 ~]# /u02/app/12.1.0/grid/crs/install/roothas.pl -prepatch

Using configuration parameter file: /u02/app/12.1.0/grid/crs/install/crsconfig_params

2020/03/08 18:46:31 CLSRSC-347: Successfully unlock /u02/app/12.1.0/grid

[grid@rac7 ~]$ /u02/app/12.1.0/grid/OPatch/opatch apply -oh /u02/app/12.1.0/grid -local /backup/soft/21255373/21255373

Oracle Interim Patch Installer version 12.2.0.1.19

Oracle Home : /u02/app/12.1.0/grid

Central Inventory : /u01/app/oraInventory

from : /u02/app/12.1.0/grid/oraInst.loc

OPatch version : 12.2.0.1.19

OUI version : 12.1.0.2.0

Log file location : /u02/app/12.1.0/grid/cfgtoollogs/opatch/opatch2020-03-08_19-04-53PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 21255373

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/u02/app/12.1.0/grid')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '21255373' to OH '/u02/app/12.1.0/grid'

Patching component oracle.crs, 12.1.0.2.0...

Patching component oracle.has.db, 12.1.0.2.0...

Patching component oracle.has.common, 12.1.0.2.0...

Patch 21255373 successfully applied.

Log file location: /u02/app/12.1.0/grid/cfgtoollogs/opatch/opatch2020-03-08_19-04-53PM_1.log

OPatch succeeded.

[grid@rac7 ~]$

After Patching check Inventory output

[grid@rac7 OPatch]$ ./opatch lsinventory

Oracle Interim Patch Installer version 12.2.0.1.19

Oracle Home : /u02/app/12.1.0/grid

Central Inventory : /u01/app/oraInventory

from : /u02/app/12.1.0/grid/oraInst.loc

OPatch version : 12.2.0.1.19

OUI version : 12.1.0.2.0

Log file location : /u02/app/12.1.0/grid/cfgtoollogs/opatch/opatch2020-03-08_19-13-26PM_1.log

Lsinventory Output file location : /u02/app/12.1.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2020-03-08_19-13-26PM.txt

--------------------------------------------------------------------------------

Local Machine Information::

Hostname: rac7.samik.com

ARU platform id: 226

ARU platform description:: Linux x86-64

Installed Top-level Products (1):

Oracle Grid Infrastructure 12c 12.1.0.2.0

There are 1 products installed in this Oracle Home.

Interim patches (1) :

Patch 21255373 : applied on Sun Mar 08 19:07:11 IST 2020

Unique Patch ID: 19853332

Patch description: "OCW Patch Set Update : 12.1.0.2.0 (21255373)"

Created on 18 Sep 2017, 08:26:25 hrs PST8PDT

Bugs fixed:

21339083, 19701617, 18589889, 20768643, 19280860, 19139608, 19061429

19133945, 19521169, 19341538, 20011424, 18946768, 19135521, 18604143

19361757, 19187207, 19627476, 19302350, 19130141, 19530755, 20317221

20177779, 19699720, 19266658, 19168690, 18899171, 19244316, 19653795

18330979, 19471722, 19027351, 18634372, 21227730, 19536337, 18707416

19184188, 19131709, 21113068, 20235486, 20160490, 19925992, 20995001

20006646, 18991776, 18439295, 19380733, 21245437, 20552947, 18943696

19591984, 19550195, 19163425, 18135723, 20014326, 19524857, 18849021

18890943, 18861196, 19154753, 17940721, 19522313, 18748932, 18835283

19184765, 19499021, 20923930, 19046190, 14851828, 19051385, 19682695

19050688, 19831611, 20598625, 19226141, 19053891, 18871287, 18998228

18980002, 18922918, 19683886, 18956780, 19325604, 19026993, 18777835

17338864, 18261648, 18945906, 19513650, 20185476, 19702758, 18952577

18882642, 19414274, 17447588, 20752167, 19262534, 19147513, 21242118

19473088, 20758997, 19178517, 18729269, 19659885, 19529729, 19455563

20877072, 19319904, 18703978, 20340620, 18536826, 19700256, 19703246

19292605, 20467806, 19192901, 21527118, 20660273, 20011635, 17592037

19479503, 19147751, 19029647, 19179158, 18901356, 19140712, 20012766

21232394, 18964974, 18835366, 19184276, 19207286, 19013789, 20510208

20001507, 18950232, 20079414, 19680763, 19259765, 19148791, 19556820

19449737, 18962892, 21646169, 19187515, 19513888, 19230771, 14661880

21519340, 21222147, 20795241, 20218012, 19853036, 19453778, 19551830

21616278, 19068333, 18843572, 18520351, 19185148, 18945435, 20775015

19232454, 18541110, 19319192, 18834955, 19204743, 20839581, 19178629

19304104, 19140891, 18747335, 20676340, 19457575, 19270660, 21297657

19069755, 19021575, 18715884, 19584688, 18798573, 19812592, 19018001

19325701, 19292272, 19270956, 20877003, 19222693, 18700893, 21276514

19662663, 18406774, 19684131, 19010177, 21082737, 19272663, 18907170

18910576, 19426384, 9372680, 20883009, 19700294, 19164099, 20289828

19331454, 19155350, 20119857, 19703199, 18508710, 18955644, 19908346

18798432, 19146822, 21123424, 19589221, 19471836, 19537762, 16286734

20669114, 18762843, 18945249, 19045143, 19146980, 19184799, 19601003

19205086, 20099624, 19351363, 21378016, 20091753, 19537547, 18862203

19281106, 19031737, 19079087, 18968981, 19148367, 19150517, 20231741

19954372, 19217019, 18730096, 18235274, 18975620, 19205617, 19513351

20219458, 18843054, 19150313, 18708349, 18953639, 19332386, 21423055

21259359, 19067804, 19371270, 19203996, 20038431, 18747382, 19054979

19209951, 19318983, 19154673, 18752378, 19150088, 19370846, 19013444

21053036, 19234177, 18998379, 20157569, 18999857, 19273577, 19075747

19367276, 19632437, 19874047, 19612597, 18990354, 19288396, 19557558

19427050, 19127078, 18910443, 20053557, 20033787, 19315567, 19444471

19148982, 18290252, 19915945, 18813323, 19777496, 19500293, 18643483

18523468, 19134098, 19277814, 20562133, 21420753, 19071526, 18965694

19226858, 18850051, 19602208, 19591356, 20061168, 18417590, 19370739

18920408, 19609388, 18636884, 20136892, 18776786, 18989446, 19148793

19043795, 19585454, 20746507, 19955755, 18317489, 18260170, 18919682

19059053, 19807548, 18678829, 19124972, 19617592, 18910748, 18849896

19147509, 18953878, 19076165, 19273758, 19319357, 19704993, 19498411

18999195, 18759724, 19459023, 20634511, 21474380, 20276459, 19066844

17208793, 19234907, 20290467, 13843841, 19538714, 19649640, 19383028

19062675, 19513969, 18859710, 20862812, 19504641, 19341481, 20293730

19986391, 18304090, 19343245, 19314048, 19473851, 18834934, 19241655

18242738, 19458082, 19470791, 18894342, 20649573, 18372060, 19522067

18953889, 18827679, 19023430, 19140711, 19259290, 19045388, 20186278

19241857, 19522571, 19076778, 19709663, 18875012, 18861564, 19066699

19273760, 19225265, 20853464, 21696068, 18819158, 19068003, 18937186

21394146, 19916737, 19049721, 19368917, 21255373, 19635215, 20408163

18868829, 22024217, 20783416, 19315522, 19141785, 19885321, 19163887

19820247, 20363708, 18852058, 18715868, 19538241, 19804032

--------------------------------------------------------------------------------

OPatch succeeded.

[root@rac7 install]# ./roothas.pl -unlock

Using configuration parameter file: ./crsconfig_params

2020/03/09 09:15:50 CLSRSC-347: Successfully unlock /u02/app/12.1.0/grid

[root@rac7 install]#

[root@rac7 install]# ./roothas.pl -patch

Using configuration parameter file: ./crsconfig_params

CRS-4123: Oracle High Availability Services has been started.

VIMP:

In 12.2, users must use rootcrs.sh -prepatch and rootcrs.sh -postpatch for manual patching.

difference between roothas.pl and rootcrs.pl

Both resides in $GRID_HOME/oui/bin

roothas.pl will be useful or used when you run the grid infrastructure in standalone mode (single node Cluster)

rootcrs.pl will be useful or used when you run the grid infrastructure in normal mode (normal cluster comprising of one or more node)

Again Starting Grid Upgradation to 18c now:

[root@rac7 ~]# /u02/app/18.3.0/grid/rootupgrade.sh

Performing root user operation.

The following environment variables are set as:

ORACLE_OWNER= grid

ORACLE_HOME= /u02/app/18.3.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The contents of "dbhome" have not changed. No need to overwrite.

The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n)

[n]:

The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n)

[n]:

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root script.

Now product-specific root actions will be performed.

Using configuration parameter file: /u02/app/18.3.0/grid/crs/install/crsconfig_params

The log of current session can be found at:

/u02/app/grid/crsdata/rac7/crsconfig/roothas_2020-03-08_07-25-30PM.log

2020/03/08 19:25:32 CLSRSC-595: Executing upgrade step 1 of 12: 'UpgPrechecks'.

2020/03/08 19:25:34 CLSRSC-363: User ignored prerequisites during installation

2020/03/08 19:25:36 CLSRSC-595: Executing upgrade step 2 of 12: 'GetOldConfig'.

2020/03/08 19:25:55 CLSRSC-318: Failed to start Oracle OHASD service

Died at /u02/app/18.3.0/grid/crs/install/crsupgrade.pm line 6104.

[root@rac7 ~]#

[root@rac7 bin]# ./crsctl start has

CRS-6705: Oracle Clusterware Release Version ('18.0.0.0.0') does not match Software Version ('12.1.0.2.0'). Oracle Clusterware cannot be started.

CRS-4000: Command Start failed, or completed with errors.

[root@rac7 bin]#

[root@rac7 bin]# pwd

/u02/app/18.3.0/grid/bin

[root@rac7 bin]# cd ../../..

[root@rac7 app]# ls -lrt

total 12

drwxr-xr-x. 3 grid oinstall 4096 Mar 6 23:30 12.1.0

drwxr-xr-x 3 root root 4096 Mar 8 04:17 18.3.0

drwxr-xr-x. 9 grid oinstall 4096 Mar 8 19:21 grid

[root@rac7 app]# cd 12.1.0

[root@rac7 12.1.0]# cd grid

[root@rac7 grid]# cd bin

[root@rac7 bin]#

[root@rac7 bin]# ./crsctl start has

CRS-6706: Oracle Clusterware Release patch level ('3544584551') does not match Software patch level ('0'). Oracle Clusterware cannot be started.

CRS-4000: Command Start failed, or completed with errors.

[root@rac7 bin]#

[root@rac7 install]# ./roothas.pl -unlock

Using configuration parameter file: ./crsconfig_params

2020/03/09 09:15:50 CLSRSC-347: Successfully unlock /u02/app/12.1.0/grid

[root@rac7 install]#

[root@rac7 install]# ./roothas.pl -patch

Using configuration parameter file: ./crsconfig_params

CRS-4123: Oracle High Availability Services has been started.

[root@rac7 install]#

[root@rac7 install]# pwd

/u02/app/12.1.0/grid/crs/install

[root@rac7 install]#

Now Same Patch is going to Apply on rac6 (Primary Server - RAC6 )

[root@rac6 grid]# pwd

/u02/app/12.1.0/grid

[root@rac6 grid]# /u02/app/12.1.0/grid/OPatch/opatch apply /backup/soft/21255373/21255373 -analyze -oh /u02/app/12.1.0/grid

The user is root. OPatch cannot continue if the user is root.

OPatch failed with error code 255

root@rac6 grid]#

[root@rac6 grid]#

Tried with Grid User as well

[grid@rac6 21255373]$ /u02/app/12.1.0/grid/OPatch/opatch apply /backup/soft/21255373/21255373 -analyze -oh /u02/app/12.1.0/grid

Oracle Interim Patch Installer version 12.2.0.1.19

Oracle Home : /u02/app/12.1.0/grid

Central Inventory : /u01/app/oraInventory

from : /u02/app/12.1.0/grid/oraInst.loc

OPatch version : 12.2.0.1.19

OUI version : 12.1.0.2.0

Log file location : /u02/app/12.1.0/grid/cfgtoollogs/opatch/opatch2020-03-12_01-19-08AM_1.log

OPatch failed to lock and get an Inventory Session for the given Oracle Home /u02/app/12.1.0/grid

Possible causes are:

No read or write permission to $ORACLE_HOME, cannot create $ORACLE_HOME/.patch_storage

No read or write permission to $ORACLE_HOME/.patch_storage

OPatch cannot proceed further because system will not be able to backup files, or read the backup area for rollback/restore.

OPatchSession cannot load inventory for the given Oracle Home /u02/app/12.1.0/grid. Possible causes are:

No read or write permission to ORACLE_HOME/.patch_storage

Central Inventory is locked by another OUI instance

No read permission to Central Inventory

The lock file exists in ORACLE_HOME/.patch_storage

The Oracle Home does not exist in Central Inventory

UtilSession failed: IPMRWServices::verifyPatchStorageDirectory() cannot read or write to /u02/app/12.1.0/grid/.patch_storage

Log file location: /u02/app/12.1.0/grid/cfgtoollogs/opatch/opatch2020-03-12_01-19-08AM_1.log

OPatch failed with error code 73

[root@rac6 ~]# /u02/app/18.3.0/grid/rootupgrade.sh

Performing root user operation.

The following environment variables are set as:

ORACLE_OWNER= grid

ORACLE_HOME= /u02/app/18.3.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The contents of "dbhome" have not changed. No need to overwrite.

The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n)

[n]: y

Copying oraenv to /usr/local/bin ...

The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n)

[n]: y

Copying coraenv to /usr/local/bin ...

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root script.

Now product-specific root actions will be performed.

Using configuration parameter file: /u02/app/18.3.0/grid/crs/install/crsconfig_params

The log of current session can be found at:

/u02/app/grid/crsdata/rac6/crsconfig/roothas_2020-03-15_04-06-53PM.log

2020/03/15 16:06:55 CLSRSC-595: Executing upgrade step 1 of 12: 'UpgPrechecks'.

2020/03/15 16:06:58 CLSRSC-595: Executing upgrade step 2 of 12: 'GetOldConfig'.

2020/03/15 16:07:02 CLSRSC-595: Executing upgrade step 3 of 12: 'GenSiteGUIDs'.

2020/03/15 16:07:02 CLSRSC-595: Executing upgrade step 4 of 12: 'SetupOSD'.

2020/03/15 16:07:02 CLSRSC-595: Executing upgrade step 5 of 12: 'PreUpgrade'.

ASM has been upgraded and started successfully.

2020/03/15 16:08:33 CLSRSC-595: Executing upgrade step 6 of 12: 'UpgradeAFD'.

2020/03/15 16:08:33 CLSRSC-595: Executing upgrade step 7 of 12: 'UpgradeOLR'.

Creating OCR keys for user 'grid', privgrp 'oinstall'..

Operation successful.

2020/03/15 16:08:39 CLSRSC-595: Executing upgrade step 8 of 12: 'UpgradeOCR'.

LOCAL ONLY MODE

Successfully accumulated necessary OCR keys.

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

CRS-4664: Node rac6 successfully pinned.

2020/03/15 16:08:41 CLSRSC-595: Executing upgrade step 9 of 12: 'CreateOHASD'.

2020/03/15 16:08:43 CLSRSC-595: Executing upgrade step 10 of 12: 'ConfigOHASD'.

2020/03/15 16:08:43 CLSRSC-329: Replacing Clusterware entries in file 'oracle-ohasd.service'

2020/03/15 16:09:31 CLSRSC-595: Executing upgrade step 11 of 12: 'UpgradeSIHA'.

CRS-4123: Oracle High Availability Services has been started.

rac6 2020/03/15 16:12:01 /u02/app/18.3.0/grid/cdata/rac6/backup_20200315_161201.olr 70732493

rac6 2020/03/07 03:04:41 /u02/app/12.1.0/grid/cdata/rac6/backup_20200307_030441.olr 0

2020/03/15 16:12:01 CLSRSC-595: Executing upgrade step 12 of 12: 'InstallACFS'.

CRS-4123: Oracle High Availability Services has been started.

rac6 2020/03/15 16:12:01 /u02/app/18.3.0/grid/cdata/rac6/backup_20200315_161201.olr 70732493

rac6 2020/03/07 03:04:41 /u02/app/12.1.0/grid/cdata/rac6/backup_20200307_030441.olr 0

2020/03/15 16:12:01 CLSRSC-595: Executing upgrade step 12 of 12: 'InstallACFS'.

CRS-4123: Oracle High Availability Services has been started.

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac6'

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac6' has completed

CRS-4133: Oracle High Availability Services has been stopped.

CRS-4123: Oracle High Availability Services has been started.

2020/03/15 16:15:13 CLSRSC-327: Successfully configured Oracle Restart for a standalone server

Amit's Oracle DBA Blog

Disclaimer

Sunday, 18 October 2020