This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
8 APPLY CPU PATCH (4751928)..............................................................................................................................37
APPENDIX A – DATABASE AND SERVICE.............................................................................................................39
APPENDIX B – DATABASE LISTENER.....................................................................................................................42
APPENDIX C – CRS RESOURCE................................................................................................................................43
APPENDIX D - /ETC/HOSTS........................................................................................................................................46
APPENDIX E – DATABASE SQLNET PARAMETER FILES.................................................................................47
APPENDIX F – ENTERPRISE MANAGER................................................................................................................53
APPENDIX G – CREATE NEW DATABASE.............................................................................................................55
APPENDIX H – DATABASE LINK..............................................................................................................................62
APPENDIX I – VCS CONFIGURATION FILE...........................................................................................................64
APPENDIX J – TEST TABLE FOR VCS ORACLE AGENT....................................................................................74
APPENDIX K – SETUP RSH FOR ORACLE INSTALLATION..............................................................................75
0.1 Revision HistoryVersion Author Review Reason For Issue Date
1.0A Eric Chan 1st Version 3rd Apr 2006
0.2 Document Distribution
Copy Owner Location / Address1
0.3 Document ReferencesRef Referenced Item1
0.4 Document Access Control
Section Access Restrictions
1 Introduction
This document is the installation guide of Oracle RAC installation project for the XXXX (HK) Limited.
XXXX is working on a project called “A.P.P.L.I.E.S” with Immigration Department of HKSAR Government as the enduser. The following is the environments in this project:
1. System Test Environment (“SIT”) which includesl Environment B (“Maintenance SIT”)l Environment F (“Development SIT”)
2. Integrated User Acceptance Test Environment (IUAT) which includesl Environment G (“IUAT”)l Environment C (“Maintenance UAT”)
3. Production Environment (“PROD”) (with Resilience Centre (“RC”) site)
The Service provides the XXXX with the installation and the configuration of Oracle 10g RAC for its Development SIT only (ie. Environment F)
2 Installation Steps
This section describes the overall steps to install Oracle 10g RAC database. The installation process divides into three parts; Oracle 10gR1 CRS, Oracle 10gR1 database and Oracle 10gR1 Companions. The following is the overall installation procedure:
Task ReferencePre-Installation OS packages (** XXXXWlibCx package is missing
in the design the build specification, refer to latest design and build specification)
Design and Build Specification
OS patchesKernel parameter/tmp spaceSWAP spaceNode timeVerify Veritas Storage Foundation for Oracle RACNetwork setting /etc/hostsSetup rsh (** ssh is not configured) Appendix K
Post-Installation Database creation Appendix GCreate database service Appendix A Modify CRS resource parameter Appendix CModify database listener and register remote listener
Appendix B
Database connection setting Appendix EEnable Enterprise Manager Appendix FCreate/Modify VCS service group and configuration Appendix ICreate test table for VCS Oracle agent Appendix JDisable automatic startup and shutdown of Oracle CRS and database
Remove /etc/rc3.d/S96init.crs and /etc/rc3.dK96init.crs
Modify VCS shutdown sequence Move /etc/rc0.d/K10vcs to /etc/rc3.d/K10vcs
Create database link Appendix HCreate and register remote listener
3 Cluster Ready Service (10.1.0.2) Installation
1. Run ‘runInstaller’ from Oracle Cluster Ready Service installation CD.
2. A Welcome screen is displayed, click ‘Next’ button.
3. Enter full path of inventory directory (/opt/oracle/oraInventory) and specify operation system group for inventory di-rectory
4. An OUI window is prompted, run ‘/opt/oracle/oraInventory/orainstRoot.sh’ and click ‘Continue’ button after orainst-Root.sh complete.
5. Specify CRS installation path.
l Name – OraCr10g_homel Path - /opt/crs/oracle/product/10.1.0/crs
6. Specify ‘English’ as CRS language.
7. Enter CRS cluster name.
l Cluster Name – csdevuaedbs1
8. Specify the interfaces to uses as private and public interconnect.
Interface Name Subnet Interface Typece0 10.26.102.192 Publicce2 20.20.30.0 Private
9. Specify OCR location.
l OCR Location – /crs/CRS_OCR/ocr1
10. Specify voting disk file name.
l Voting disk – /crs/VOTE-disk/vdisk1
11. An OUI window is prompted, run ‘/opt/oracle/oraInventory/orainstRoot.sh’ and click ‘Continue’ button after orainst-Root.sh complete.
12. A summary window is displayed, click ‘Install’ button to continuous.
13. An installation process window is displayed.
14. An OUI window is prompted, run ‘/opt/crs/oracle/product/10.1.0/crs/root.sh’ on each cluster nodes (eg. de-vuaedbs11 and devuaedbs12) and click ‘OK’ button after root.sh complete.
Before run ‘/opt/crs/oracle/product/10.1.0/crs/root.sh’, apply Veritas SFRAC point patch.
Run the following commands to apply the Veritas SFRAC point patch:
l Login to first cluster node (eg. devuaedbs11) as root
l Copy init.cssd.patch file included in this point patch to <CRS_HOME>/admin/css/ directory.
# cp init.cssd.patch <CRS_HOME>/css/admin/
l Make a backup copy of <CRS_HOME>css/admin/init.cssd
# cd <CRS_HOME>/css/admin/# cp init.cssd init.cssd.orig
l Apply patch to init.cssd file.
# patch init.cssd < init.cssd.patch
l Verify the differences
# diff –c init.cssd.orig init.cssd
l Repeat the procedure on another cluster node (eg. devuaebs12)
l Run ‘/opt/crs/oracle/product/10.1.0/crs/root.sh’ at devuaedbs11
l Run ‘/opt/crs/oracle/product/10.1.0/crs/root.sh’ at devuaedbs12
15. A configuration assistant window is displayed. An Oracle Notification Configuration Assistant and Oracle Private In-terconnection Assistant are configured.
16. The ‘End of Installation’ is displayed means Oracle Cluster Ready Service is installed successfully.
4 Database (10.1.0.2) Installation1. Run ‘runInstaller’ from Oracle Database installation CD.
2. Specify Database installation path.
l Name – OraDb10g_home1l Path – /opt/oracle/product/10.1.0/db_1
3. Specify cluster nodes (devuaedbs11 and devuaedbs12) to installation database.
4. Specify Custom installation type.
5. OUI checks operation system requirement and installation path.
6. Specify database components to be installed.
l Oracle Real Application Clusters 10.1.0.2.0l Oracle Partitioning 10.1.0.2.0
7. Specify Database Administrator Group and Database Operator Group.
8. Do not create database during installation.
9. A summary window is displayed, click ‘Install’ button to continuous.
10. An OUI window is prompted, run ‘/opt/oracle/product/10.1.0/db_1/root.sh’ on each cluster nodes (eg. devuaedbs11 and devuaedbs12) and click ‘Continue’ button after root.sh complete.
11. VIP Configuration Assistant window is displayed. Select all network interface for public network. (all interface within same IPMP group, eg, ce0 and ce1).
12. The VIP Configuration Assistant Process Dialog is displayed.
13. The Oracle Net Configuration Assistant window is displayed. Specify typical configuration and click ‘Next’ button.
14. The ‘End of Installation’ is displayed means Oracle Database is installed successfully
15. Copy the IPC and VCSMM libraries on all nodes where Oracle 10g database binaries are installed.
l Logon to devuaedbs11 as oracle10 user.l Run ‘cp /opt/VRTSvcs/rac/lib/libskgxp10_64.so $ORACLE_HOME/lib/libskgxp10.so’ at command prompt
l Logon to devuaedbs12 as oracle10 user.l Run ‘cp /opt/VRTSvcs/rac/lib/libskgxp10_64.so $ORACLE_HOME/lib/libskgxp10.so’ at command prompt
5 Companions (10.1.0.2) Installation
1. Run ‘runInstaller’ from Oracle Companions installation CD.
2. Specify Companions installation path.
3. Select all cluster nodes and click ‘Next’ button.
5. A summary window is displayed, click ‘Install’ button to continuous.
6. An installation process window is displayed.
7. An OUI window is prompted, run ‘/opt/oracle/product/10.1.0/db_1/root.sh’ on each cluster nodes (eg. devuaedbs11 and devuaedbs12) and click ‘OK’ button after root.sh complete.
l Run ‘/opt/oracle/product/10.1.0/db_1/root.sh’ at devuaedbs11.
l Run ‘/opt/oracle/product/10.1.0/db_1/root.sh’ at devuaedbs12.
8. The ‘End of Installation’ is displayed means Oracle Companions is installed successfully.
6 Apply Cluster Ready Service 10.1.0.4
1. Logon to devuaedbs11 as oracle10 user.
2. Run ‘$ORACLE_HOME/OPatch/opatch apply’ and response the question as prompted. This step is used to apply patch p3671865.
devuaedbs11 >$ORACLE_HOME/OPatch/opatch apply
Oracle Interim Patch Installer version 1.0.0.0.55Copyright (c) 2006 Oracle Corporation. All Rights Reserved..
We recommend you refer to the OPatch documentation under OPatch/docs for usage reference. We also recommend using the latest OPatch version. For the latest OPatch version and other support related issues, please refer to document 293369.1 which is viewable from metalink.oracle.com
Oracle Home = /opt/oracle/product/10.1.0/db_1Location of Oracle Universal Installer components = /opt/oracle/product/10.1.0/db_1/ouiLocation of OraInstaller.jar = "/opt/oracle/product/10.1.0/db_1/oui/jlib"Oracle Universal Installer shared library = /opt/oracle/product/10.1.0/db_1/oui/lib/solaris/liboraInstaller.soLocation of Oracle Inventory Pointer = /var/opt/oracle/oraInst.locLocation of Oracle Inventory = /opt/oracle/product/10.1.0/db_1/inventoryPath to Java = /opt/oracle/product/10.1.0/db_1/jre/1.4.2/bin/javaLog file = /opt/oracle/product/10.1.0/db_1/.patch_storage/<patch ID>/*.log
OPatch detected the node list and the local node from the inventory. OPatch will patch the local system then propagate the patch to the remote nodes.
This node is part of an Oracle Real Application Cluster. Local node is "devuaedbs11" Nodes are: devuaedbs11 devuaedbs12(patching mode = rolling)Please shut down Oracle instances running out of this ORACLE_HOME on this node.(Oracle Home = /opt/oracle/product/10.1.0/db_1)Is this node ready for updating?Please respond Y|N >YApplying patch 3671865...
Patching copy files...
Inventory is good and does not have any dangling patches.
The local instance has been updated and can berestarted before answering the next question.The nodes left to update are: "devuaedbs12".Do you want to continue patching?
Please respond Y|N >YCreating file to hold list of files to propagate: "/opt/oracle/product/10.1.0/db_1/.patch_storage/3671865/opatch_files_to_propagate.lst"
Unpatched nodes are "devuaedbs12"Which is the next node to be updated?(if there are no more nodes, just press <enter>)devuaedbs12
Please shut down Oracle instances on node:"devuaedbs12"running out of ORACLE_HOME(Oracle Home = /opt/oracle/product/10.1.0/db_1)Is the node ready for updating (are the instances down)?Please respond Y|N >YPropagating the patch...
Files for the interim patch 3671865 have been propagated to devuaedbs12.
Node "devuaedbs12" has been updated.You can now restart Oracle instance on it.
Updating inventory...
Verifying patch... Verifying that patch ID is in Oracle Home inventory.
** TIAEAF_WL01, TIAEAF_WL02, TIAEEF_WL01, TIAEEF_WL02, TIAEDF_WL01 and TIAEDF_WL02 are not startup automatically when its preferred instance starts. VCS trigger function (/opt/VRTSvcs/bin/triggers/resstatechange) is responsible to start the services when its preferred instance is startup.
Appendix B – Database Listener
Database Listener List
The following table shows the listeners for TIAEAF, TIAEEF and TIAEDF databases.
Listener Name Host Port Listening InstanceTIAEAF Database
LISTENER_TIAEAF_DEVUAEDBS11 devuaedbs11 1525 Local Listener of TIAEAF01Remote Listener of TIAEAF02
LISTENER_TIAEAF_DEVUAEDBS12 devuaedbs12 1525 Local Listener of TIAEAF02Remote Listener of TIAEAF01
TIAEEF Database
LISTENER_TIAEEF_DEVUAEDBS11 devuaedbs11 1526 Local Listener of TIAEEF01Remote Listener of TIAEEF02
LISTENER_TIAEEF_DEVUAEDBS12 devuaedbs12 1526 Local Listener of TIAEEF02Remote Listener of TIAEEF01
TIAEDF Database
LISTENER_TIAEDF_DEVUAEDBS11 devuaedbs11 1527 Local Listener of TIAEDF01Remote Listener of TIAEDF02
LISTENER_TIAEDF_DEVUAEDBS12 devuaedbs12 1527 Local Listener of TIAEDF02Remote Listener of TIAEDF01
Register Remote Listener
The following procedure describes the step to register instance (ie. TIAEAF01 and TIAEAF02)to the remote listener.
1. Logon to devuaedbs11 server as oracle10 user.
2. Execute sqlplus and logon to TIAEAF01 instance as sysdba user.
3. At sqlplus prompt, run ‘alter system set remote_listener=LISTENER_TIAEAF_DEVUAEDBS12 scope=both’
4. Logon to devuaedbs12 server as oracle10 user.
5. Execute sqlplus and logon to TIAEAF01 instance as sysdba user.
6. At sqlplus prompt, run ‘alter system set remote_listener=LISTENER_TIAEAF_DEVUAEDBS11 scope=both’
Appendix C – CRS Resource
CRS Resource List
This section shows the CRS resource list.
Resource Type Resource NameDatabase ora.TIAEAF.db.cap
This section describes the procedure to add the CRS resource. VIP and listener resource are register automatically but database and instance resource are required to register manually. The following step shows the procedure to register an instances and database (eg. TIAEAF) to the Oracle Cluster Register.
Original Value AUTO_START=1RESTART_ATTEMPTS=5REQUIRED_RESOURCES=ora.devuaedbs12.vip
Modified Value AUTO_START=2RESTART_ATTEMPTS=0REQUIRED_RESOURCES=
l VIP Resource
Resource name Valueora.devuaedbs11.vip.cap Original Value CHECK_INTERVAL=60
RESTART_ATTEMPTS=1SCRIPT_TIMEOUT=60
Modified Value CHECK_INTERVAL=20RESTART_ATTEMPTS=3SCRIPT_TIMEOUT=20
ora.devuaedbs12.vip.cap Original Value CHECK_INTERVAL=60RESTART_ATTEMPTS=1SCRIPT_TIMEOUT=60
Modified Value CHECK_INTERVAL=20RESTART_ATTEMPTS=3SCRIPT_TIMEOUT=20
**AUTO_START - A flag indicating whether Oracle Clusterware should automatically start a resource after a cluster restart, regardless of whether the resource was running prior to the cluster restart. When set to 0, Oracle Clusterware starts the resource only if it had been running before the restart. When set to 1, Oracle Clusterware always starts the resource after a restart.
RESTART_ATTEMPTS –The number of times that Oracle Clusterware attempts to restart a resource on a single cluster node before attempting to relocate the resource. A value of 1 means that Oracle Clusterware only attempts to restart the resource once on a node. A second failure causes an attempt to relocate the resource.
REQUIRED_RESOURCES - An ordered list of resource names separated by blank spaces that this resource depends on. Each resource to be used as a required resource in this profile must be registered with Oracle Clusterware or the re-source’s profile registration will fail.
CHECK_INTERVAL - The time interval, in seconds, between repeated executions of the check entry point of a re-source's action program. There can be some overhead associated if you set the check interval to a low value and enable frequent checks.
SCRIPT_TIMEOUT - The maximum time, in second, that an action program may require to complete before an error is returned. This attribute specifies the time out value for the "check" action of the action script. If the check action does not return before this time, Oracle Clusterware will consider the action failed.
Appendix D - /etc/hosts
This section is the network setting for the Oracle RAC database.
The following section describes the procedure to enable the Enterprise Manager.
l Logon to any cluster node as oracle10 user.
l Run ‘emca –r’ at command prompt and answer the prompted question (shown in bold font). The following is the screen dump:
devuaedbs11 >emca –r
STARTED EMCA at Mon Mar 20 21:46:33 HKT 2006Enter the following information about the database to be configuredListener port number: 1525Database SID: TIAEAF01Service name: TIAEAF.dev.immd.hksargEmail address for notification: Email gateway for notification: Password for dbsnmp: Password for sysman: Password for sys:
Database host name ................ devuaedbs11.dev.immd.hksargListener port number ................ 1525Database SID ................ TIAEAF01Service name ................ TIAEAF.dev.immd.hksargEmail address for notification ............... Email gateway for notification ...............
This section describes procedure to create a database creation script.
1. Logon to devuaedbs11 as oracle10 user.
2. Run $ORACLE_HOME/bin/dbca.
3. Specify ‘Create a Database’ radio button.
4. Select all cluster nodes, eg. devuaedbs11 and devuaedbs12, and click Next.
5. Select ‘Custom Database’ template and click Next.
6. Specify ‘Global Database Name’ and ‘SID Prefix’. DBCA restricts 5 characters for SID prefix thus ‘TIAEA’ can be entered. The SID name should be corrected manually in the database creation scripts.
7. Keep default setting and click Next.
8. Specify password for default database user.
9. Select ‘Cluster File System’ as the storage mechanism and click Next.
10. Select ‘Use Database File Location from Template’.
11. Enable automatic archiving and specify file format of archived log.
12. Enable Flash Recovery Area, specify flash recovery area destination and flash recovery size.
13. Specify ‘Enterprise Manager Repository’ component to be created.
14. Keep default setting and click Finish.
15. Save the database creation script to a directory.
16. Modify the database creation script if any.
17. Run modified database creation script to create the database.
18. It is required to modify the database creation script to suit your environment (eg. instance name).
19. Enable the RAC database by issue ‘alter system set CLUSTER_DATABASE=TRUE scope=BOTH’.
20. Register database instance to the local and remote listener, eg. register TIAEAF01 and TIAEAF02
- Logon to TIAEAF01 instance as sysdba user- Run ‘alter system set local_listener=LLSNR_TIAEAF_DEVUAEDBS11_ALIAS scope=BOTH’
- Run ‘alter system set remote_listener=RLSNR_TIAEAF_DEVUAEDBS12_ALIAS scope=BOTH’
Appendix H – Database Link
This section describes procedure to create a database link.
1. Run sqlplus and logon to database (eg. TIAEEF database) as sysdba user.
2. Run the following command at sqlplus prompt to create a database link
create database link <database link name> connect to <user> identified by <password> using '<tns connection alias>';
For example,
create database link lnk_tiaeaf connect to testia01 identified by tia01 using 'tiaeaftaf';
Appendix I – VCS Configuration File
The following is the VCS configuration file, main.cf.
include "types.cf"include "CFSTypes.cf"include "CVMTypes.cf"include "OracleTypes.cf"include "PrivNIC.cf"
This section describes procedure to create a VCS Oracle agent test table for database. ** It is required to create a VCS Oracle agent test table for each instance of each database. The following procedures create two test tables, one for TIAEAF01 instance and another one for TIAEAF02 instance, for TIAEAF database.
1. Logon to any cluster node (eg. devuaedbs11) as oracle10.
2. Issue ‘export ORACLE_SID=TIAEAF01’ to setup environment variable.
3. Issue the following statements at the sqlplus prompt to create the VCS Oracle Agent test table.
conn / as sysdba;
create user vcsctl identified by <PASSWORD> default tablespace users temporary tablespace temp quota 100k on usersgrant create session to vcsctl;
create table vcsctl.vcsctl_TIAEAF01 (tstamp data);insert into vcsctl.vcsctl_TIAEAF01 (tstamp) values (sysdate);
create table vcsctl.vcsctl_TIAEAF02 (tstamp data);insert into vcsctl.vcsctl_TIAEAF02 (tstamp) values (sysdate);
Appendix K – Setup rsh for Oracle Installation
This section describes procedure to setup rsh for Oracle CRS and database installation.
If ssh (SSH client) is configured for the cluster nodes, the Oracle OUI installation program can install Oracle CRS and database as long as ssh commands between nodes can execute without password prompting and confirmation.
Is ssh is not configured, enable each node to have remove rsh access to the other nodes during Oracle CRS and database installation. On each node, placing a “+” character in the first line of / .rhosts file gives remote access to the oracle10 user.
Remove the remote rsh access permission after Oracle CRS and database installation.
Metalink Reference
Metalink Doc ID / TAR Description5253956.992 Database link cannot failover5286834.992 Database link and TAF supported
298073.1 How to remove CRS auto start and restart for a RAC instance300903.1 Load balancing with RAC69906.1 Configuring Transparent Application Failover
240052.1 10g manual database creation in oracle (single instance and RAC)97926.1 Failover issues and limitations [Connect-time failover and TAF]
226880.1 Configuration of load balancing and transparent application failover283107.1 Solaris IP Multipathing239888.1 DB_NAME maximum length restriction when using DBCA