Friday, January 16, 2015

Oracle 10g RAC Startup/Shutdown services on a single node (for maintenance)

Oracle 10g RAC Startup/Shutdown services on a single node (for maintenance)

Pre-checks

Oracle Home: 
ORACLE_HOME=/oracle/app/oracle/product/10.2.0/db_1

CRS Home:
CRS_HOME=/oracle/crs/oracle/product/10/crs/

Executables Location:
/oracle/crs/oracle/product/10/crs/bin

Check the status of Cluster services:
 /oracle/crs/oracle/product/10/crs/bin/crs_stat -t

Few commands to check the status of individual cluster services:

For example: 
Server name is cd2-db-svr and cd2-db-svr-bck
Database name is TRAX
Instance name is TRAX01 and TRAX02

cd2-db-svr# srvctl status nodeapps -n cd2-db-svr

VIP is running on node: cd2-db-svr
GSD is running on node: cd2-db-svr
Listener is running on node: cd2-db-svr

ONS daemon is running on node: cd2-db-svr

cd2-db-svr# srvctl status asm -n cd2-db-svr

ASM instance +ASM1 is running on node cd2-db-svr

cd2-db-svr# srvctl status database -d TRAX
Instance TRAX01 is running on node cd2-db-svr

Instance TRAX02 is running on node cd2-db-svr-bck

cd2-db-svr# crsctl check crs

CSS appears healthy
CRS appears healthy

EVM appears healthy

cd2-db-svr# ps -ef|grep d.bin
    root  4274  4004   0   Jul 10 ?    8993:18 /oracle/crs/oracle/product/10/crs/bin/crsd.bin reboot
  oracle  4221  4217   0  Jul 10 ?    309:20 /oracle/crs/oracle/product/10/crs/bin/evmd.bin
    root  4441  4285   0   Jul 10 ?     89:33 /oracle/crs/oracle/product/10/crs/bin/oprocd.bin run -t 1000 -m 500 -f
  oracle  4510  4327   0  Jul 10 ?     2731:29 /oracle/crs/oracle/product/10/crs/bin/ocssd.bin
  oracle 16846 22996   0 15:03:34 pts/5       0:00 grep d.bin

ps -ef|grep pmon

ps -ef|grep tns


Actual Steps to bring down the services on one node of Oracle 10G RAC cluster

Stop services on  node 1(cd2-db-svr)

1. srvctl stop instance -d TRAX -i TRAX01
2. srvctl stop asm -n cd2-db-svr
3. srvctl stop nodeapps -n cd2-db-svr
4. crsctl stop crs

Start services on node 1(cd2-db-svr)

1. crsctl start crs  (Ideally all services should come up automatically, if not issue the following steps to bring up the services)
2. srvctl start nodeapps -n  cd2-db-svr
3. srvctl start asm -n  cd2-db-svr
4. srvctl start instance -d TRAX -i TRAX01