oracle 11gR2 RAC “oc4j” and “gsd” resource offline

Oracle RAC GSD process

GSD (Global Services Daemon) is a cluserware process that was used in Oracle RAC 9i.
It runs on each node and coordinates with the cluster manager to receive requests from clients such as the DBCA, EM and the SRVCTL utility to execute tasks such as instance startup or shutdown.

With Oracle Clusterware 10g and 11g, the GSD resource does not have a function and will be disabled by default
It can be enabled in Oracle 10g or 11g if any Oracle 9i RAC components are present.

[oracle@rac2 ~]$ crs_stat -t

Name           Type           Target    State     Host       

------------------------------------------------------------

ora.DATA.dg    ora....up.type ONLINE    ONLINE    rac1        

ora....ER.lsnr ora....er.type ONLINE    ONLINE    rac1       

ora....N1.lsnr ora....er.type ONLINE    ONLINE    rac2       

ora.asm        ora.asm.type   ONLINE    ONLINE    rac1       

ora.eons       ora.eons.type  ONLINE    ONLINE    rac1       

ora.gsd        ora.gsd.type   OFFLINE   OFFLINE              

ora....network ora....rk.type ONLINE    ONLINE    rac1       

ora.oc4j       ora.oc4j.type  OFFLINE   OFFLINE              

ora.ons        ora.ons.type   ONLINE    ONLINE    rac1       

ora.orcl.db    ora....se.type ONLINE    ONLINE    rac1       

ora....SM1.asm application    ONLINE    ONLINE    rac1       

ora....C1.lsnr application    ONLINE    ONLINE    rac1       

ora.rac1.gsd   application    OFFLINE   OFFLINE              

ora.rac1.ons   application    ONLINE    ONLINE    rac1       

ora.rac1.vip   ora....t1.type ONLINE    ONLINE    rac1       

ora....SM2.asm application    ONLINE    ONLINE    rac2       

ora....C2.lsnr application    ONLINE    OFFLINE              

ora.rac2.gsd   application    OFFLINE   OFFLINE              

ora.rac2.ons   application    ONLINE    ONLINE    rac2       

ora.rac2.vip   ora....t1.type ONLINE    ONLINE    rac2       

ora.scan1.vip  ora....ip.type ONLINE    ONLINE    rac2   

OC4J Resource Troubleshooting

[oracle@rac1 ~]$ srvctl start oc4j

OC4J could not be started

PRCR-1079 : Failed to start resource ora.oc4j

CRS-2501: Resource 'ora.oc4j' is disabled

we need to enable and start the resource using

[oracle@rac1 ~]$ srvctl enable oc4j

[oracle@rac1 ~]$ srvctl start oc4j

Check the resource status

[oracle@rac1 ~]$ crs_stat -t|grep oc4j

ora.oc4j       ora.oc4j.type  ONLINE    ONLINE    rac1    

Now take a look at our GSD resource

[oracle@rac1 ~]$ srvctl status nodeapps

VIP rac1-vip is enabled

VIP rac1-vip is running on node: rac1

VIP rac2-vip is enabled

VIP rac2-vip is running on node: rac2

Network is enabled

Network is running on node: rac1

Network is running on node: rac2

GSD is disabled

GSD is not running on node: rac1

GSD is not running on node: rac2

ONS is enabled

ONS daemon is running on node: rac1

ONS daemon is running on node: rac2

eONS is enabled

eONS daemon is running on node: rac1

eONS daemon is running on node: rac2  

From the above output it is evident that gsd is disable so, enable that and start it 

[oracle@rac1 ~]$ srvctl enable nodeapps

PRKO-2414 : GSD is already enabled on node(s): rac1,rac2

PRKO-2415 : VIP is already enabled on node(s): rac1,rac2

PRKO-2416 : Network resource is already enabled.

PRKO-2417 : ONS is already enabled on node(s): rac1,rac2

PRKO-2418 : eONS is already enabled on node(s): rac1,rac2

[oracle@rac1 archive]$ srvctl start nodeapps

PRKO-2421 : Network resource is already started on node(s): rac1,rac2

PRKO-2420 : VIP is already started on node(s): rac1,rac2

PRKO-2420 : VIP is already started on node(s): rac1,rac2

PRKO-2422 : ONS is already started on node(s): rac1,rac2

PRKO-2423 : eONS is already started on node(s): rac1,rac2

Finally Check the resources status

[oracle@rac1 ~]$ crs_stat -t

Name           Type           Target    State     Host       

------------------------------------------------------------

ora.DATA.dg    ora....up.type ONLINE    ONLINE    rac1       

ora....ER.lsnr ora....er.type ONLINE    ONLINE    rac1       

ora....N1.lsnr ora....er.type ONLINE    ONLINE    rac2       

ora.asm        ora.asm.type   ONLINE    ONLINE    rac1       

ora.eons       ora.eons.type  ONLINE    ONLINE    rac1       

ora.gsd        ora.gsd.type   ONLINE    ONLINE    rac1       

ora....network ora....rk.type ONLINE    ONLINE    rac1       

ora.oc4j       ora.oc4j.type  ONLINE    ONLINE    rac1       

ora.ons        ora.ons.type   ONLINE    ONLINE    rac1       

ora.orcl.db    ora....se.type ONLINE    ONLINE    rac1       

ora....SM1.asm application    ONLINE    ONLINE    rac1       

ora....C1.lsnr application    ONLINE    ONLINE    rac1       

ora.rac1.gsd   application    ONLINE    ONLINE    rac1       

ora.rac1.ons   application    ONLINE    ONLINE    rac1       

ora.rac1.vip   ora....t1.type ONLINE    ONLINE    rac1       

ora....SM2.asm application    ONLINE    ONLINE    rac2       

ora....C2.lsnr application    ONLINE    ONLINE    rac2       

ora.rac2.gsd   application    ONLINE    ONLINE    rac2       

ora.rac2.ons   application    ONLINE    ONLINE    rac2       

ora.rac2.vip   ora....t1.type ONLINE    ONLINE    rac2       

ora.scan1.vip  ora....ip.type ONLINE    ONLINE    rac2