首页 诗词 字典 板报 句子 名言 友答 励志 学校 网站地图
当前位置: 首页 > 教程频道 > 数据库 > 其他数据库 >

怎么来分析oracle 11g grid infrastructure root.sh 执行异常诊断

2013-11-04 
如何来分析oracle 11g grid infrastructure root.sh 执行错误诊断?Troubleshooting 11.2 Grid Infrastruct

如何来分析oracle 11g grid infrastructure root.sh 执行错误诊断?

Troubleshooting 11.2 Grid Infrastructure  root.sh Issues (文档  ID 1053970.1)

转到底部


修改时间:2013-3-20类型:TROUBLESHOOTING

In this Document

Purpose

 

Troubleshooting Steps

 

 

Advanced Root.sh Troubleshooting

 

 

Community Discussions

 

References


Applies to:

Oracle Database -Enterprise Edition - Version 11.2.0.1 to 11.2.0.3 [Release 11.2]
Information in this document applies to any platform.

Purpose

This document is to provide a reference fortroubleshooting root.sh issues after installing an 11.2 Grid Infrastructurehome for a cluster.  For versions prior to 11.2, seeNote: 240001.1

TroubleshootingSteps

At the end of a grid infrastructureinstallation, the user is prompted to run the "root.sh" script. This script configures and starts the Oracle Clusterware stack.  A root.shscript can error out and/or fail under one of the following conditions:

  • Problem     with the network configuration.
  • Problem     with the storage location for the OCR and/or voting files.  
  • Permission     problem with/var/tmp (specifically /var/tmp/.oracle).
  • Problem     with the vendor clusterware (if used).
  • Some     other configuration issue.
  • An     Oracle bug.

    Most configuration issues should bedetectable by running the Cluster Verification Utility with the followingsyntax (input the nodelist):

    cd<GRID_HOME>/bin
    ./cluvfy stage -pre crsinst -n <nodelist> -r 11gR2 -verbose


    Additional options can be used for a more thorough check:

    USAGE:
    cluvfy stage -pre crsinst -n <node_list> [-r {10gR1|10gR2|11gR1|11gR2}]
    [-c <ocr_location_list>] [-q <voting_disk_list>]
    [-osdba <osdba_group>]
    [-orainv <orainventory_group>]
    [-asm -asmgrp <asmadmin_group>]
    [-asm -asmdev <asm_device_list>]
    [-fixup [-fixupdir <fixup_dir>]] [-verbose]


    If the Cluster Verification Utility is unable to find a configuration problemand your root.sh still fails, you may need the assistance of Oracle Support totroubleshoot further and/or see the "Advanced Root.shTroubleshooting" section:

    Advanced Root.sh Troubleshooting

    The root.sh is simply a parent script thatcalls the following scripts:

    <GRID_HOME>/install/utl/rootmacro.sh   # small - validateshome and user
    <GRID_HOME>/install/utl/rootinstall.sh    # small -creates some local files
    <GRID_HOME>/network/install/sqlnet/setowner.sh   # small -opens up /tmp permissions
    <GRID_HOME>/rdbms/install/rootadd_rdbms.sh  # small - miscfile/permission checks
    <GRID_HOME>/rdbms/install/rootadd_filemap.sh  # small - miscfile/permission checks
    <GRID_HOME>/crs/install/rootcrs.pl  # MAIN CLUSTERWARE CONFIGSCRIPT

    If your root.sh is failing on one of the first 5 scripts, it should be an easyfix since those fix are small and easy to troubleshoot.  However, mostproblems are likely going to happen in the rootcrs.pl script which is the mainclusterware config script.  This script will log useful trace data to<GRID_HOME>/cfgtoollogs/crsconfig/rootcrs_<nodename>.log. However, you should check the clusterware alert log under<GRID_HOME>/log/<nodename> first for any obvious problems orerrors.

    In the following section I will show the log output of a new installation on a2 node cluster (racbde1 and racbde2) where the OCR and Voting files will bestored in ASM on a diskgroup called +SYSTEMDG.  This log information isposted for reference.  It might be useful to compare the clusterware alertlog from a working root.sh (mine) to a failing one (yours) to see where it wentwrong.  I willbold the major landmarks in the clusterwarealert log so that you can see how far you got:

    Node 1 (racbde1) Clusterware Alert Log During root.sh:

    Oracle Database11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle.All rights reserved.
    2009-12-23 19:24:33.844
    [client(17368)]CRS-2106:The OLR location /u01/app/grid/cdata/racbde1.olr isinaccessible. Details in /u01/app/grid/log/racbde1/client/ocrconfig_17368.log.
    2009-12-23 19:24:33.956
    [client(17368)]CRS-2101:The OLR was formatted using version 3.
    2009-12-23 19:25:02.495
    [ohasd(17767)]CRS-2112:The OLR service started on node racbde1.
    2009-12-23 19:25:02.833
    [ohasd(17767)]CRS-2772:Server 'racbde1' has been assigned to pool 'Free'.
    2009-12-23 19:25:34.801
    [cssd(18791)]CRS-1713:CSSD daemon is started in exclusive mode
    2009-12-23 19:25:37.126
    [cssd(18791)]CRS-1709:Lease acquisition failed for node racbde1 because novoting file has been configured; Details at (:CSSNM00031:) in/u01/app/grid/log/racbde1/cssd/ocssd.log
    2009-12-23 19:25:54.705
    [cssd(18791)]CRS-1601:CSSD Reconfiguration complete. Active nodes areracbde1 .
    2009-12-23 19:25:55.431
    [ctssd(18848)]CRS-2403:The Cluster Time Synchronization Service on host racbde1is in observer mode.
    2009-12-23 19:25:55.575
    [ctssd(18848)]CRS-2407:The new Cluster Time Synchronization Service referencenode is host racbde1.
    2009-12-23 19:25:56.312
    [ctssd(18848)]CRS-2401:The Cluster Time Synchronization Service started on hostracbde1.
    [client(19034)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(19038)]CRS-10001:ACFS-9322: done.
    2009-12-23 19:30:26.790
    [client(19423)]CRS-1006:The OCR location +SYSTEMDG is inaccessible. Details in/u01/app/grid/log/racbde1/client/ocrconfig_19423.log.
    2009-12-23 19:30:27.883
    [client(19423)]CRS-1001:The OCR was formatted using version 3.
    2009-12-23 19:30:40.473
    [crsd(19480)]CRS-1012:The OCR service started on node racbde1.
    2009-12-23 19:31:53.331
    [cssd(18791)]CRS-1605:CSSD voting file is online: /dev/sdb1;details in /u01/app/grid/log/racbde1/cssd/ocssd.log.
    2009-12-23 19:31:53.373
    [cssd(18791)]CRS-1605:CSSD voting file is online: /dev/sdb2;details in /u01/app/grid/log/racbde1/cssd/ocssd.log.
    2009-12-23 19:31:53.417
    [cssd(18791)]CRS-1605:CSSD voting file is online: /dev/sdb3;details in /u01/app/grid/log/racbde1/cssd/ocssd.log.
    2009-12-23 19:31:54.413
    [cssd(18791)]CRS-1626:A Configuration change request completed successfully
    2009-12-23 19:31:54.424
    [cssd(18791)]CRS-1601:CSSD Reconfiguration complete. Active nodes areracbde1 .
    2009-12-23 19:32:10.831
    [ctssd(18848)]CRS-2405:The Cluster Time Synchronization Service on host racbde1is shutdown by user
    2009-12-23 19:32:26.536
    [cssd(18791)]CRS-1603:CSSD on node racbde1 shutdown by user.
    2009-12-23 19:32:26.856
    [cssd(18791)]CRS-1625:Node racbde1, number 1, was manually shut down
    2009-12-23 19:32:44.826
    [cssd(20125)]CRS-1713:CSSD daemon is started in clustered mode
    2009-12-23 19:34:07.568
    [cssd(20125)]CRS-1707:Lease acquisition for node racbde1 number 1completed
    2009-12-23 19:34:07.690
    [cssd(20125)]CRS-1605:CSSD voting file is online: /dev/sdb3; details in/u01/app/grid/log/racbde1/cssd/ocssd.log.
    2009-12-23 19:34:07.731
    [cssd(20125)]CRS-1605:CSSD voting file is online: /dev/sdb2; details in/u01/app/grid/log/racbde1/cssd/ocssd.log.
    2009-12-23 19:34:07.774
    [cssd(20125)]CRS-1605:CSSD voting file is online: /dev/sdb1; details in/u01/app/grid/log/racbde1/cssd/ocssd.log.
    2009-12-23 19:34:25.380
    [cssd(20125)]CRS-1601:CSSD Reconfiguration complete. Active nodes areracbde1 .
    2009-12-23 19:34:26.324
    [ctssd(20269)]CRS-2403:The Cluster Time Synchronization Service on host racbde1is in observer mode.
    2009-12-23 19:34:26.448
    [ctssd(20269)]CRS-2407:The new Cluster Time Synchronization Service referencenode is host racbde1.
    2009-12-23 19:34:27.278
    [ctssd(20269)]CRS-2401:The Cluster Time Synchronization Service startedon host racbde1.
    2009-12-23 19:34:41.941
    [crsd(20392)]CRS-1012:The OCR service started on node racbde1.
    2009-12-23 19:34:44.734
    [crsd(20392)]CRS-1201:CRSD started on node racbde1.



    Node 2 (racbde2) Clusterware Alert Log During root.sh:

    Oracle Database11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle.All rights reserved.
    2009-12-23 19:33:43.687
    [client(12019)]CRS-2106:The OLR location /u01/app/grid/cdata/racbde2.olr isinaccessible. Details in /u01/app/grid/log/racbde2/client/ocrconfig_12019.log.
    2009-12-23 19:33:43.700
    [client(12019)]CRS-2101:The OLR was formatted using version 3.
    2009-12-23 19:33:50.660
    [ohasd(12058)]CRS-2112:The OLR service started on node racbde2.
    2009-12-23 19:33:50.946
    [ohasd(12058)]CRS-2772:Server 'racbde2' has been assigned to pool 'Free'.
    2009-12-23 19:34:15.140
    [ohasd(12058)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPDdaemon is not running).
    2009-12-23 19:34:17.910
    [cssd(13108)]CRS-1713:CSSD daemon is started in exclusive mode
    2009-12-23 19:35:39.019
    [cssd(13108)]CRS-1707:Lease acquisition for node racbde2 number 2completed
    [cssd(13108)]CRS-1636:The CSS daemon was started in exclusive mode but found anactive CSS daemon on node racbde1 and is terminating; details at (:CSSNM00006:)in /u01/app/grid/log/racbde2/cssd/ocssd.log
    2009-12-23 19:35:39.043
    [cssd(13108)]CRS-1603:CSSD on node racbde2 shutdown by user.
    2009-12-23 19:35:39.152
    [ohasd(12058)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server'racbde2'.
    2009-12-23 19:36:00.206
    [cssd(13376)]CRS-1713:CSSD daemon is started in clustered mode
    2009-12-23 19:36:19.648
    [cssd(13376)]CRS-1707:Lease acquisition for node racbde2 number 2completed
    2009-12-23 19:36:19.762
    [cssd(13376)]CRS-1605:CSSD voting file is online: /dev/sdb1;details in /u01/app/grid/log/racbde2/cssd/ocssd.log.
    2009-12-23 19:36:19.810
    [cssd(13376)]CRS-1605:CSSD voting file is online: /dev/sdb3;details in /u01/app/grid/log/racbde2/cssd/ocssd.log.
    2009-12-23 19:36:19.857
    [cssd(13376)]CRS-1605:CSSD voting file is online: /dev/sdb2;details in /u01/app/grid/log/racbde2/cssd/ocssd.log.
    2009-12-23 19:36:31.342
    [cssd(13376)]CRS-1601:CSSD Reconfiguration complete. Active nodes areracbde1 racbde2 .
    2009-12-23 19:36:32.707
    [ctssd(13443)]CRS-2403:The Cluster Time Synchronization Service on host racbde2is in observer mode.
    2009-12-23 19:36:32.860
    [ctssd(13443)]CRS-2407:The new Cluster Time Synchronization Service referencenode is host racbde1.
    2009-12-23 19:36:33.600
    [ctssd(13443)]CRS-2401:The Cluster Time Synchronization Service startedon host racbde2.
    [client(13473)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(13477)]CRS-10001:ACFS-9322: done.
    2009-12-23 19:39:27.166
    [crsd(13606)]CRS-1012:The OCR service started on node racbde2.
    2009-12-23 19:39:30.419
    [crsd(13606)]CRS-1201:CRSD started on node racbde2.



    If further analysis is needed, it might be useful to compare a working rootcrsoutput (mine) to one that is failing (yours) to see what went wrong. Again the rootcrs log is in <GRID_HOME>/cfgtoollogs/crsconfig/rootcrs_<nodename>.log. I will divide the log into the following rootcrs sections:

    • First     Node Initial Setup (racbde1)
    • First     Node Setup OLR for storing Oracle local registry data
    • First     Node Setup GPnP wallet and profile
    • First     Node Setup and copy files for OHASD daemon
    • First     Node Start OHASD Daemon
    • First     Node Copy required CRS resources for OHASD to start
    • First     Node Start in Exclusive Mode and Configure Diskgroup
    • First     Node Push GPnP Profile to Remote Node(s)
    • First     Node Start Full Clusterware Stack
    • First     Node Adding Clusterware Resources
    • Secondary     Note Initial Setup (racbde2)
    • Secondary     Note Get GPnP Profile
    • Secondary     Node Setup OLR for storing Oracle local registry data
    • Secondary     Node Setup and copy files for OHASD daemon
    • Secondary     Node Start OHASD Daemon
    • Secondary     Node Copy required CRS resources for OHASD to start
    • Secondary     Node Start Full Clusterware Stack
    • Secondary     Node Adding Clusterware Resources


      First Node Initial Setup (racbde1):

      2009-12-2319:24:30: The configuration parameter file/u01/app/grid/crs/install/crsconfig_params is valid
      2009-12-23 19:24:30: Checking for super user privileges
      2009-12-23 19:24:30: User has super user privileges
      2009-12-23 19:24:30: ### Printing the configuration values from files:
      2009-12-23 19:24:30:   /u01/app/grid/crs/install/crsconfig_params
      2009-12-23 19:24:30:   /u01/app/grid/crs/install/s_crsconfig_defs
      2009-12-23 19:24:30: ASM_DISCOVERY_STRING=/dev/sdb*
      2009-12-23 19:24:30: ASM_DISKS=/dev/sdb1,/dev/sdb2,/dev/sdb3
      2009-12-23 19:24:30: ASM_DISK_GROUP=SYSTEMDG
      2009-12-23 19:24:30: ASM_REDUNDANCY=NORMAL
      2009-12-23 19:24:30: ASM_SPFILE=
      2009-12-23 19:24:30: ASM_UPGRADE=false
      2009-12-23 19:24:30: CLSCFG_MISSCOUNT=
      2009-12-23 19:24:30: CLUSTER_GUID=
      2009-12-23 19:24:30: CLUSTER_NAME=racbde-scan
      2009-12-23 19:24:30:CRS_NODEVIPS='racbde1-vip/255.255.254.0/eth1,racbde2-vip/255.255.254.0/eth1'
      2009-12-23 19:24:30: CRS_STORAGE_OPTION=1
      2009-12-23 19:24:30: CSS_LEASEDURATION=400
      2009-12-23 19:24:30: DIRPREFIX=
      2009-12-23 19:24:30: DISABLE_OPROCD=0
      2009-12-23 19:24:30: EMBASEJAR_NAME=oemlt.jar
      2009-12-23 19:24:30: EWTJAR_NAME=ewt3.jar
      2009-12-23 19:24:30: EXTERNAL_ORACLE_BIN=/opt/oracle/bin
      2009-12-23 19:24:30: GNS_ADDR_LIST=
      2009-12-23 19:24:30: GNS_ALLOW_NET_LIST=
      2009-12-23 19:24:30: GNS_CONF=false
      2009-12-23 19:24:30: GNS_DENY_ITF_LIST=
      2009-12-23 19:24:30: GNS_DENY_NET_LIST=
      2009-12-23 19:24:30: GNS_DOMAIN_LIST=
      2009-12-23 19:24:30: GPNPCONFIGDIR=/u01/app/grid
      2009-12-23 19:24:30: GPNPGCONFIGDIR=/u01/app/grid
      2009-12-23 19:24:30: GPNP_PA=
      2009-12-23 19:24:30: HELPJAR_NAME=help4.jar
      2009-12-23 19:24:30: HOST_NAME_LIST=racbde1,racbde2
      2009-12-23 19:24:30: ID=/etc/init.d
      2009-12-23 19:24:30: INIT=/sbin/init
      2009-12-23 19:24:30: IT=/etc/inittab
      2009-12-23 19:24:30: JEWTJAR_NAME=jewt4.jar
      2009-12-23 19:24:30: JLIBDIR=/u01/app/grid/jlib
      2009-12-23 19:24:30: JREDIR=/u01/app/grid/jdk/jre/
      2009-12-23 19:24:30: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
      2009-12-23 19:24:30: MSGFILE=/var/adm/messages
      2009-12-23 19:24:30: NETCFGJAR_NAME=netcfg.jar
      2009-12-23 19:24:30:NETWORKS="eth1"/10.141.154.0:public,"eth0"/192.168.0.0:cluster_interconnect
      2009-12-23 19:24:30: NEW_HOST_NAME_LIST=
      2009-12-23 19:24:30:NEW_NODEVIPS='racbde1-vip/255.255.254.0/eth1,racbde2-vip/255.255.254.0/eth1'
      2009-12-23 19:24:30: NEW_NODE_NAME_LIST=
      2009-12-23 19:24:30: NEW_PRIVATE_NAME_LIST=
      2009-12-23 19:24:30: NODELIST=racbde1,racbde2
      2009-12-23 19:24:30: NODE_NAME_LIST=racbde1,racbde2
      2009-12-23 19:24:30: OCFS_CONFIG=
      2009-12-23 19:24:30: OCRCONFIG=/etc/oracle/ocr.loc
      2009-12-23 19:24:30: OCRCONFIGDIR=/etc/oracle
      2009-12-23 19:24:30: OCRID=
      2009-12-23 19:24:30: OCRLOC=ocr.loc
      2009-12-23 19:24:30: OCR_LOCATIONS=NO_VAL
      2009-12-23 19:24:30: OLASTGASPDIR=/etc/oracle/lastgasp
      2009-12-23 19:24:30: OLRCONFIG=/etc/oracle/olr.loc
      2009-12-23 19:24:30: OLRCONFIGDIR=/etc/oracle
      2009-12-23 19:24:30: OLRLOC=olr.loc
      2009-12-23 19:24:30: OPROCDCHECKDIR=/etc/oracle/oprocd/check
      2009-12-23 19:24:30: OPROCDDIR=/etc/oracle/oprocd
      2009-12-23 19:24:30: OPROCDFATALDIR=/etc/oracle/oprocd/fatal
      2009-12-23 19:24:30: OPROCDSTOPDIR=/etc/oracle/oprocd/stop
      2009-12-23 19:24:30: ORACLE_BASE=/u01/app/oracle
      2009-12-23 19:24:30: ORACLE_HOME=/u01/app/grid
      2009-12-23 19:24:30: ORACLE_OWNER=oracle
      2009-12-23 19:24:30: ORA_ASM_GROUP=oinstall
      2009-12-23 19:24:30: ORA_DBA_GROUP=oinstall
      2009-12-23 19:24:30: PRIVATE_NAME_LIST=
      2009-12-23 19:24:30: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d/etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d
      2009-12-23 19:24:30: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d/etc/rc.d/rc4.d /etc/rc.d/rc6.d
      2009-12-23 19:24:30: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d
      2009-12-23 19:24:30: RC_KILL=K19
      2009-12-23 19:24:30: RC_KILL_OLD=K96
      2009-12-23 19:24:30: RC_START=S96
      2009-12-23 19:24:30: SCAN_NAME=racbde-scan.us.oracle.com
      2009-12-23 19:24:30: SCAN_PORT=1521
      2009-12-23 19:24:30: SCRBASE=/etc/oracle/scls_scr
      2009-12-23 19:24:30: SHAREJAR_NAME=share.jar
      2009-12-23 19:24:30: SILENT=false
      2009-12-23 19:24:30: SO_EXT=so
      2009-12-23 19:24:30: SRVCFGLOC=srvConfig.loc
      2009-12-23 19:24:30: SRVCONFIG=/var/opt/oracle/srvConfig.loc
      2009-12-23 19:24:30: SRVCONFIGDIR=/var/opt/oracle
      2009-12-23 19:24:30: VNDR_CLUSTER=false
      2009-12-23 19:24:30: VOTING_DISKS=NO_VAL
      2009-12-23 19:24:30: ### Printing other configuration values ###
      2009-12-23 19:24:30: CLSCFG_EXTRA_PARMS=
      2009-12-23 19:24:30: CRSDelete=0
      2009-12-23 19:24:30: CRSPatch=0
      2009-12-23 19:24:30: DEBUG=
      2009-12-23 19:24:30: DOWNGRADE=
      2009-12-23 19:24:30: HAS_GROUP=oinstall
      2009-12-23 19:24:30: HAS_USER=root
      2009-12-23 19:24:30: HOST=racbde1
      2009-12-23 19:24:30: IS_SIHA=0
      2009-12-23 19:24:30: OLR_DIRECTORY=/u01/app/grid/cdata
      2009-12-23 19:24:30: OLR_LOCATION=/u01/app/grid/cdata/racbde1.olr
      2009-12-23 19:24:30: ORA_CRS_HOME=/u01/app/grid
      2009-12-23 19:24:30: SUPERUSER=root
      2009-12-23 19:24:30: UPGRADE=
      2009-12-23 19:24:30: VF_DISCOVERY_STRING=
      2009-12-23 19:24:30: addfile=/u01/app/grid/crs/install/crsconfig_addparams
      2009-12-23 19:24:30: crscfg_trace=1
      2009-12-23 19:24:30: crscfg_trace_file=/u01/app/grid/cfgtoollogs/crsconfig/rootcrs_racbde1.log
      2009-12-23 19:24:30: hosts=
      2009-12-23 19:24:30: oldcrshome=
      2009-12-23 19:24:30: oldcrsver=
      2009-12-23 19:24:30: osdfile=/u01/app/grid/crs/install/s_crsconfig_defs
      2009-12-23 19:24:30: parameters_valid=1
      2009-12-23 19:24:30: paramfile=/u01/app/grid/crs/install/crsconfig_params
      2009-12-23 19:24:30: platform_family=unix
      2009-12-23 19:24:30: srvctl_trc_suff=0
      2009-12-23 19:24:30: unlock_crshome=
      2009-12-23 19:24:30: user_is_superuser=1
      2009-12-23 19:24:30: ### Printing of configuration values complete ###
      2009-12-23 19:24:30: Oracle CRS stack is not configured yet
      2009-12-23 19:24:30: CRS is not yet configured. Hence, will proceed toconfigure CRS
      2009-12-23 19:24:30: Cluster-wide one-time actions... Done!
      2009-12-23 19:24:32: Oracle CRS home = /u01/app/grid
      2009-12-23 19:24:32: Host name = racbde1
      2009-12-23 19:24:32: CRS user = oracle
      2009-12-23 19:24:32: Oracle CRS home = /u01/app/grid
      2009-12-23 19:24:32: GPnP host = racbde1
      2009-12-23 19:24:32: Oracle GPnP home = /u01/app/grid/gpnp
      2009-12-23 19:24:32: Oracle GPnP local home = /u01/app/grid/gpnp/racbde1
      2009-12-23 19:24:32: GPnP directories verified.
      2009-12-23 19:24:32: Checking to see if Oracle CRS stack is already configured
      2009-12-23 19:24:32: Oracle CRS stack is not configured yet
      2009-12-23 19:24:32: ---Checking local gpnp setup...
      2009-12-23 19:24:32: The setup file"/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" does not exist
      2009-12-23 19:24:32: The setup file"/u01/app/grid/gpnp/racbde1/wallets/peer/cwallet.sso" does not exist
      2009-12-23 19:24:32: The setup file"/u01/app/grid/gpnp/racbde1/wallets/prdr/cwallet.sso" does not exist
      2009-12-23 19:24:32: chk gpnphome /u01/app/grid/gpnp/racbde1: profile_ok 0wallet_ok 0 r/o_wallet_ok 0
      2009-12-23 19:24:32: chk gpnphome /u01/app/grid/gpnp/racbde1: INVALID (badprofile/wallet)
      2009-12-23 19:24:32: ---Checking cluster-wide gpnp setup...
      2009-12-23 19:24:32: The setup file"/u01/app/grid/gpnp/profiles/peer/profile.xml" does not exist
      2009-12-23 19:24:32: The setup file "/u01/app/grid/gpnp/wallets/peer/cwallet.sso"does not exist
      2009-12-23 19:24:32: The setup file"/u01/app/grid/gpnp/wallets/prdr/cwallet.sso" does not exist
      2009-12-23 19:24:32: chk gpnphome /u01/app/grid/gpnp: profile_ok 0 wallet_ok 0r/o_wallet_ok 0
      2009-12-23 19:24:32: chk gpnphome /u01/app/grid/gpnp: INVALID (badprofile/wallet)
      2009-12-23 19:24:32: gpnp setup checked: local valid? 0 cluster-wide valid? 0
      2009-12-23 19:24:32: gpnp setup: NONE
      2009-12-23 19:24:32: GPNP configuration required
      2009-12-23 19:24:32: Validating for SI-CSS configuration


      First Node Setup OLR for storing Oracle local registry data:

      2009-12-2319:24:32: Retrieving OCR main disk location
      2009-12-23 19:24:32: Opening file OCRCONFIG
      2009-12-23 19:24:32: Value () is set for key=ocrconfig_loc
      2009-12-23 19:24:32: Unable to retrieve ocr disk info
      2009-12-23 19:24:32: Checking to see if any 9i GSD is up
      2009-12-23 19:24:32: libskgxnBase_lib = /etc/ORCLcluster/oracm/lib/libskgxn2.so
      2009-12-23 19:24:32: libskgxn_lib = /opt/ORCLcluster/lib/libskgxn2.so
      2009-12-23 19:24:32: SKGXN library file does not exists
      2009-12-23 19:24:32: OLR location = /u01/app/grid/cdata/racbde1.olr
      2009-12-23 19:24:32: Oracle CRS Home = /u01/app/grid
      2009-12-23 19:24:32: Validating /etc/oracle/olr.loc file for OLR location/u01/app/grid/cdata/racbde1.olr
      2009-12-23 19:24:32: /etc/oracle/olr.loc already exists. Backing up/etc/oracle/olr.loc to /etc/oracle/olr.loc.orig
      2009-12-23 19:24:32: Oracle CRS home = /u01/app/grid
      2009-12-23 19:24:32: Oracle cluster name = racbde-scan
      2009-12-23 19:24:32: OCR locations = +SYSTEMDG
      2009-12-23 19:24:32: Validating OCR
      2009-12-23 19:24:32: Retrieving OCR location used by previous installations
      2009-12-23 19:24:32: Opening file OCRCONFIG
      2009-12-23 19:24:32: Value () is set for key=ocrconfig_loc
      2009-12-23 19:24:32: Opening file OCRCONFIG
      2009-12-23 19:24:32: Value () is set for key=ocrmirrorconfig_loc
      2009-12-23 19:24:32: Opening file OCRCONFIG
      2009-12-23 19:24:32: Value () is set for key=ocrconfig_loc3
      2009-12-23 19:24:32: Opening file OCRCONFIG
      2009-12-23 19:24:32: Value () is set for key=ocrconfig_loc4
      2009-12-23 19:24:32: Opening file OCRCONFIG
      2009-12-23 19:24:32: Value () is set for key=ocrconfig_loc5
      2009-12-23 19:24:32: Checking if OCR sync file exists
      2009-12-23 19:24:32: No need to sync OCR file
      2009-12-23 19:24:32: OCR_LOCATION=+SYSTEMDG
      2009-12-23 19:24:32: OCR_MIRROR_LOCATION=
      2009-12-23 19:24:32: OCR_MIRROR_LOC3=
      2009-12-23 19:24:32: OCR_MIRROR_LOC4=
      2009-12-23 19:24:32: OCR_MIRROR_LOC5=
      2009-12-23 19:24:32: Current OCR location=
      2009-12-23 19:24:32: Current OCR mirror location=
      2009-12-23 19:24:32: Current OCR mirror loc3=
      2009-12-23 19:24:32: Current OCR mirror loc4=
      2009-12-23 19:24:32: Current OCR mirror loc5=
      2009-12-23 19:24:32: Verifying current OCR settings with user entered values
      2009-12-23 19:24:32: Setting OCR locations in /etc/oracle/ocr.loc
      2009-12-23 19:24:32: Validating OCR locations in /etc/oracle/ocr.loc
      2009-12-23 19:24:32: Checking for existence of /etc/oracle/ocr.loc
      2009-12-23 19:24:32: Backing up /etc/oracle/ocr.loc to /etc/oracle/ocr.loc.orig
      2009-12-23 19:24:32: Setting ocr location +SYSTEMDG
      2009-12-23 19:24:32: Creating or upgrading Oracle Local Registry (OLR)
      2009-12-23 19:24:34: OLR successfully created or upgraded
      2009-12-23 19:24:34: /u01/app/grid/bin/clscfg -localadd
      2009-12-23 19:24:34: Keys created in the OLR successfully



      First Node Setup GPnP wallet and profile:

      2009-12-2319:24:34: GPnP setup state: none
      2009-12-23 19:24:34: Creating local GPnP setup for clustered node...
      2009-12-23 19:24:34: Oracle CRS home = /u01/app/grid
      2009-12-23 19:24:34: Oracle GPnP wallets home =/u01/app/grid/gpnp/racbde1/wallets
      2009-12-23 19:24:34: Checking if GPnP setup exists
      2009-12-23 19:24:34: /u01/app/grid/gpnp/racbde1/wallets/peer/cwallet.sso walletmust be created
      2009-12-23 19:24:34: Removing old wallets/certificates, if any
      2009-12-23 19:24:34: Creating GPnP Root Wallet...
      2009-12-23 19:24:34: /u01/app/grid/bin/orapki wallet create -wallet"/u01/app/grid/gpnp/racbde1/wallets/root" -pwd gpnp_wallet1 -nologo
      2009-12-23 19:24:35: Creating GPnP Root Certificate...
      2009-12-23 19:24:35: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/root" -pwd gpnp_wallet1-self_signed -dn "CN=GPnP_root" -keysize 1024 -validity 9999 -nologo
      2009-12-23 19:24:37: Exporting GPnP Root Certificate...
      2009-12-23 19:24:37: /u01/app/grid/bin/orapki wallet export -wallet"/u01/app/grid/gpnp/racbde1/wallets/root" -pwd gpnp_wallet1 -dn"CN=GPnP_root" -cert"/u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt" -nologo
      2009-12-23 19:24:38: Creating GPnP Peer Wallet...
      2009-12-23 19:24:38: /u01/app/grid/bin/orapki wallet create -wallet"/u01/app/grid/gpnp/racbde1/wallets/peer" -pwd gpnp_wallet1-auto_login -nologo
      2009-12-23 19:24:38: Creating GPnP Profile Reader Wallet...
      2009-12-23 19:24:38: /u01/app/grid/bin/orapki wallet create -wallet"/u01/app/grid/gpnp/racbde1/wallets/prdr" -pwd gpnp_wallet1-auto_login -nologo
      2009-12-23 19:24:39: Creating GPnP PA Wallet...
      2009-12-23 19:24:39: /u01/app/grid/bin/orapki wallet create -wallet"/u01/app/grid/gpnp/racbde1/wallets/pa" -pwd gpnp_wallet1 -auto_login-nologo
      2009-12-23 19:24:40: Adding private key to GPnP Peer Wallet...
      2009-12-23 19:24:40: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/peer" -pwd gpnp_wallet1 -dn"CN=GPnP_peer" -keysize 1024 -nologo
      2009-12-23 19:24:41: Adding private key to GPnP PA Wallet...
      2009-12-23 19:24:41: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/pa" -pwd gpnp_wallet1 -dn"CN=GPnP_pa" -keysize 1024 -nologo
      2009-12-23 19:24:42: Creating certificate request for GPnP Peer Wallet...
      2009-12-23 19:24:42: /u01/app/grid/bin/orapki wallet export -wallet"/u01/app/grid/gpnp/racbde1/wallets/peer" -pwd gpnp_wallet1 -dn"CN=GPnP_peer" -request"/u01/app/grid/gpnp/racbde1/wallets/peer/certreq.txt" -nologo
      2009-12-23 19:24:43: Creating certificate request for GPnP PA Wallet...
      2009-12-23 19:24:43: /u01/app/grid/bin/orapki wallet export -wallet"/u01/app/grid/gpnp/racbde1/wallets/pa" -pwd gpnp_wallet1 -dn"CN=GPnP_pa" -request"/u01/app/grid/gpnp/racbde1/wallets/pa/certreq.txt" -nologo
      2009-12-23 19:24:44: Creating certificate for GPnP Peer Wallet...
      2009-12-23 19:24:44: /u01/app/grid/bin/orapki cert create -wallet "/u01/app/grid/gpnp/racbde1/wallets/root"-pwd gpnp_wallet1 -request"/u01/app/grid/gpnp/racbde1/wallets/peer/certreq.txt" -cert"/u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt" -validity 9999-nologo
      2009-12-23 19:24:45: Creating certificate for GPnP PA Wallet...
      2009-12-23 19:24:45: /u01/app/grid/bin/orapki cert create -wallet"/u01/app/grid/gpnp/racbde1/wallets/root" -pwd gpnp_wallet1 -request"/u01/app/grid/gpnp/racbde1/wallets/pa/certreq.txt" -cert"/u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt" -validity 9999-nologo
      2009-12-23 19:24:46: Adding Root Certificate TP to GPnP Peer Wallet...
      2009-12-23 19:24:46: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/peer" -pwd gpnp_wallet1-trusted_cert -cert "/u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt"-nologo
      2009-12-23 19:24:47: Adding Root Certificate TP to GPnP Profile ReaderWallet...
      2009-12-23 19:24:47: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/prdr" -pwd gpnp_wallet1 -trusted_cert-cert "/u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt"-nologo
      2009-12-23 19:24:48: Adding Root Certificate TP to GPnP PA Wallet...
      2009-12-23 19:24:48: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/pa" -pwd gpnp_wallet1-trusted_cert -cert"/u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt" -nologo
      2009-12-23 19:24:49: Adding PA Certificate as a TP into a GPnP Peer Wallet...
      2009-12-23 19:24:49: /u01/app/grid/bin/orapki wallet add -wallet "/u01/app/grid/gpnp/racbde1/wallets/peer"-pwd gpnp_wallet1 -trusted_cert -cert"/u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt" -nologo
      2009-12-23 19:24:50: Adding peer Certificate as a TP into a GPnP PA Wallet...
      2009-12-23 19:24:50: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/pa" -pwd gpnp_wallet1-trusted_cert -cert"/u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt" -nologo
      2009-12-23 19:24:51: Adding PA Certificate as a TP into a GPnP Profile ReaderWallet...
      2009-12-23 19:24:51: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/prdr" -pwd gpnp_wallet1-trusted_cert -cert "/u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt"-nologo
      2009-12-23 19:24:52: Adding peer Certificate as a TP into a GPnP Profile ReaderWallet...
      2009-12-23 19:24:52: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/prdr" -pwd gpnp_wallet1-trusted_cert -cert"/u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt" -nologo
      2009-12-23 19:24:53: Adding PA Certificate as a TP into a GPnP Peer Wallet...
      2009-12-23 19:24:53: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/peer" -pwd gpnp_wallet1-user_cert -cert "/u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt"-nologo
      2009-12-23 19:24:54: Adding peer Certificate as a TP into a GPnP PA Wallet...
      2009-12-23 19:24:54: /u01/app/grid/bin/orapki wallet add -wallet"/u01/app/grid/gpnp/racbde1/wallets/pa" -pwd gpnp_wallet1 -user_cert-cert "/u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt" -nologo
      2009-12-23 19:24:55: GPnP Wallets ownership/permissions successfully set.
      2009-12-23 19:24:55: GPnP Wallets successfully created.
      2009-12-23 19:24:55: <--- GPnP wallets successfully created
      2009-12-23 19:24:55: Creating GPnP peer profile --->
      2009-12-23 19:24:55: Oracle CRS home = /u01/app/grid
      2009-12-23 19:24:55: Oracle GPnP profiles home =/u01/app/grid/gpnp/racbde1/profiles
      2009-12-23 19:24:55: Oracle GPnP profiles parameters:
      2009-12-23 19:24:55:    paloc==
      2009-12-23 19:24:55:    cname=racbde-scan=
      2009-12-23 19:24:55:    cssdisco==
      2009-12-23 19:24:55:    cssld=400=
      2009-12-23 19:24:55:    asmdisco=/dev/sdb*=
      2009-12-23 19:24:55:    asmspf==
      2009-12-23 19:24:55:   netlst="eth1"/10.141.154.0:public,"eth0"/192.168.0.0:cluster_interconnect=
      2009-12-23 19:24:55:    ocrid==
      2009-12-23 19:24:55:    clusterguid==
      2009-12-23 19:24:55: Checking if GPnP setup exists
      2009-12-23 19:24:55: /u01/app/grid/gpnp/racbde1/profiles/peer/profile.xmlprofile must be created
      2009-12-23 19:24:55: OCRID is not available, hence not set in GPnP Profile
      2009-12-23 19:24:55: ClusterGUID is not available, hence not set in GPnPProfile
      2009-12-23 19:24:55: gpnptool: run /u01/app/grid/bin/gpnptool create-o="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" -ovr -prf-prf_sq=1 -prf_cn=racbde-scan -prf_pa="" -hnet=gen-gen:hnet_nm="*" -gen:net=net1 -net1:net_ip="10.141.154.0"-net1:net_ada="eth1" -net1:net_use="public" -gen:net=net2-net2:net_ip="192.168.0.0" -net2:net_ada="eth0"-net2:net_use="cluster_interconnect" -css=css-css:css_dis="" -css:css_ld=400 -asm=asm-asm:asm_dis="/dev/sdb*" -asm:asm_spf=""
      2009-12-23 19:24:55: Running as user oracle: /u01/app/grid/bin/gpnptool create-o="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" -ovr -prf-prf_sq=1 -prf_cn=racbde-scan -prf_pa="" -hnet=gen-gen:hnet_nm="*" -gen:net=net1 -net1:net_ip="10.141.154.0"-net1:net_ada="eth1" -net1:net_use="public" -gen:net=net2-net2:net_ip="192.168.0.0" -net2:net_ada="eth0"-net2:net_use="cluster_interconnect" -css=css -css:css_dis=""-css:css_ld=400 -asm=asm -asm:asm_dis="/dev/sdb*"-asm:asm_spf=""
      2009-12-23 19:24:55: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/gpnptool create-o="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" -ovr -prf-prf_sq=1 -prf_cn=racbde-scan -prf_pa="" -hnet=gen-gen:hnet_nm="*" -gen:net=net1 -net1:net_ip="10.141.154.0"-net1:net_ada="eth1" -net1:net_use="public" -gen:net=net2-net2:net_ip="192.168.0.0" -net2:net_ada="eth0"-net2:net_use="cluster_interconnect" -css=css-css:css_dis="" -css:css_ld=400 -asm=asm-asm:asm_dis="/dev/sdb*" -asm:asm_spf="" '
      2009-12-23 19:24:55: Removing file /tmp/fileDple0c
      2009-12-23 19:24:55: Successfully removed file: /tmp/fileDple0c
      2009-12-23 19:24:55: /bin/su successfully executed

      2009-12-23 19:24:55: gpnptool: rc=0
      2009-12-23 19:24:55: gpnptool output:
      Resulting profile written to"/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml".
      Success.

      2009-12-23 19:24:55: gpnptool: run /u01/app/grid/bin/gpnptool sign-p="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml"-o="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" -ovr-w="file:/u01/app/grid/gpnp/racbde1/wallets/peer" -rmws
      2009-12-23 19:24:55: Running as user oracle: /u01/app/grid/bin/gpnptool sign-p="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml"-o="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" -ovr-w="file:/u01/app/grid/gpnp/racbde1/wallets/peer" -rmws
      2009-12-23 19:24:55: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/gpnptool sign -p="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml"-o="/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml" -ovr-w="file:/u01/app/grid/gpnp/racbde1/wallets/peer" -rmws '
      2009-12-23 19:24:55: Removing file /tmp/fileWLaWwU
      2009-12-23 19:24:55: Successfully removed file: /tmp/fileWLaWwU
      2009-12-23 19:24:55: /bin/su successfully executed

      2009-12-23 19:24:55: gpnptool: rc=0
      2009-12-23 19:24:55: gpnptool output:
      Resulting profile written to"/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml".
      Success.

      2009-12-23 19:24:55: GPnP peer profile create successfully completed.
      2009-12-23 19:24:55: <--- GPnP peer profile successfully created
      2009-12-23 19:24:55: GPnP local setup successfully created



      First Node Setup and copy files for OHASD daemon:

      2009-12-2319:24:55: Registering ohasd
      2009-12-23 19:24:55: init file = /u01/app/grid/crs/init/init.ohasd
      2009-12-23 19:24:55: Copying file /u01/app/grid/crs/init/init.ohasd to/etc/init.d directory
      2009-12-23 19:24:55: Setting init.ohasd permission in /etc/init.d directory
      2009-12-23 19:24:55: init file = /u01/app/grid/crs/init/ohasd
      2009-12-23 19:24:55: Copying file /u01/app/grid/crs/init/ohasd to /etc/init.ddirectory
      2009-12-23 19:24:55: Setting ohasd permission in /etc/init.d directory
      2009-12-23 19:24:55: Removing "/etc/rc.d/rc3.d/S96ohasd"
      2009-12-23 19:24:55: Removing file /etc/rc.d/rc3.d/S96ohasd
      2009-12-23 19:24:55: Failure with return code 1 from command rm/etc/rc.d/rc3.d/S96ohasd
      2009-12-23 19:24:55: Failed to remove file:
      2009-12-23 19:24:55: Creating a link "/etc/rc.d/rc3.d/S96ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:24:55: Removing "/etc/rc.d/rc5.d/S96ohasd"
      2009-12-23 19:24:55: Removing file /etc/rc.d/rc5.d/S96ohasd
      2009-12-23 19:24:55: Failure with return code 1 from command rm/etc/rc.d/rc5.d/S96ohasd
      2009-12-23 19:24:55: Failed to remove file:
      2009-12-23 19:24:55: Creating a link "/etc/rc.d/rc5.d/S96ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:24:55: Removing "/etc/rc.d/rc0.d/K19ohasd"
      2009-12-23 19:24:55: Removing file /etc/rc.d/rc0.d/K19ohasd
      2009-12-23 19:24:55: Failure with return code 1 from command rm/etc/rc.d/rc0.d/K19ohasd
      2009-12-23 19:24:55: Failed to remove file:
      2009-12-23 19:24:55: Creating a link "/etc/rc.d/rc0.d/K19ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:24:55: Removing "/etc/rc.d/rc1.d/K19ohasd"
      2009-12-23 19:24:55: Removing file /etc/rc.d/rc1.d/K19ohasd
      2009-12-23 19:24:55: Failure with return code 1 from command rm/etc/rc.d/rc1.d/K19ohasd
      2009-12-23 19:24:55: Failed to remove file:
      2009-12-23 19:24:55: Creating a link "/etc/rc.d/rc1.d/K19ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:24:55: Removing "/etc/rc.d/rc2.d/K19ohasd"
      2009-12-23 19:24:55: Removing file /etc/rc.d/rc2.d/K19ohasd
      2009-12-23 19:24:55: Failure with return code 1 from command rm/etc/rc.d/rc2.d/K19ohasd
      2009-12-23 19:24:55: Failed to remove file:
      2009-12-23 19:24:55: Creating a link "/etc/rc.d/rc2.d/K19ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:24:55: Removing "/etc/rc.d/rc4.d/K19ohasd"
      2009-12-23 19:24:55: Removing file /etc/rc.d/rc4.d/K19ohasd
      2009-12-23 19:24:56: Failure with return code 1 from command rm/etc/rc.d/rc4.d/K19ohasd
      2009-12-23 19:24:56: Failed to remove file:
      2009-12-23 19:24:56: Creating a link "/etc/rc.d/rc4.d/K19ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:24:56: Removing "/etc/rc.d/rc6.d/K19ohasd"
      2009-12-23 19:24:56: Removing file /etc/rc.d/rc6.d/K19ohasd
      2009-12-23 19:24:56: Failure with return code 1 from command rm/etc/rc.d/rc6.d/K19ohasd
      2009-12-23 19:24:56: Failed to remove file:
      2009-12-23 19:24:56: Creating a link "/etc/rc.d/rc6.d/K19ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:24:56: The file ohasd has been successfully linked to the RCdirectories



      First Node Start OHASD Daemon:

      2009-12-2319:24:56: Starting ohasd
      2009-12-23 19:24:56: itab entries=
      2009-12-23 19:25:01: Created backup /etc/inittab.no_crs
      2009-12-23 19:25:01: Appending to /etc/inittab.tmp:
      2009-12-23 19:25:01: h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null2>&1 </dev/null

      2009-12-23 19:25:01: Done updating /etc/inittab.tmp
      2009-12-23 19:25:01: Saved /etc/inittab.crs
      2009-12-23 19:25:01: Installed new /etc/inittab
      2009-12-23 19:25:06: ohasd is starting
      2009-12-23 19:25:06: Checking ohasd
      2009-12-23 19:25:06: ohasd started successfully



      First Node Copy required CRS resources for OHASD to start:

      2009-12-2319:25:06: Creating CRS resources and dependencies
      2009-12-23 19:25:06: Configuring HASD
      2009-12-23 19:25:06: Registering type ora.daemon.type
      2009-12-23 19:25:07: Registering type ora.mdns.type
      2009-12-23 19:25:07: Registering type ora.gpnp.type
      2009-12-23 19:25:07: Registering type ora.gipc.type
      2009-12-23 19:25:07: Registering type ora.cssd.type
      2009-12-23 19:25:08: Registering type ora.cssdmonitor.type
      2009-12-23 19:25:08: Registering type ora.crs.type
      2009-12-23 19:25:08: Registering type ora.evm.type
      2009-12-23 19:25:08: Registering type ora.ctss.type
      2009-12-23 19:25:08: Registering type ora.asm.type
      2009-12-23 19:25:09: Registering type ora.drivers.acfs.type
      2009-12-23 19:25:09: Registering type ora.diskmon.type
      2009-12-23 19:25:28: ADVM/ACFS is configured

      2009-12-23 19:25:28: Successfully created CRS resources for cluster daemon andASM
      2009-12-23 19:25:28: Checking if initial configuration has been performed



      First Node Start in Exclusive Mode and Configure Diskgroup:

      2009-12-2319:25:28: Starting CSS in exclusive mode
      2009-12-23 19:25:55: CRS-2672: Attempting to start 'ora.gipcd' on 'racbde1'
      2009-12-23 19:25:55: CRS-2672: Attempting to start 'ora.mdnsd' on 'racbde1'
      2009-12-23 19:25:55: CRS-2676: Start of 'ora.gipcd' on 'racbde1' succeeded
      2009-12-23 19:25:55: CRS-2676: Start of 'ora.mdnsd' on 'racbde1' succeeded
      2009-12-23 19:25:55: CRS-2672: Attempting to start 'ora.gpnpd' on 'racbde1'
      2009-12-23 19:25:55: CRS-2676: Start of 'ora.gpnpd' on 'racbde1' succeeded
      2009-12-23 19:25:55: CRS-2672: Attempting to start 'ora.cssdmonitor' on'racbde1'
      2009-12-23 19:25:55: CRS-2676: Start of 'ora.cssdmonitor' on 'racbde1'succeeded
      2009-12-23 19:25:55: CRS-2672: Attempting to start 'ora.cssd' on 'racbde1'
      2009-12-23 19:25:55: CRS-2672: Attempting to start 'ora.diskmon' on 'racbde1'
      2009-12-23 19:25:55: CRS-2676: Start of 'ora.diskmon' on 'racbde1' succeeded
      2009-12-23 19:25:55: CRS-2676: Start of 'ora.cssd' on 'racbde1' succeeded
      2009-12-23 19:25:55: Querying for existing CSS voting disks
      2009-12-23 19:25:55: Performing initial configuration for cluster
      2009-12-23 19:25:56: Start of resource "ora.ctssd -init" Succeeded
      2009-12-23 19:25:56: Configuring ASM via ASMCA
      2009-12-23 19:25:56: Executing as oracle: /u01/app/grid/bin/asmca -silent-diskGroupName SYSTEMDG -diskList /dev/sdb1,/dev/sdb2,/dev/sdb3 -redundancyNORMAL -diskString '/dev/sdb*' -configureLocalASM
      2009-12-23 19:25:56: Running as user oracle: /u01/app/grid/bin/asmca -silent-diskGroupName SYSTEMDG -diskList /dev/sdb1,/dev/sdb2,/dev/sdb3 -redundancyNORMAL -diskString '/dev/sdb*' -configureLocalASM
      2009-12-23 19:25:56:   Invoking "/u01/app/grid/bin/asmca -silent-diskGroupName SYSTEMDG -diskList /dev/sdb1,/dev/sdb2,/dev/sdb3 -redundancyNORMAL -diskString '/dev/sdb*' -configureLocalASM" as user"oracle"
      2009-12-23 19:30:21: Creating or upgrading OCR keys
      2009-12-23 19:30:31: OCR keys are successfully populated
      2009-12-23 19:30:31: Invalidating repository location for Oracle 9i deployments
      2009-12-23 19:30:31: Executing clscfg
      2009-12-23 19:30:38: Oracle Cluster Registry initialization completed
      2009-12-23 19:30:40: Start of resource "ora.crsd -init" Succeeded
      2009-12-23 19:30:40: Creating voting files
      2009-12-23 19:30:40: Creating voting files in ASM diskgroup SYSTEMDG
      2009-12-23 19:30:40: Executing crsctl replace votedisk +SYSTEMDG


      First Node Push GPnP Profile to Remote Node(s):

      2009-12-2319:31:55: Promoting local gpnp setup to cluster-wide. Nodes {racbde1,racbde2}
      2009-12-23 19:31:55: Pushing local gpnpsetup to cluster nodes:{racbde1,racbde2}
      2009-12-23 19:31:55:   /tmp/fileg6883M => /u01/app/grid/gpnp/manifest.txt
      2009-12-23 19:31:55:      rmtcpy:/u01/app/grid/bin/cluutil -sourcefile /tmp/fileg6883M -destfile /u01/app/grid/gpnp/manifest.txt-nodelist racbde1,racbde2
      2009-12-23 19:31:55: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /tmp/fileg6883M -destfile /u01/app/grid/gpnp/manifest.txt -nodelistracbde1,racbde2
      2009-12-23 19:31:55: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile /tmp/fileg6883M -destfile/u01/app/grid/gpnp/manifest.txt -nodelist racbde1,racbde2 '
      2009-12-23 19:31:56: Removing file /tmp/fileMlmyGF
      2009-12-23 19:31:56: Successfully removed file: /tmp/fileMlmyGF
      2009-12-23 19:31:56: /bin/su successfully executed

      2009-12-23 19:31:56:  /u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml => /u01/app/grid/gpnp/profiles/peer/profile.xml
      2009-12-23 19:31:56:      rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml -destfile/u01/app/grid/gpnp/profiles/peer/profile.xml -nodelist racbde1,racbde2
      2009-12-23 19:31:56: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml -destfile/u01/app/grid/gpnp/profiles/peer/profile.xml -nodelist racbde1,racbde2
      2009-12-23 19:31:56: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/profiles/peer/profile.xml -destfile/u01/app/grid/gpnp/profiles/peer/profile.xml -nodelist racbde1,racbde2 '
      2009-12-23 19:31:56: Removing file /tmp/filePm9QYA
      2009-12-23 19:31:56: Successfully removed file: /tmp/filePm9QYA
      2009-12-23 19:31:56: /bin/su successfully executed

      2009-12-23 19:31:56:  /u01/app/grid/gpnp/racbde1/wallets/peer/cwallet.sso => /u01/app/grid/gpnp/wallets/peer/cwallet.sso
      2009-12-23 19:31:56:      rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/peer/cwallet.sso -destfile /u01/app/grid/gpnp/wallets/peer/cwallet.sso-nodelist racbde1,racbde2
      2009-12-23 19:31:56: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/wallets/peer/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/peer/cwallet.sso -nodelist racbde1,racbde2
      2009-12-23 19:31:56: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/peer/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/peer/cwallet.sso -nodelist racbde1,racbde2 '
      2009-12-23 19:31:57: Removing file /tmp/file2trrwx
      2009-12-23 19:31:57: Successfully removed file: /tmp/file2trrwx
      2009-12-23 19:31:57: /bin/su successfully executed

      2009-12-23 19:31:57:  /u01/app/grid/gpnp/racbde1/profiles/peer/profile_orig.xml =>  /u01/app/grid/gpnp/profiles/peer/profile_orig.xml
      2009-12-23 19:31:57:      rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/profiles/peer/profile_orig.xml -destfile/u01/app/grid/gpnp/profiles/peer/profile_orig.xml -nodelist racbde1,racbde2
      2009-12-23 19:31:57: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/profiles/peer/profile_orig.xml -destfile/u01/app/grid/gpnp/profiles/peer/profile_orig.xml -nodelist racbde1,racbde2
      2009-12-23 19:31:57: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/profiles/peer/profile_orig.xml -destfile/u01/app/grid/gpnp/profiles/peer/profile_orig.xml -nodelist racbde1,racbde2 '
      2009-12-23 19:31:57: Removing file /tmp/fileZqRXjv
      2009-12-23 19:31:57: Successfully removed file: /tmp/fileZqRXjv
      2009-12-23 19:31:57: /bin/su successfully executed

      2009-12-23 19:31:57:  /u01/app/grid/gpnp/racbde1/wallets/root/ewallet.p12 => /u01/app/grid/gpnp/wallets/root/ewallet.p12
      2009-12-23 19:31:57:      rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/root/ewallet.p12 -destfile/u01/app/grid/gpnp/wallets/root/ewallet.p12 -nodelist racbde1,racbde2
      2009-12-23 19:31:57: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/wallets/root/ewallet.p12 -destfile/u01/app/grid/gpnp/wallets/root/ewallet.p12 -nodelist racbde1,racbde2
      2009-12-23 19:31:57: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/root/ewallet.p12 -destfile/u01/app/grid/gpnp/wallets/root/ewallet.p12 -nodelist racbde1,racbde2 '
      2009-12-23 19:31:57: Removing file /tmp/filecX5Reu
      2009-12-23 19:31:57: Successfully removed file: /tmp/filecX5Reu
      2009-12-23 19:31:57: /bin/su successfully executed

      2009-12-23 19:31:57:  /u01/app/grid/gpnp/racbde1/wallets/prdr/cwallet.sso => /u01/app/grid/gpnp/wallets/prdr/cwallet.sso
      2009-12-23 19:31:57:      rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/prdr/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/prdr/cwallet.sso -nodelist racbde1,racbde2
      2009-12-23 19:31:57: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/wallets/prdr/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/prdr/cwallet.sso -nodelist racbde1,racbde2
      2009-12-23 19:31:57: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/prdr/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/prdr/cwallet.sso -nodelist racbde1,racbde2 '
      2009-12-23 19:31:58: Removing file /tmp/filejENXcu
      2009-12-23 19:31:58: Successfully removed file: /tmp/filejENXcu
      2009-12-23 19:31:58: /bin/su successfully executed

      2009-12-23 19:31:58:  /u01/app/grid/gpnp/racbde1/wallets/pa/cwallet.sso => /u01/app/grid/gpnp/wallets/pa/cwallet.sso
      2009-12-23 19:31:58:      rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/pa/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/pa/cwallet.sso -nodelist racbde1,racbde2
      2009-12-23 19:31:58: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/wallets/pa/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/pa/cwallet.sso -nodelist racbde1,racbde2
      2009-12-23 19:31:58: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/pa/cwallet.sso -destfile/u01/app/grid/gpnp/wallets/pa/cwallet.sso -nodelist racbde1,racbde2 '
      2009-12-23 19:31:58: Removing file /tmp/filed8XZpv
      2009-12-23 19:31:58: Successfully removed file: /tmp/filed8XZpv
      2009-12-23 19:31:58: /bin/su successfully executed

      2009-12-23 19:31:58:  /u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt => /u01/app/grid/gpnp/wallets/root/b64certificate.txt
      2009-12-23 19:31:58:      rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt -destfile/u01/app/grid/gpnp/wallets/root/b64certificate.txt -nodelist racbde1,racbde2
      2009-12-23 19:31:58: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt-destfile /u01/app/grid/gpnp/wallets/root/b64certificate.txt -nodelistracbde1,racbde2
      2009-12-23 19:31:58: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/root/b64certificate.txt -destfile/u01/app/grid/gpnp/wallets/root/b64certificate.txt -nodelist racbde1,racbde2 '
      2009-12-23 19:31:59: Removing file /tmp/file2UPPUx
      2009-12-23 19:31:59: Successfully removed file: /tmp/file2UPPUx
      2009-12-23 19:31:59: /bin/su successfully executed

      2009-12-23 19:31:59:  /u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt => /u01/app/grid/gpnp/wallets/peer/cert.txt
      2009-12-23 19:31:59:      rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt -destfile/u01/app/grid/gpnp/wallets/peer/cert.txt -nodelist racbde1,racbde2
      2009-12-23 19:31:59: Running as user oracle: /u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt -destfile/u01/app/grid/gpnp/wallets/peer/cert.txt -nodelist racbde1,racbde2
      2009-12-23 19:31:59: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/racbde1/wallets/peer/cert.txt-destfile /u01/app/grid/gpnp/wallets/peer/cert.txt -nodelist racbde1,racbde2 '
      2009-12-23 19:31:59: Removing file /tmp/fileRL2LFB
      2009-12-23 19:31:59: Successfully removed file: /tmp/fileRL2LFB
      2009-12-23 19:31:59: /bin/su successfully executed

      2009-12-23 19:31:59:   /u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt=>  /u01/app/grid/gpnp/wallets/pa/cert.txt
      2009-12-23 19:31:59:      rmtcpy:/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt -destfile/u01/app/grid/gpnp/wallets/pa/cert.txt -nodelist racbde1,racbde2
      2009-12-23 19:31:59: Running as user oracle: /u01/app/grid/bin/cluutil-sourcefile /u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt -destfile/u01/app/grid/gpnp/wallets/pa/cert.txt -nodelist racbde1,racbde2
      2009-12-23 19:31:59: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/cluutil -sourcefile/u01/app/grid/gpnp/racbde1/wallets/pa/cert.txt -destfile/u01/app/grid/gpnp/wallets/pa/cert.txt -nodelist racbde1,racbde2 '
      2009-12-23 19:32:00: Removing file /tmp/fileWwdzFG
      2009-12-23 19:32:00: Successfully removed file: /tmp/fileWwdzFG
      2009-12-23 19:32:00: /bin/su successfully executed

      2009-12-23 19:32:00: Exiting exclusive mode



      First Node Start Full Clusterware Stack:

      2009-12-2319:32:39: Starting
      2009-12-23 19:32:40: Start of resource "ora.mdnsd -init" Succeeded
      2009-12-23 19:32:41: Start of resource "ora.gipcd -init" Succeeded
      2009-12-23 19:32:43: Start of resource "ora.gpnpd -init" Succeeded
      2009-12-23 19:32:43: Successfully started requested Oracle stack daemons
      2009-12-23 19:32:43: Starting CSS in clustered mode
      2009-12-23 19:34:26: CRS-2672: Attempting to start 'ora.cssdmonitor' on'racbde1'
      2009-12-23 19:34:26: CRS-2676: Start of 'ora.cssdmonitor' on 'racbde1' succeeded
      2009-12-23 19:34:26: CRS-2672: Attempting to start 'ora.cssd' on 'racbde1'
      2009-12-23 19:34:26: CRS-2672: Attempting to start 'ora.diskmon' on 'racbde1'
      2009-12-23 19:34:26: CRS-2676: Start of 'ora.diskmon' on 'racbde1' succeeded
      2009-12-23 19:34:26: CRS-2676: Start of 'ora.cssd' on 'racbde1' succeeded
      2009-12-23 19:34:27: Start of resource "ora.ctssd -init -envUSR_ORA_ENV=CTSS_REBOOT=TRUE" Succeeded
      2009-12-23 19:34:40: Start of resource "ora.asm -init" Succeeded
      2009-12-23 19:34:41: Start of resource "ora.crsd -init" Succeeded
      2009-12-23 19:34:42: Start of resource "ora.evmd -init" Succeeded
      2009-12-23 19:34:42: Successfully started Oracle clusterware stack
      2009-12-23 19:34:42: Waiting for Oracle CRSD and EVMD to start
      2009-12-23 19:34:48: Oracle CRS stack installed and running



      First Node Adding Clusterware Resources:

      2009-12-2319:34:48: Configuring node
      2009-12-23 19:34:48: adding nodeapps...
      2009-12-23 19:34:48: upgrade_opt=
      2009-12-23 19:34:48: nodevip=racbde1-vip/255.255.254.0/eth1
      2009-12-23 19:34:48: DHCP_flag=0
      2009-12-23 19:34:48: nodes_to_add=racbde1
      2009-12-23 19:34:48: add nodeapps for static IP
      2009-12-23 19:34:48: Running srvctl config nodeapps to detect if VIP exists
      2009-12-23 19:34:49: output=PRKO-2312 : GSD does not exist.
       PRKO-2331 : ONS daemon does not exist.
       PRKO-2339 : eONS daemon does not exist.

      2009-12-23 19:34:49: Invoking "/u01/app/grid/bin/srvctl add nodeapps -nracbde1 -A "racbde1-vip/255.255.254.0/eth1" "
      2009-12-23 19:34:49: trace file=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg0.log
      2009-12-23 19:35:16: add nodeapps -n racbde1 -A racbde1-vip/255.255.254.0/eth1on node=racbde1 ... passed
      2009-12-23 19:35:16: nodes_to_start=racbde1
      2009-12-23 19:35:16: Configuring first node
      2009-12-23 19:35:16: DHCP_flag=0
      2009-12-23 19:35:16: nodes_to_start=racbde1
      2009-12-23 19:35:17: check ASM exists done and ASM does not exist
      2009-12-23 19:35:17: Prior version ASM does not exist , Invoking add asm
      2009-12-23 19:35:17: Invoking "/u01/app/grid/bin/srvctl add asm"
      2009-12-23 19:35:17: tracefile=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg1.log
      2009-12-23 19:35:17: Running as user oracle: /u01/app/grid/bin/srvctl add asm
      2009-12-23 19:35:17:   Invoking "/u01/app/grid/bin/srvctl addasm" as user "oracle"
      2009-12-23 19:35:24: add asm ... success
      2009-12-23 19:35:24: Adding ASM diskgroup resource
      2009-12-23 19:35:24: Running as user oracle: /u01/app/grid/bin/crsctl creatediskgroup SYSTEMDG
      2009-12-23 19:35:24:   Invoking "/u01/app/grid/bin/crsctl creatediskgroup SYSTEMDG" as user "oracle"
      2009-12-23 19:35:26: create diskgroup SYSTEMDG ... success
      2009-12-23 19:35:26: Successfully created disk group resource
      2009-12-23 19:35:27: Invoking: /u01/app/grid/bin/crsctl add typeora.registry.acfs.type -basetype ora.local_resource.type -file /u01/app/grid/crs/template/registry.acfs.type
      2009-12-23 19:35:29: add ora.registry.acfs.type ... success
      2009-12-23 19:35:29: Invoking: /u01/app/grid/bin/crsctl add resourceora.registry.acfs -attr ACL='owner:root:rwx,pgrp:oinstall:r-x,other::r--' -typeora.registry.acfs.type -f
      2009-12-23 19:35:30: add resource ora.registry.acfs ... success
      2009-12-23 19:35:30: GNS is not to be configured - skipping
      2009-12-23 19:35:30: Invoking "/u01/app/grid/bin/srvctl add scan -nracbde-scan.us.oracle.com"
      2009-12-23 19:35:30: tracefile=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg2.log
      2009-12-23 19:35:35: add scan=racbde-scan.us.oracle.com ... success
      2009-12-23 19:35:35: Invoking "/u01/app/grid/bin/srvctl add scan_listener-p 1521"
      2009-12-23 19:35:35: trace file=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg3.log
      2009-12-23 19:35:35: Running as user oracle: /u01/app/grid/bin/srvctl addscan_listener -p 1521
      2009-12-23 19:35:35:   Invoking "/u01/app/grid/bin/srvctl addscan_listener -p 1521" as user "oracle"
      2009-12-23 19:35:41: add scan listener ... success
      2009-12-23 19:35:41: Running as user oracle: /u01/app/grid/bin/srvctl add oc4j
      2009-12-23 19:35:41:   Invoking "/u01/app/grid/bin/srvctl addoc4j" as user "oracle"
      2009-12-23 19:35:44: J2EE (OC4J) Container Resource Add ... passed ...
      2009-12-23 19:35:44: starting nodeapps...
      2009-12-23 19:35:44: DHCP_flag=0
      2009-12-23 19:35:44: nodes_to_start=racbde1
      2009-12-23 19:35:54: exit value of start nodeapps/vip is 0
      2009-12-23 19:35:54: GNS is not to be configured - skipping
      2009-12-23 19:35:54: Invoking "/u01/app/grid/bin/srvctl start scan"
      2009-12-23 19:35:54: tracefile=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg5.log
      2009-12-23 19:36:04: start scan ... success
      2009-12-23 19:36:04: Invoking "/u01/app/grid/bin/srvctl start scan_listener"
      2009-12-23 19:36:04: tracefile=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg6.log
      2009-12-23 19:36:04: Running as user oracle: /u01/app/grid/bin/srvctl startscan_listener
      2009-12-23 19:36:04:   Invoking "/u01/app/grid/bin/srvctl startscan_listener" as user "oracle"
      2009-12-23 19:36:07: start scan listener ... success
      2009-12-23 19:36:07: Running as user oracle: /u01/app/grid/bin/srvctl disableoc4j
      2009-12-23 19:36:07:   Invoking "/u01/app/grid/bin/srvctldisable oc4j" as user "oracle"
      2009-12-23 19:36:08: J2EE (OC4J) Container Resource Disable ... passed ...
      2009-12-23 19:36:08: starting acfs_registry...
      2009-12-23 19:36:08: nodes_to_start=racbde1
      2009-12-23 19:36:09: /u01/app/grid/bin/crsctl start res ora.registry.acfs -nracbde1 ... success
      2009-12-23 19:36:09: SRVCONFIG=/var/opt/oracle/srvConfig.loc
      2009-12-23 19:36:09: Oracle 92 configuration and SKGXN library does not exists
      2009-12-23 19:36:09: /u01/app/grid/bin/ocrconfig -local -manualbackup ...passed
      2009-12-23 19:36:09: Install cvuqdisk rpm on Linux...
      2009-12-23 19:36:09: New package to install is/u01/app/grid/cv/rpm/cvuqdisk-1.0.7-1.rpm
      2009-12-23 19:36:09: Invoking "/bin/rpm -q cvuqdisk" command
      2009-12-23 19:36:10: no existing cvuqdisk found
      2009-12-23 19:36:10: removing old rpm
      2009-12-23 19:36:10: installing/upgrading new rpm
      2009-12-23 19:36:11: Configure Oracle Grid Infrastructure for a Cluster ...succeeded



      Secondary Note Initial Setup (racbde2):

      2009-12-2319:33:41: The configuration parameter file /u01/app/grid/crs/install/crsconfig_paramsis valid
      2009-12-23 19:33:41: Checking for super user privileges
      2009-12-23 19:33:41: User has super user privileges
      2009-12-23 19:33:41: ### Printing the configuration values from files:
      2009-12-23 19:33:41:    /u01/app/grid/crs/install/crsconfig_params
      2009-12-23 19:33:41:   /u01/app/grid/crs/install/s_crsconfig_defs
      2009-12-23 19:33:41: ASM_DISCOVERY_STRING=/dev/sdb*
      2009-12-23 19:33:41: ASM_DISKS=/dev/sdb1,/dev/sdb2,/dev/sdb3
      2009-12-23 19:33:41: ASM_DISK_GROUP=SYSTEMDG
      2009-12-23 19:33:41: ASM_REDUNDANCY=NORMAL
      2009-12-23 19:33:41: ASM_SPFILE=
      2009-12-23 19:33:41: ASM_UPGRADE=false
      2009-12-23 19:33:41: CLSCFG_MISSCOUNT=
      2009-12-23 19:33:41: CLUSTER_GUID=
      2009-12-23 19:33:41: CLUSTER_NAME=racbde-scan
      2009-12-23 19:33:41: CRS_NODEVIPS='racbde1-vip/255.255.254.0/eth1,racbde2-vip/255.255.254.0/eth1'
      2009-12-23 19:33:41: CRS_STORAGE_OPTION=1
      2009-12-23 19:33:41: CSS_LEASEDURATION=400
      2009-12-23 19:33:41: DIRPREFIX=
      2009-12-23 19:33:41: DISABLE_OPROCD=0
      2009-12-23 19:33:41: EMBASEJAR_NAME=oemlt.jar
      2009-12-23 19:33:41: EWTJAR_NAME=ewt3.jar
      2009-12-23 19:33:41: EXTERNAL_ORACLE_BIN=/opt/oracle/bin
      2009-12-23 19:33:41: GNS_ADDR_LIST=
      2009-12-23 19:33:41: GNS_ALLOW_NET_LIST=
      2009-12-23 19:33:41: GNS_CONF=false
      2009-12-23 19:33:41: GNS_DENY_ITF_LIST=
      2009-12-23 19:33:41: GNS_DENY_NET_LIST=
      2009-12-23 19:33:41: GNS_DOMAIN_LIST=
      2009-12-23 19:33:41: GPNPCONFIGDIR=/u01/app/grid
      2009-12-23 19:33:41: GPNPGCONFIGDIR=/u01/app/grid
      2009-12-23 19:33:41: GPNP_PA=
      2009-12-23 19:33:41: HELPJAR_NAME=help4.jar
      2009-12-23 19:33:41: HOST_NAME_LIST=racbde1,racbde2
      2009-12-23 19:33:41: ID=/etc/init.d
      2009-12-23 19:33:41: INIT=/sbin/init
      2009-12-23 19:33:41: IT=/etc/inittab
      2009-12-23 19:33:41: JEWTJAR_NAME=jewt4.jar
      2009-12-23 19:33:41: JLIBDIR=/u01/app/grid/jlib
      2009-12-23 19:33:41: JREDIR=/u01/app/grid/jdk/jre/
      2009-12-23 19:33:41: LANGUAGE_ID=AMERICAN_AMERICA.AL32UTF8
      2009-12-23 19:33:41: MSGFILE=/var/adm/messages
      2009-12-23 19:33:41: NETCFGJAR_NAME=netcfg.jar
      2009-12-23 19:33:41: NETWORKS="eth1"/10.141.154.0:public,"eth0"/192.168.0.0:cluster_interconnect
      2009-12-23 19:33:41: NEW_HOST_NAME_LIST=
      2009-12-23 19:33:41:NEW_NODEVIPS='racbde1-vip/255.255.254.0/eth1,racbde2-vip/255.255.254.0/eth1'
      2009-12-23 19:33:41: NEW_NODE_NAME_LIST=
      2009-12-23 19:33:41: NEW_PRIVATE_NAME_LIST=
      2009-12-23 19:33:41: NODELIST=racbde1,racbde2
      2009-12-23 19:33:41: NODE_NAME_LIST=racbde1,racbde2
      2009-12-23 19:33:41: OCFS_CONFIG=
      2009-12-23 19:33:41: OCRCONFIG=/etc/oracle/ocr.loc
      2009-12-23 19:33:41: OCRCONFIGDIR=/etc/oracle
      2009-12-23 19:33:41: OCRID=
      2009-12-23 19:33:41: OCRLOC=ocr.loc
      2009-12-23 19:33:41: OCR_LOCATIONS=NO_VAL
      2009-12-23 19:33:41: OLASTGASPDIR=/etc/oracle/lastgasp
      2009-12-23 19:33:41: OLRCONFIG=/etc/oracle/olr.loc
      2009-12-23 19:33:41: OLRCONFIGDIR=/etc/oracle
      2009-12-23 19:33:41: OLRLOC=olr.loc
      2009-12-23 19:33:41: OPROCDCHECKDIR=/etc/oracle/oprocd/check
      2009-12-23 19:33:41: OPROCDDIR=/etc/oracle/oprocd
      2009-12-23 19:33:41: OPROCDFATALDIR=/etc/oracle/oprocd/fatal
      2009-12-23 19:33:41: OPROCDSTOPDIR=/etc/oracle/oprocd/stop
      2009-12-23 19:33:41: ORACLE_BASE=/u01/app/oracle
      2009-12-23 19:33:41: ORACLE_HOME=/u01/app/grid
      2009-12-23 19:33:41: ORACLE_OWNER=oracle
      2009-12-23 19:33:41: ORA_ASM_GROUP=oinstall
      2009-12-23 19:33:41: ORA_DBA_GROUP=oinstall
      2009-12-23 19:33:41: PRIVATE_NAME_LIST=
      2009-12-23 19:33:41: RCALLDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d/etc/rc.d/rc3.d /etc/rc.d/rc4.d /etc/rc.d/rc5.d /etc/rc.d/rc6.d
      2009-12-23 19:33:41: RCKDIR=/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d/etc/rc.d/rc4.d /etc/rc.d/rc6.d
      2009-12-23 19:33:41: RCSDIR=/etc/rc.d/rc3.d /etc/rc.d/rc5.d
      2009-12-23 19:33:41: RC_KILL=K19
      2009-12-23 19:33:41: RC_KILL_OLD=K96
      2009-12-23 19:33:41: RC_START=S96
      2009-12-23 19:33:41: SCAN_NAME=racbde-scan.us.oracle.com
      2009-12-23 19:33:41: SCAN_PORT=1521
      2009-12-23 19:33:41: SCRBASE=/etc/oracle/scls_scr
      2009-12-23 19:33:41: SHAREJAR_NAME=share.jar
      2009-12-23 19:33:41: SILENT=false
      2009-12-23 19:33:41: SO_EXT=so
      2009-12-23 19:33:41: SRVCFGLOC=srvConfig.loc
      2009-12-23 19:33:41: SRVCONFIG=/var/opt/oracle/srvConfig.loc
      2009-12-23 19:33:41: SRVCONFIGDIR=/var/opt/oracle
      2009-12-23 19:33:41: VNDR_CLUSTER=false
      2009-12-23 19:33:41: VOTING_DISKS=NO_VAL
      2009-12-23 19:33:41: ### Printing other configuration values ###
      2009-12-23 19:33:41: CLSCFG_EXTRA_PARMS=
      2009-12-23 19:33:41: CRSDelete=0
      2009-12-23 19:33:41: CRSPatch=0
      2009-12-23 19:33:41: DEBUG=
      2009-12-23 19:33:41: DOWNGRADE=
      2009-12-23 19:33:41: HAS_GROUP=oinstall
      2009-12-23 19:33:41: HAS_USER=root
      2009-12-23 19:33:41: HOST=racbde2
      2009-12-23 19:33:41: IS_SIHA=0
      2009-12-23 19:33:41: OLR_DIRECTORY=/u01/app/grid/cdata
      2009-12-23 19:33:41: OLR_LOCATION=/u01/app/grid/cdata/racbde2.olr
      2009-12-23 19:33:41: ORA_CRS_HOME=/u01/app/grid
      2009-12-23 19:33:41: SUPERUSER=root
      2009-12-23 19:33:41: UPGRADE=
      2009-12-23 19:33:41: VF_DISCOVERY_STRING=
      2009-12-23 19:33:41: addfile=/u01/app/grid/crs/install/crsconfig_addparams
      2009-12-23 19:33:41: crscfg_trace=1
      2009-12-23 19:33:41:crscfg_trace_file=/u01/app/grid/cfgtoollogs/crsconfig/rootcrs_racbde2.log
      2009-12-23 19:33:41: hosts=
      2009-12-23 19:33:41: oldcrshome=
      2009-12-23 19:33:41: oldcrsver=
      2009-12-23 19:33:41: osdfile=/u01/app/grid/crs/install/s_crsconfig_defs
      2009-12-23 19:33:41: parameters_valid=1
      2009-12-23 19:33:41: paramfile=/u01/app/grid/crs/install/crsconfig_params
      2009-12-23 19:33:41: platform_family=unix
      2009-12-23 19:33:41: srvctl_trc_suff=0
      2009-12-23 19:33:41: unlock_crshome=
      2009-12-23 19:33:41: user_is_superuser=1
      2009-12-23 19:33:41: ### Printing of configuration values complete ###
      2009-12-23 19:33:41: Oracle CRS stack is not configured yet
      2009-12-23 19:33:41: CRS is not yet configured. Hence, will proceed toconfigure CRS
      2009-12-23 19:33:41: Cluster-wide one-time actions... Done!
      2009-12-23 19:33:41: Oracle CRS home = /u01/app/grid
      2009-12-23 19:33:41: Host name = racbde2
      2009-12-23 19:33:41: CRS user = oracle
      2009-12-23 19:33:41: Oracle CRS home = /u01/app/grid
      2009-12-23 19:33:41: GPnP host = racbde2
      2009-12-23 19:33:41: Oracle GPnP home = /u01/app/grid/gpnp
      2009-12-23 19:33:41: Oracle GPnP local home = /u01/app/grid/gpnp/racbde2
      2009-12-23 19:33:41: GPnP directories verified.
      2009-12-23 19:33:41: Checking to see if Oracle CRS stack is already configured
      2009-12-23 19:33:41: Oracle CRS stack is not configured yet
      2009-12-23 19:33:41: ---Checking local gpnp setup...
      2009-12-23 19:33:41: The setup file"/u01/app/grid/gpnp/racbde2/profiles/peer/profile.xml" does not exist
      2009-12-23 19:33:41: The setup file"/u01/app/grid/gpnp/racbde2/wallets/peer/cwallet.sso" does not exist
      2009-12-23 19:33:41: The setup file "/u01/app/grid/gpnp/racbde2/wallets/prdr/cwallet.sso"does not exist
      2009-12-23 19:33:41: chk gpnphome /u01/app/grid/gpnp/racbde2: profile_ok 0wallet_ok 0 r/o_wallet_ok 0
      2009-12-23 19:33:41: chk gpnphome /u01/app/grid/gpnp/racbde2: INVALID (badprofile/wallet)



      Secondary Note Get GPnP Profile:

      2009-12-2319:33:41: ---Checking cluster-wide gpnp setup...
      2009-12-23 19:33:41: chk gpnphome /u01/app/grid/gpnp: profile_ok 1 wallet_ok 1r/o_wallet_ok 1
      2009-12-23 19:33:41: gpnptool: run /u01/app/grid/bin/gpnptool verify-p="/u01/app/grid/gpnp/profiles/peer/profile.xml"-w="file:/u01/app/grid/gpnp/wallets/peer" -wu=peer
      2009-12-23 19:33:41: Running as user oracle: /u01/app/grid/bin/gpnptool verify-p="/u01/app/grid/gpnp/profiles/peer/profile.xml"-w="file:/u01/app/grid/gpnp/wallets/peer" -wu=peer
      2009-12-23 19:33:41: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/gpnptool verify-p="/u01/app/grid/gpnp/profiles/peer/profile.xml"-w="file:/u01/app/grid/gpnp/wallets/peer" -wu=peer '
      2009-12-23 19:33:43: Removing file /tmp/file1cIHO0
      2009-12-23 19:33:43: Successfully removed file: /tmp/file1cIHO0
      2009-12-23 19:33:43: /bin/su successfully executed

      2009-12-23 19:33:43: gpnptool: rc=0
      2009-12-23 19:33:43: gpnptool output:
      Profile signature is valid.

      2009-12-23 19:33:43: Profile"/u01/app/grid/gpnp/profiles/peer/profile.xml" signature is VALID forwallet "file:/u01/app/grid/gpnp/wallets/peer"
      2009-12-23 19:33:43: gpnptool: run /u01/app/grid/bin/gpnptool verify-p="/u01/app/grid/gpnp/profiles/peer/profile.xml" -w="file:/u01/app/grid/gpnp/wallets/prdr"-wu=peer
      2009-12-23 19:33:43: Running as user oracle: /u01/app/grid/bin/gpnptool verify-p="/u01/app/grid/gpnp/profiles/peer/profile.xml"-w="file:/u01/app/grid/gpnp/wallets/prdr" -wu=peer
      2009-12-23 19:33:43: s_run_as_user2: Running /bin/su oracle -c '/u01/app/grid/bin/gpnptool verify-p="/u01/app/grid/gpnp/profiles/peer/profile.xml"-w="file:/u01/app/grid/gpnp/wallets/prdr" -wu=peer '
      2009-12-23 19:33:43: Removing file /tmp/filev2P2aX
      2009-12-23 19:33:43: Successfully removed file: /tmp/filev2P2aX
      2009-12-23 19:33:43: /bin/su successfully executed

      2009-12-23 19:33:43: gpnptool: rc=0
      2009-12-23 19:33:43: gpnptool output:
      Profile signature is valid.

      2009-12-23 19:33:43: Profile "/u01/app/grid/gpnp/profiles/peer/profile.xml"signature is VALID for wallet "file:/u01/app/grid/gpnp/wallets/prdr"
      2009-12-23 19:33:43: chk gpnphome /u01/app/grid/gpnp: OK
      2009-12-23 19:33:43: GPnP Wallets ownership/permissions successfully set.
      2009-12-23 19:33:43: gpnp setup checked: local valid? 0 cluster-wide valid? 1
      2009-12-23 19:33:43: Taking cluster-wide setup as local
      2009-12-23 19:33:43:   copy"/u01/app/grid/gpnp/profiles/peer/profile.xml" =>"/u01/app/grid/gpnp/racbde2/profiles/peer/profile.xml"
      2009-12-23 19:33:43:   set ownership on"/u01/app/grid/gpnp/racbde2/profiles/peer/profile.xml" =>(oracle,oinstall)
      2009-12-23 19:33:43:   copy"/u01/app/grid/gpnp/wallets/peer/cwallet.sso" =>"/u01/app/grid/gpnp/racbde2/wallets/peer/cwallet.sso"
      2009-12-23 19:33:43:   set ownership on "/u01/app/grid/gpnp/racbde2/wallets/peer/cwallet.sso"=> (oracle,oinstall)
      2009-12-23 19:33:43:   copy"/u01/app/grid/gpnp/wallets/prdr/cwallet.sso" =>"/u01/app/grid/gpnp/racbde2/wallets/prdr/cwallet.sso"
      2009-12-23 19:33:43:   set ownership on "/u01/app/grid/gpnp/racbde2/wallets/prdr/cwallet.sso"=> (oracle,oinstall)
      2009-12-23 19:33:43:   copy"/u01/app/grid/gpnp/profiles/peer/profile_orig.xml" =>"/u01/app/grid/gpnp/racbde2/profiles/peer/profile_orig.xml"
      2009-12-23 19:33:43:   set ownership on "/u01/app/grid/gpnp/racbde2/profiles/peer/profile_orig.xml"=> (oracle,oinstall)
      2009-12-23 19:33:43:   copy"/u01/app/grid/gpnp/wallets/root/ewallet.p12" =>"/u01/app/grid/gpnp/racbde2/wallets/root/ewallet.p12"
      2009-12-23 19:33:43:   set ownership on "/u01/app/grid/gpnp/racbde2/wallets/root/ewallet.p12"=> (oracle,oinstall)
      2009-12-23 19:33:43:   copy"/u01/app/grid/gpnp/wallets/pa/cwallet.sso" =>"/u01/app/grid/gpnp/racbde2/wallets/pa/cwallet.sso"
      2009-12-23 19:33:43:   set ownership on"/u01/app/grid/gpnp/racbde2/wallets/pa/cwallet.sso" =>(oracle,oinstall)
      2009-12-23 19:33:43:   copy"/u01/app/grid/gpnp/wallets/root/b64certificate.txt" =>"/u01/app/grid/gpnp/racbde2/wallets/root/b64certificate.txt"
      2009-12-23 19:33:43:   set ownership on"/u01/app/grid/gpnp/racbde2/wallets/root/b64certificate.txt" =>(oracle,oinstall)
      2009-12-23 19:33:43:   copy"/u01/app/grid/gpnp/wallets/peer/cert.txt" =>"/u01/app/grid/gpnp/racbde2/wallets/peer/cert.txt"
      2009-12-23 19:33:43:   set ownership on"/u01/app/grid/gpnp/racbde2/wallets/peer/cert.txt" =>(oracle,oinstall)
      2009-12-23 19:33:43:   copy"/u01/app/grid/gpnp/wallets/pa/cert.txt" =>"/u01/app/grid/gpnp/racbde2/wallets/pa/cert.txt"
      2009-12-23 19:33:43:   set ownership on"/u01/app/grid/gpnp/racbde2/wallets/pa/cert.txt" => (oracle,oinstall)
      2009-12-23 19:33:43: GPnP Wallets ownership/permissions successfully set.
      2009-12-23 19:33:43: gpnp setup: GOTCLUSTERWIDE
      2009-12-23 19:33:43: Validating for SI-CSS configuration



      Secondary Node Setup OLR for storing Oracle local registry data:

      2009-12-2319:33:43: Retrieving OCR main disk location
      2009-12-23 19:33:43: Opening file OCRCONFIG
      2009-12-23 19:33:43: Value () is set for key=ocrconfig_loc
      2009-12-23 19:33:43: Unable to retrieve ocr disk info
      2009-12-23 19:33:43: Checking to see if any 9i GSD is up
      2009-12-23 19:33:43: libskgxnBase_lib = /etc/ORCLcluster/oracm/lib/libskgxn2.so
      2009-12-23 19:33:43: libskgxn_lib = /opt/ORCLcluster/lib/libskgxn2.so
      2009-12-23 19:33:43: SKGXN library file does not exists
      2009-12-23 19:33:43: OLR location = /u01/app/grid/cdata/racbde2.olr
      2009-12-23 19:33:43: Oracle CRS Home = /u01/app/grid
      2009-12-23 19:33:43: Validating /etc/oracle/olr.loc file for OLR location/u01/app/grid/cdata/racbde2.olr
      2009-12-23 19:33:43: /etc/oracle/olr.loc already exists. Backing up /etc/oracle/olr.locto /etc/oracle/olr.loc.orig
      2009-12-23 19:33:43: Oracle CRS home = /u01/app/grid
      2009-12-23 19:33:43: Oracle cluster name = racbde-scan
      2009-12-23 19:33:43: OCR locations = +SYSTEMDG
      2009-12-23 19:33:43: Validating OCR
      2009-12-23 19:33:43: Retrieving OCR location used by previous installations
      2009-12-23 19:33:43: Opening file OCRCONFIG
      2009-12-23 19:33:43: Value () is set for key=ocrconfig_loc
      2009-12-23 19:33:43: Opening file OCRCONFIG
      2009-12-23 19:33:43: Value () is set for key=ocrmirrorconfig_loc
      2009-12-23 19:33:43: Opening file OCRCONFIG
      2009-12-23 19:33:43: Value () is set for key=ocrconfig_loc3
      2009-12-23 19:33:43: Opening file OCRCONFIG
      2009-12-23 19:33:43: Value () is set for key=ocrconfig_loc4
      2009-12-23 19:33:43: Opening file OCRCONFIG
      2009-12-23 19:33:43: Value () is set for key=ocrconfig_loc5
      2009-12-23 19:33:43: Checking if OCR sync file exists
      2009-12-23 19:33:43: No need to sync OCR file
      2009-12-23 19:33:43: OCR_LOCATION=+SYSTEMDG
      2009-12-23 19:33:43: OCR_MIRROR_LOCATION=
      2009-12-23 19:33:43: OCR_MIRROR_LOC3=
      2009-12-23 19:33:43: OCR_MIRROR_LOC4=
      2009-12-23 19:33:43: OCR_MIRROR_LOC5=
      2009-12-23 19:33:43: Current OCR location=
      2009-12-23 19:33:43: Current OCR mirror location=
      2009-12-23 19:33:43: Current OCR mirror loc3=
      2009-12-23 19:33:43: Current OCR mirror loc4=
      2009-12-23 19:33:43: Current OCR mirror loc5=
      2009-12-23 19:33:43: Verifying current OCR settings with user entered values
      2009-12-23 19:33:43: Setting OCR locations in /etc/oracle/ocr.loc
      2009-12-23 19:33:43: Validating OCR locations in /etc/oracle/ocr.loc
      2009-12-23 19:33:43: Checking for existence of /etc/oracle/ocr.loc
      2009-12-23 19:33:43: Backing up /etc/oracle/ocr.loc to /etc/oracle/ocr.loc.orig
      2009-12-23 19:33:43: Setting ocr location +SYSTEMDG
      2009-12-23 19:33:43: Creating or upgrading Oracle Local Registry (OLR)
      2009-12-23 19:33:43: OLR successfully created or upgraded
      2009-12-23 19:33:43: /u01/app/grid/bin/clscfg -localadd
      2009-12-23 19:33:43: Keys created in the OLR successfully
      2009-12-23 19:33:44: GPnP setup state: new-cluster-wide
      2009-12-23 19:33:44: GPnP cluster configuration already performed



      Secondary Node Setup and copy files for OHASD daemon:

      2009-12-2319:33:44: Registering ohasd
      2009-12-23 19:33:44: init file = /u01/app/grid/crs/init/init.ohasd
      2009-12-23 19:33:44: Copying file /u01/app/grid/crs/init/init.ohasd to/etc/init.d directory
      2009-12-23 19:33:44: Setting init.ohasd permission in /etc/init.d directory
      2009-12-23 19:33:44: init file = /u01/app/grid/crs/init/ohasd
      2009-12-23 19:33:44: Copying file /u01/app/grid/crs/init/ohasd to /etc/init.ddirectory
      2009-12-23 19:33:44: Setting ohasd permission in /etc/init.d directory
      2009-12-23 19:33:44: Removing "/etc/rc.d/rc3.d/S96ohasd"
      2009-12-23 19:33:44: Removing file /etc/rc.d/rc3.d/S96ohasd
      2009-12-23 19:33:44: Failure with return code 1 from command rm/etc/rc.d/rc3.d/S96ohasd
      2009-12-23 19:33:44: Failed to remove file:
      2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc3.d/S96ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:33:44: Removing "/etc/rc.d/rc5.d/S96ohasd"
      2009-12-23 19:33:44: Removing file /etc/rc.d/rc5.d/S96ohasd
      2009-12-23 19:33:44: Failure with return code 1 from command rm/etc/rc.d/rc5.d/S96ohasd
      2009-12-23 19:33:44: Failed to remove file:
      2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc5.d/S96ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:33:44: Removing "/etc/rc.d/rc0.d/K19ohasd"
      2009-12-23 19:33:44: Removing file /etc/rc.d/rc0.d/K19ohasd
      2009-12-23 19:33:44: Failure with return code 1 from command rm /etc/rc.d/rc0.d/K19ohasd
      2009-12-23 19:33:44: Failed to remove file:
      2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc0.d/K19ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:33:44: Removing "/etc/rc.d/rc1.d/K19ohasd"
      2009-12-23 19:33:44: Removing file /etc/rc.d/rc1.d/K19ohasd
      2009-12-23 19:33:44: Failure with return code 1 from command rm/etc/rc.d/rc1.d/K19ohasd
      2009-12-23 19:33:44: Failed to remove file:
      2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc1.d/K19ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:33:44: Removing "/etc/rc.d/rc2.d/K19ohasd"
      2009-12-23 19:33:44: Removing file /etc/rc.d/rc2.d/K19ohasd
      2009-12-23 19:33:44: Failure with return code 1 from command rm/etc/rc.d/rc2.d/K19ohasd
      2009-12-23 19:33:44: Failed to remove file:
      2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc2.d/K19ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:33:44: Removing "/etc/rc.d/rc4.d/K19ohasd"
      2009-12-23 19:33:44: Removing file /etc/rc.d/rc4.d/K19ohasd
      2009-12-23 19:33:44: Failure with return code 1 from command rm /etc/rc.d/rc4.d/K19ohasd
      2009-12-23 19:33:44: Failed to remove file:
      2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc4.d/K19ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:33:44: Removing "/etc/rc.d/rc6.d/K19ohasd"
      2009-12-23 19:33:44: Removing file /etc/rc.d/rc6.d/K19ohasd
      2009-12-23 19:33:44: Failure with return code 1 from command rm/etc/rc.d/rc6.d/K19ohasd
      2009-12-23 19:33:44: Failed to remove file:
      2009-12-23 19:33:44: Creating a link "/etc/rc.d/rc6.d/K19ohasd"pointing to /etc/init.d/ohasd
      2009-12-23 19:33:44: The file ohasd has been successfully linked to the RCdirectories
      2009-12-23 19:33:44: Starting ohasd
      2009-12-23 19:33:44: itab entries=
      2009-12-23 19:33:49: Created backup /etc/inittab.no_crs
      2009-12-23 19:33:49: Appending to /etc/inittab.tmp:
      2009-12-23 19:33:49: h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null2>&1 </dev/null

      2009-12-23 19:33:49: Done updating /etc/inittab.tmp
      2009-12-23 19:33:49: Saved /etc/inittab.crs
      2009-12-23 19:33:49: Installed new /etc/inittab



      Secondary Node Start OHASD Daemon:

      2009-12-2319:33:55: ohasd is starting
      2009-12-23 19:33:55: Checking ohasd
      2009-12-23 19:33:55: ohasd started successfully


      Secondary Node Copy required CRS resources for OHASD to start:

      2009-12-2319:33:55: Creating CRS resources and dependencies
      2009-12-23 19:33:55: Configuring HASD
      2009-12-23 19:33:55: Registering type ora.daemon.type
      2009-12-23 19:33:55: Registering type ora.mdns.type
      2009-12-23 19:33:55: Registering type ora.gpnp.type
      2009-12-23 19:33:55: Registering type ora.gipc.type
      2009-12-23 19:33:56: Registering type ora.cssd.type
      2009-12-23 19:33:56: Registering type ora.cssdmonitor.type
      2009-12-23 19:33:56: Registering type ora.crs.type
      2009-12-23 19:33:56: Registering type ora.evm.type
      2009-12-23 19:33:56: Registering type ora.ctss.type
      2009-12-23 19:33:57: Registering type ora.asm.type
      2009-12-23 19:33:57: Registering type ora.drivers.acfs.type
      2009-12-23 19:33:57: Registering type ora.diskmon.type
      2009-12-23 19:34:12: ADVM/ACFS is configured

      2009-12-23 19:34:12: Successfully created CRS resources for cluster daemon andASM
      2009-12-23 19:34:12: Checking if initial configuration has been performed
      2009-12-23 19:34:12: Starting CSS in exclusive mode
      2009-12-23 19:35:54: CRS-4402: The CSS daemon was started in exclusive mode butfound an active CSS daemon on node racbde1, number 1, and is terminating
      2009-12-23 19:35:54: An active cluster was found during exclusive startup,restarting to join the cluster



      Secondary Node Start Full Clusterware Stack:

      2009-12-2319:35:54: Starting
      2009-12-23 19:35:56: Start of resource "ora.mdnsd -init" Succeeded
      2009-12-23 19:35:57: Start of resource "ora.gipcd -init" Succeeded
      2009-12-23 19:35:58: Start of resource "ora.gpnpd -init" Succeeded
      2009-12-23 19:35:58: Successfully started requested Oracle stack daemons
      2009-12-23 19:35:58: Starting CSS in clustered mode
      2009-12-23 19:36:32: CRS-2672: Attempting to start 'ora.cssdmonitor' on'racbde2'
      2009-12-23 19:36:32: CRS-2676: Start of 'ora.cssdmonitor' on 'racbde2'succeeded
      2009-12-23 19:36:32: CRS-2672: Attempting to start 'ora.cssd' on 'racbde2'
      2009-12-23 19:36:32: CRS-2672: Attempting to start 'ora.diskmon' on 'racbde2'
      2009-12-23 19:36:32: CRS-2676: Start of 'ora.diskmon' on 'racbde2' succeeded
      2009-12-23 19:36:32: CRS-2676: Start of 'ora.cssd' on 'racbde2' succeeded
      2009-12-23 19:36:33: Start of resource "ora.ctssd -init -envUSR_ORA_ENV=CTSS_REBOOT=TRUE" Succeeded
      2009-12-23 19:39:25: Start of resource "ora.asm -init" Succeeded
      2009-12-23 19:39:26: Start of resource "ora.crsd -init" Succeeded
      2009-12-23 19:39:27: Start of resource "ora.evmd -init" Succeeded
      2009-12-23 19:39:27: Successfully started Oracle clusterware stack
      2009-12-23 19:39:27: Waiting for Oracle CRSD and EVMD to start
      2009-12-23 19:39:33: Oracle CRS stack installed and running



      Secondary Node Adding Clusterware Resources:

      2009-12-2319:39:33: Configuring node
      2009-12-23 19:39:34: adding nodeapps...
      2009-12-23 19:39:34: upgrade_opt=
      2009-12-23 19:39:34: nodevip=racbde2-vip/255.255.254.0/eth1
      2009-12-23 19:39:34: DHCP_flag=0
      2009-12-23 19:39:34: nodes_to_add=racbde2
      2009-12-23 19:39:34: add nodeapps for static IP
      2009-12-23 19:39:34: Running srvctl config nodeapps to detect if VIP exists
      2009-12-23 19:39:35: vip exists
      2009-12-23 19:39:35: Invoking "/u01/app/grid/bin/srvctl add vip -n racbde2-k 1 -A "racbde2-vip/255.255.254.0/eth1" "
      2009-12-23 19:39:35: tracefile=/u01/app/grid/cfgtoollogs/crsconfig/srvmcfg0.log
      2009-12-23 19:39:38: add vip -n racbde2 -k 1 -A racbde2-vip/255.255.254.0/eth1on node=racbde2 ... passed
      2009-12-23 19:39:38: nodes_to_start=racbde2
      2009-12-23 19:39:38: starting nodeapps...
      2009-12-23 19:39:38: DHCP_flag=0
      2009-12-23 19:39:38: nodes_to_start=racbde2
      2009-12-23 19:39:43: exit value of start nodeapps/vip is 2
      2009-12-23 19:39:43: output for start nodeapps is  PRKO-2421 : Networkresource is already started on node(s): racbde2 PRKO-2422 : ONS is alreadystarted on node(s): racbde2 PRKO-2423 : eONS is already started on node(s):racbde2
      2009-12-23 19:39:43: output of startnodeapp after removing already startedmesgs is
      2009-12-23 19:39:43: /u01/app/grid/bin/srvctl start nodeapps -n racbde2 ...passed
      2009-12-23 19:39:43: /u01/app/grid/bin/ocrconfig -local -manualbackup ...passed
      2009-12-23 19:39:43: Install cvuqdisk rpm on Linux...
      2009-12-23 19:39:43: New package to install is/u01/app/grid/cv/rpm/cvuqdisk-1.0.7-1.rpm
      2009-12-23 19:39:43: Invoking "/bin/rpm -q cvuqdisk" command
      2009-12-23 19:39:44: no existing cvuqdisk found
      2009-12-23 19:39:44: removing old rpm
      2009-12-23 19:39:44: installing/upgrading new rpm
      2009-12-23 19:39:45: Configure Oracle Grid Infrastructure for a Cluster ...succeeded



      If the root.sh is successful but there are subsequent startup problems, see Note: 1050908.1 for more troubleshootinginformation.

       

      Community Discussions


      Still have questions? Use the communities window below to search for similardiscussions or start a new discussion on this subject.

      Note: Window is the LIVE community not a screenshot.

      Click hereto open in main browser window.

      References

      NOTE:1050908.1 - Troubleshoot Grid InfrastructureStartup Issues
      NOTE:1053147.1 - 11gR2 Clusterware and Grid Home- What You Need to Know

       

热点排行