instance not starting

[Former Member]

Hi Gurus,

One of our server is not starting. We could not find possible reasons of that issue.

Please help me in this regard. It is a high priority Issue. I am posting the disp log.

Please check out and give me your valuable suggestions

log:

-

---

trc file: "dev_disp", trc level: 1, release: "620"

-

---

Tue Apr 15 16:00:40 2008

systemid 560 (PC with Windows NT)

relno 6200

patchlevel 0

patchno 251

intno 20020600

pid 2516

***LOG Q00=> DpSapEnvInit, DPStart (00 2516) [dpxxdisp.c 966]

shared lib "dw_xml.dll" version 252 successfully loaded

shared lib "dw_xtc.dll" version 252 successfully loaded

shared lib "dw_stl.dll" version 252 successfully loaded

Tue Apr 15 16:00:48 2008

• WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 8 seconds

***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 3140]

MtxInit: -2 0 0

MBUF state OFF

EmInit: MmSetImplementation( 2 ).

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 1024 kByte.

Using implementation std

<EsNT> Memory Reset enabled as NT default

<EsNT> EsIUnamFileMapInit: Initialize the memory 1223 MB

<ES> 1222 blocks reserved for free list.

ES initialized.

Tue Apr 15 16:00:49 2008

***LOG Q0K=> DpMsAttach, mscon ( gems) [dpxxdisp.c 8832]

CCMS: Initalizing shared memory of size 20000000 for monitoring segment.

CCMS: start to initalize 3.X shared alert area (first segment).

DpMsgAdmin: Set release to 6200, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 940]

DpMsgAdmin: Set patchno for this platform to 251

Release check o.K.

Tue Apr 15 16:01:29 2008

• ERROR => W0 (pid 2532) died [dpxxdisp.c 11210]

• ERROR => W1 (pid 2556) died [dpxxdisp.c 11210]

• ERROR => W2 (pid 2548) died [dpxxdisp.c 11210]

• ERROR => W3 (pid 2580) died [dpxxdisp.c 11210]

• ERROR => W4 (pid 2572) died [dpxxdisp.c 11210]

• ERROR => W5 (pid 2644) died [dpxxdisp.c 11210]

• ERROR => W6 (pid 2652) died [dpxxdisp.c 11210]

• ERROR => W7 (pid 2692) died [dpxxdisp.c 11210]

• ERROR => W8 (pid 972) died [dpxxdisp.c 11210]

• ERROR => W9 (pid 2708) died [dpxxdisp.c 11210]

• ERROR => W10 (pid 2716) died [dpxxdisp.c 11210]

• ERROR => W11 (pid 2724) died [dpxxdisp.c 11210]

• ERROR => W12 (pid 2728) died [dpxxdisp.c 11210]

• ERROR => W13 (pid 2744) died [dpxxdisp.c 11210]

• ERROR => W14 (pid 2760) died [dpxxdisp.c 11210]

• ERROR => W15 (pid 2772) died [dpxxdisp.c 11210]

• ERROR => W16 (pid 2776) died [dpxxdisp.c 11210]

• ERROR => W17 (pid 2800) died [dpxxdisp.c 11210]

• ERROR => W18 (pid 2820) died [dpxxdisp.c 11210]

• ERROR => W19 (pid 2828) died [dpxxdisp.c 11210]

• ERROR => W20 (pid 2836) died [dpxxdisp.c 11210]

• ERROR => W21 (pid 1852) died [dpxxdisp.c 11210]

• ERROR => W22 (pid 2352) died [dpxxdisp.c 11210]

• ERROR => W23 (pid 2856) died [dpxxdisp.c 11210]

• ERROR => W24 (pid 2920) died [dpxxdisp.c 11210]

• ERROR => W25 (pid 2972) died [dpxxdisp.c 11210]

my types changed after wp death/restart 0xbf --> 0x80

• DP_FATAL_ERROR => DpEnvCheck: no more work processes

• DISPATCHER EMERGENCY SHUTDOWN ***

• ERROR => DpMBufRead: state MBUF_PREPARED, opmode MBUF_USE [dpxxmbuf.c 503]

• ERROR => DpModState: DpMBufRead failed (-1) [dpxxdisp.c 13129]

Tue Apr 15 16:01:31 2008

***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 9058]

MBUF state OFF

MBUF component DOWN

***LOG Q05=> DpHalt, DPStop ( 2516) [dpxxdisp.c 7637]

Thanks and regards,

KIRAN

[Former Member]

Hi. can you provide the dev_w0 log file from work directory ? Also can you execute the "R3trans -d" in command line and after post here the trans.log file? Regards.

[Former Member]

Hi Sergo,

Thanks for your response. here iam posting the dev_w0 log

dev_w0 log:

-

---

trc file: "dev_w0", trc level: 1, release: "620"

-

---

*

• ACTIVE TRACE LEVEL 1

• ACTIVE TRACE COMPONENTS all, M

*

B

B Tue Apr 15 16:55:26 2008

B create_con (con_name=R/3)

B Loading DB library 'D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll' ...

B Library 'D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll' loaded

B Version of 'D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll' is "620.02", patchlevel (0.112)

B New connection 0 created

M systemid 560 (PC with Windows NT)

M relno 6200

M patchlevel 0

M patchno 251

M intno 20020600

M pid 1548

M

M ***LOG Q0Q=> tskh_init, WPStart (Workproc 0 1548) [dpxxdisp.c 1016]

I MtxInit: -2 0 0

X EmInit: MmSetImplementation( 2 ).

X <ES> client 0 initializing ....

X Using implementation std

M <EsNT> Memory Reset enabled as NT default

X ES initialized.

M *** ERROR => TrIInitFileindex: rename(1) failed: errno=-1 (File exists) [trfile.c 6995]

M *** ERROR => TrIInitFileindex: rename(1) failed: errno=-1 (File exists) [trfile.c 6995]

M *** ERROR => TrIInitFileindex: rename(1) failed: errno=-1 (File exists) [trfile.c 6995]

M *** ERROR => TrIInitFileindex: rename(1) failed: errno=-1 (File exists) [trfile.c 6995]

M *** ERROR => TrIInitFileindex: rename(1) failed: errno=-1 (File exists) [trfile.c 6995]

M *** ERROR => TrIInitFileindex: rename(1) failed: errno=-1 (File exists) [trfile.c 6995]

M *** ERROR => TrIInitFileindex: rename(1) failed: errno=-1 (File exists) [trfile.c 6995]

M *** ERROR => TrIInitFileindex: rename(2) failed: errno=-1 (File exists) [trfile.c 7034]

M *** ERROR => TrIInitFileindex: rename(2) failed: errno=-1 (File exists) [trfile.c 7034]

M *** ERROR => TrIInitFileindex: rename(2) failed: errno=-1 (File exists) [trfile.c 7034]

M

M Tue Apr 15 16:55:35 2008

M calling db_connect ...

C Got ORACLE_HOME=D:\oracle\ora81 from environment

C Client NLS settings: AMERICAN_AMERICA.WE8DEC

C Logon as OPS$-user to get SAPGEM's password

C Connecting as /@GEM on connection 0 ...

C Attaching to DB Server GEM (con_hdl=0,svchp=0302E6F8,svrhp=0302E504)

C

C Tue Apr 15 16:55:37 2008

C Starting user session (con_hdl=0,svchp=0302E6F8,srvhp=0302E504,usrhp=0624AFDC)

C *** ERROR => OCI-call 'OCISessionBegin' failed: rc = 1033

[dboci.c 3718]

C *** ERROR => CONNECT failed with sql error '1033'

[dboci.c 9536]

C Try to connect with default password

C Connecting as SAPGEM/<pwd>@GEM on connection 0 ...

C Starting user session (con_hdl=0,svchp=0302E6F8,srvhp=0302E504,usrhp=0624AFDC)

C *** ERROR => OCI-call 'OCISessionBegin' failed: rc = 1033

[dboci.c 3718]

C *** ERROR => CONNECT failed with sql error '1033'

[dboci.c 9536]

B ***LOG BV3=> severe db error 1033 ; work process is stopped [dbsh#2 @ 957] [dbsh 0957 ]

B ***LOG BY2=> sql error 1033 performing CON [dblink#1 @ 419] [dblink 0419 ]

B ***LOG BY0=> ORA-01033: ORACLE initialization or shutdown in progress [dblink#1 @ 419] [dblink 0419 ]

M ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c 1098]

M in_ThErrHandle: 1

M *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c 8277]

M

M Info for wp 0

M

M stat = 4

M reqtype = 1

M act_reqtype = -1

M tid = -1

M mode = 255

M len = -1

M rq_id = -1

M rq_source = 255

M last_tid = 0

M last_mode = 0

M rfc_req = 0

M report = > <

M action = 0

M tab_name = > <

M

M *****************************************************************************

M *

M * LOCATION SAP-Server gems_GEM_00 on host gems (wp 0)

M * ERROR tskh_init: db_connect

M *

M * TIME Tue Apr 15 16:55:37 2008

M * RELEASE 620

M * COMPONENT Taskhandler

M * VERSION 1

M * RC 13

M * MODULE thxxhead.c

M * LINE 8408

M * COUNTER 1

M *

M *****************************************************************************

M

M Entering TH_CALLHOOKS

M ThCallHooks: call hook >SAP-Trace buffer write< for event BEFORE_DUMP

M ThCallHooks: call hook >ThrSaveSPAFields< for event BEFORE_DUMP

M *** ERROR => ThrSaveSPAFields: no valid thr_wpadm [thxxrun1.c 672]

M *** ERROR => ThCallHooks: event handler ThrSaveSPAFields for event BEFORE_DUMP failed [thxxtool3.c 235]

M Entering ThSetStatError

M Entering ThReadDetachMode

M call ThrShutDown (1)...

M ***LOG Q02=> wp_halt, WPStop (Workproc 0 1548) [dpnttool.c 345]

r3 trsns log:

d:\> r3trans -d

this is r3trans version 6.07 <release 620 - 05.08.02 - 15:04:42>.

2EETW169 no connect possible: "DBMS = ORACLE

dbs_ora_tnsname= 'GEM'"

r3trans finished <0012>

please let me know whts wrong

thanks

KIRAN

[Former Member]

Can you restart the database and if you still have problem, post the alert_SID.log.

[Former Member]

Hi kiran d. Are you execute the "R3trans -d" under "sidadm" user? The trans.log is the file (example :

you go to commanr line end execute R3trans -d like this-->

C:\Documents and Settings\user>R3trans -d

The R3trans creates the trans.log in folder -->C:\Documents and Settings\user

If you execute C:\R3trans -d the trans.log creates in C:\ folder . understand? )

I'm think your database is down. Login to system with sidadm --> Go to Start->run->cmd and execute this -->

sqlplus /nolog

connect /as sysdba

shutdown

startup

After this try to start sap in MMC. About ORA-01033: ORACLE initialization or shutdown in progress -->

Read in Note Note 655240 - Composite SAP note: ORA-01033.

Regards. Award if helpful.

Edited by: Sergo Beradze on Apr 15, 2008 4:11 PM

[Former Member]

Hi RK,

I couldnt find alert_sid.log in the work directory

regards,

KIRAN

[Former Member]

Hi sergo,

Iam getting ORA-12560: TNS:protocol adapter error when iam trying to login as sysdba in sql.

please help me in this

THANKS,

KIRAN

[Former Member]

Hi Sergo,

The trans log is as follows:

4 ETW000 R3trans version 6.07 (release 620 - 05.08.02 - 15:04:42).

4 ETW000 ===============================================

4 ETW000

4 ETW000 date&time : 15.04.2008 - 18:00:57

4 ETW000 control file: <no ctrlfile>

4 ETW000 R3trans was called as follows: R3trans -d

4 ETW000 trace at level 2 opened for a given file pointer

4 ETW000 [dev trc ,00000] Tue Apr 15 18:01:00 2008 0.000000

4 ETW000 [dev trc ,00000] db_con_init called 0.000000

4 ETW000 [dev trc ,00000] create_con (con_name=R/3) 0.000000

4 ETW000 [dev trc ,00000] Loading DB library 'D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll' ...

4 ETW000 0.000000

4 ETW000 [dev trc ,00000] load shared library (D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll), hdl 0

4 ETW000 9438 0.009438

4 ETW000 [dev trc ,00000] using "D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll"

4 ETW000 25 0.009463

4 ETW000 [dev trc ,00000] Library 'D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll' loaded

4 ETW000 21 0.009484

4 ETW000 [dev trc ,00000] function DbSlExpFuns loaded from library D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll

4 ETW000 26 0.009510

4 ETW000 [dev trc ,00000] Version of 'D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll' is "620.02", patchlevel (0.112)

4 ETW000 75 0.009585

4 ETW000 [dev trc ,00000] function dsql_db_init loaded from library D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll

4 ETW000 24 0.009609

4 ETW000 [dev trc ,00000] function dbdd_exp_funs loaded from library D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll

4 ETW000 37 0.009646

4 ETW000 [dev trc ,00000] New connection 0 created 28 0.009674

4 ETW000 [dev trc ,00000] 0: name = R/3, con_id = -000000001 state = DISCONNECTED, perm = YES, reco = NO

4 ETW000 23 0.009697

4 ETW000 [dev trc ,00000] db_con_connect (con_name=R/3)

4 ETW000 24 0.009721

4 ETW000 [dev trc ,00000] find_con found the following connection for reuse:

4 ETW000 20 0.009741

4 ETW000 [dev trc ,00000] 0: name = R/3, con_id = 000000000 state = DISCONNECTED, perm = YES, reco = NO

4 ETW000 22 0.009763

4 ETW000 [dev trc ,00000] Got ORACLE_HOME=D:\oracle\ora81 from environment

4 ETW000 214 0.009977

4 ETW000 [dev trc ,00000] -->oci_initialize 19 0.009996

4 ETW000 [dev trc ,00000] Client NLS settings: AMERICAN_AMERICA.WE8DEC

4 ETW000 14790 0.024786

4 ETW000 [dev trc ,00000] Logon as OPS$-user to get SAPGEM's password

4 ETW000 65 0.024851

4 ETW000 [dev trc ,00000] Connecting as /@GEM on connection 0 ...

4 ETW000 21 0.024872

4 ETW000 [dev trc ,00000] Allocating service context handle

4 ETW000 26 0.024898

4 ETW000 [dev trc ,00000] Allocating server context handle

4 ETW000 27 0.024925

4 ETW000 [dev trc ,00000] Attaching to DB Server GEM (con_hdl=0,svchp=0172A398,svrhp=0172A1A4)

4 ETW000 26 0.024951

4 ETW000 [dev trc ,00000] Assigning server context 0172A1A4 to service context 0172A398

4 ETW000 57038 0.081989

4 ETW000 [dev trc ,00000] Allocating user session handle

4 ETW000 137 0.082126

4 ETW000 [dev trc ,00000] Starting user session (con_hdl=0,svchp=0172A398,srvhp=0172A1A4,usrhp=0176AFCC)

4 ETW000 40 0.082166

4 ETW000 [dboci.c ,00000] *** ERROR => OCI-call 'OCISessionBegin' failed: rc = 1033

4 ETW000 51472 0.133638

4 ETW000 [dboci.c ,00000] *** ERROR => CONNECT failed with sql error '1033'

4 ETW000 28 0.133666

4 ETW000 [dev trc ,00000] Try to connect with default password

4 ETW000 30 0.133696

4 ETW000 [dev trc ,00000] Connecting as SAPGEM/<pwd>@GEM on connection 0 ...

4 ETW000 22 0.133718

4 ETW000 [dev trc ,00000] Assigning username to user session 0176AFCC

4 ETW000 20 0.133738

4 ETW000 [dev trc ,00000] Assigning password to user session 0176AFCC

4 ETW000 27 0.133765

4 ETW000 [dev trc ,00000] Starting user session (con_hdl=0,svchp=0172A398,srvhp=0172A1A4,usrhp=0176AFCC)

4 ETW000 26 0.133791

4 ETW000 [dboci.c ,00000] *** ERROR => OCI-call 'OCISessionBegin' failed: rc = 1033

4 ETW000 1499 0.135290

4 ETW000 [dboci.c ,00000] *** ERROR => CONNECT failed with sql error '1033'

4 ETW000 26 0.135316

4 ETW000 [dblink ,00419] ***LOG BY2=>sql error 1033 performing CON [dblink#1 @ 419]

4 ETW000 68 0.135384

4 ETW000 [dblink ,00419] ***LOG BY0=>ORA-01033: ORACLE initialization or shutdown in progress [dblink#1 @ 419]

4 ETW000 24 0.135408

2EETW169 no connect possible: "DBMS = ORACLE --- dbs_ora_tnsname = 'GEM'"

thanks,

KIRAN

[Former Member]

Read the Note 441518 - ORA-12560 composite SAP Note.

P.S. First chek in services are all oracle services is up and runnig?

Regards.

Edited by: Sergo Beradze on Apr 15, 2008 4:24 PM

[Former Member]

Hi sergo,

I have gone with this note and everything was ok and i think some thing gone wrong with DBMS and all the work process once started are immediately coming to end state and i am posting the developer trace of work process. Please look in to that and let me know what to do

-

---

trc file: "dev_w10", trc level: 1, release: "620"

-

---

*

• ACTIVE TRACE LEVEL 1

• ACTIVE TRACE COMPONENTS all, M

*

B

B Tue Apr 15 16:55:36 2008

B create_con (con_name=R/3)

B Loading DB library 'D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll' ...

B Library 'D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll' loaded

B Version of 'D:\usr\sap\GEM\SYS\exe\run\dboraslib.dll' is "620.02", patchlevel (0.112)

B New connection 0 created

M systemid 560 (PC with Windows NT)

M relno 6200

M patchlevel 0

M patchno 251

M intno 20020600

M pid 2892

M

M ***LOG Q0Q=> tskh_init, WPStart (Workproc10 2892) [dpxxdisp.c 1016]

I MtxInit: -2 0 0

X EmInit: MmSetImplementation( 2 ).

X <ES> client 10 initializing ....

X Using implementation std

M <EsNT> Memory Reset enabled as NT default

X ES initialized.

M

M Tue Apr 15 16:55:44 2008

M calling db_connect ...

C Got ORACLE_HOME=D:\oracle\ora81 from environment

C Client NLS settings: AMERICAN_AMERICA.WE8DEC

C Logon as OPS$-user to get SAPGEM's password

C Connecting as /@GEM on connection 0 ...

C Attaching to DB Server GEM (con_hdl=0,svchp=06F29148,svrhp=06F28F54)

C

C Tue Apr 15 16:55:45 2008

C Starting user session (con_hdl=0,svchp=06F29148,srvhp=06F28F54,usrhp=06F725EC)

C *** ERROR => OCI-call 'OCISessionBegin' failed: rc = 1033

[dboci.c 3718]

C *** ERROR => CONNECT failed with sql error '1033'

[dboci.c 9536]

C Try to connect with default password

C Connecting as SAPGEM/<pwd>@GEM on connection 0 ...

C Starting user session (con_hdl=0,svchp=06F29148,srvhp=06F28F54,usrhp=06F725EC)

C *** ERROR => OCI-call 'OCISessionBegin' failed: rc = 1033

[dboci.c 3718]

C *** ERROR => CONNECT failed with sql error '1033'

[dboci.c 9536]

B ***LOG BV3=> severe db error 1033 ; work process is stopped [dbsh#2 @ 957] [dbsh 0957 ]

B ***LOG BY2=> sql error 1033 performing CON [dblink#1 @ 419] [dblink 0419 ]

B ***LOG BY0=> ORA-01033: ORACLE initialization or shutdown in progress [dblink#1 @ 419] [dblink 0419 ]

M ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c 1098]

M in_ThErrHandle: 1

M *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c 8277]

M

M Info for wp 10

M

M stat = 4

M reqtype = 2

M act_reqtype = -1

M tid = -1

M mode = 255

M len = -1

M rq_id = -1

M rq_source = 255

M last_tid = 0

M last_mode = 0

M rfc_req = 0

M report = > <

M action = 0

M tab_name = > <

M

M *****************************************************************************

M *

M * LOCATION SAP-Server gems_GEM_00 on host gems (wp 10)

M * ERROR tskh_init: db_connect

M *

M * TIME Tue Apr 15 16:55:45 2008

M * RELEASE 620

M * COMPONENT Taskhandler

M * VERSION 1

M * RC 13

M * MODULE thxxhead.c

M * LINE 8408

M * COUNTER 1

M *

M *****************************************************************************

M

M Entering TH_CALLHOOKS

M ThCallHooks: call hook >SAP-Trace buffer write< for event BEFORE_DUMP

M ThCallHooks: call hook >ThrSaveSPAFields< for event BEFORE_DUMP

M *** ERROR => ThrSaveSPAFields: no valid thr_wpadm [thxxrun1.c 672]

M *** ERROR => ThCallHooks: event handler ThrSaveSPAFields for event BEFORE_DUMP failed [thxxtool3.c 235]

M Entering ThSetStatError

M Entering ThReadDetachMode

M call ThrShutDown (1)...

M ***LOG Q02=> wp_halt, WPStop (Workproc10 2892) [dpnttool.c 345]

Thanks

Kiran

[Former Member]

Are you read the Note 655240 - Composite SAP note: ORA-01033 ? Can you login sqlplus /nolog

connect /as sysdba or the same error? First read the Note. Regards. Award if helpful...

[Former Member]

Can you please run this at the os level.

sappfpar check pf=<instance profile name>

let me know you have any error displayed

-

---

check this note and related notes for possible solution

Note 403004 - Database connect using R3trans fails