cancel
Showing results for 
Search instead for 
Did you mean: 

SAP Netweaver hangs on phase 25 out of 29

Former Member
0 Kudos

<pre>

OS: CentOS 4.8, 64bit

SAP: SAP ERP 6.0 EHP4 Ready

Database: Oracle

I get stuck on the SAP Netweaver Installer at phase 25 out of 29. I have tried changing the host file and rebooting/

restarting the machine and installation several times, but I consistently get this error message:

ABAP processes of instance OPQ/DVEBMGS00 [ABAP:UNKNOWN] did not start after 10:30 minutes. Giving up.

Here is the content of the host file:

172.10.10.159 pink localhost.localdomain localhost

172.10.10.159 used to be 127.0.0.1

Here is the first half of dev_disp. It appears that the work processes cannot be started. How can this problem

be resolved?

-


trc file: "dev_disp.new", trc level: 1, release: "701"

-


sysno 00

sid OPQ

systemid 390 (AMD/Intel x86_64 with Linux)

relno 7010

patchlevel 0

patchno 32

intno 20020600

make: single threaded, Unicode, 64 bit, optimized

pid 13228

Fri Mar 12 12:04:42 2010

kernel runs with dp version 241000(ext=110000) (@(#) DPLIB-INT-VERSION-241000-UC)

length of sys_adm_ext is 576 bytes

      • SWITCH TRC-HIDE on ***

***LOG Q00=> DpSapEnvInit, DPStart (00 13228) [dpxxdisp.c 1286]

shared lib "dw_xml.so" version 32 successfully loaded

shared lib "dw_xtc.so" version 32 successfully loaded

shared lib "dw_stl.so" version 32 successfully loaded

shared lib "dw_gui.so" version 32 successfully loaded

shared lib "dw_mdm.so" version 32 successfully loaded

rdisp/softcancel_sequence : -> 0,5,-1

use internal message server connection to port 3900

MtxInit: 30000 0 0

DpSysAdmExtInit: ABAP is active

DpSysAdmExtInit: VMC (JAVA VM in WP) is not active

DpIPCInit2: start server >pink_OPQ_00 <

DpShMCreate: sizeof(wp_adm) 29784 (1752)

DpShMCreate: sizeof(tm_adm) 6009216 (29896)

DpShMCreate: sizeof(wp_ca_adm) 28800 (96)

DpShMCreate: sizeof(appc_ca_adm) 9600 (96)

DpCommTableSize: max/headSize/ftSize/tableSize=500/8/548056/548064

DpShMCreate: sizeof(comm_adm) 548064 (1088)

DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0

DpShMCreate: sizeof(slock_adm) 0 (104)

DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0

DpShMCreate: sizeof(file_adm) 0 (72)

DpShMCreate: sizeof(vmc_adm) 0 (2008)

DpShMCreate: sizeof(wall_adm) (40056/36728/80/192)

DpShMCreate: sizeof(gw_adm) 48

DpShMCreate: SHM_DP_ADM_KEY (addr: 0x2aa18e5000, size: 6711576)

DpShMCreate: allocated sys_adm at 0x2aa18e5000

DpShMCreate: allocated wp_adm at 0x2aa18e7308

DpShMCreate: allocated tm_adm_list at 0x2aa18ee760

DpShMCreate: allocated tm_adm at 0x2aa18ee7c0

DpShMCreate: allocated wp_ca_adm at 0x2aa1ea9940

DpShMCreate: allocated appc_ca_adm at 0x2aa1eb09c0

DpShMCreate: allocated comm_adm at 0x2aa1eb2f40

DpShMCreate: system runs without slock table

DpShMCreate: system runs without file table

DpShMCreate: allocated vmc_adm_list at 0x2aa1f38c20

DpShMCreate: allocated gw_adm at 0x2aa1f38ca0

DpShMCreate: system runs without vmc_adm

DpShMCreate: allocated ca_info at 0x2aa1f38cd0

DpShMCreate: allocated wall_adm at 0x2aa1f38cd8

MBUF state OFF

DpCommInitTable: init table for 500 entries

rdisp/queue_size_check_value : -> off

ThTaskStatus: rdisp/reset_online_during_debug 0

EmInit: MmSetImplementation( 2 ).

MM global diagnostic options set: 0

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 4096 kByte.

Using implementation map

<EsMap> EsMapUnamFileMapInit: Initialize the memory 7968 MB

Linux: Kernel does not support shared memory disclaiming

Linux: disclaiming for shared memory disabled

<ES> 1988 blocks reserved for free list.

ES initialized.

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1681]

***LOG Q0K=> DpMsAttach, mscon ( pink) [dpxxdisp.c 12483]

DpStartStopMsg: send start message (myname is >pink_OPQ_00 <)

DpStartStopMsg: start msg sent

Warning: Swap space is configured quite small with 16863 MB.

It should be configured with at least 20 GB on 64 bit systems.

See note 153641 for more information.

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

CCMS: start to initalize 3.X shared alert area (first segment).

      • ERROR => DpWPCheck: W0 (pid 13237) died (severity=0, status=65280) [dpxxdisp.c 15662]

child (pid=13237) exited with exit code 255

      • ERROR => DpWPCheck: W3 (pid 13242) died (severity=0, status=65280) [dpxxdisp.c 15662]

child (pid=13242) exited with exit code 255

      • ERROR => DpWPCheck: W4 (pid 13243) died (severity=0, status=65280) [dpxxdisp.c 15662]

child (pid=13243) exited with exit code 255

      • ERROR => DpWPCheck: W5 (pid 13246) died (severity=0, status=65280) [dpxxdisp.c 15662]

child (pid=13246) exited with exit code 255

      • ERROR => DpWPCheck: W6 (pid 13251) died (severity=0, status=65280) [dpxxdisp.c 15662]

child (pid=13251) exited with exit code 255

      • ERROR => DpWPCheck: W9 (pid 13260) died (severity=0, status=65280) [dpxxdisp.c 15662]

child (pid=13260) exited with exit code 255

my types changed after wp death/restart 0xbf --> 0xbd

my types changed after wp death/restart 0xbd --> 0x9d

DpMsgAdmin: Set release to 7010, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1048]

DpMsgAdmin: Set patchno for this platform to 32

Release check o.K.

      • ERROR => DpWPCheck: W0 (pid 13237) died (severity=0, status=0) [dpxxdisp.c 15662]

my types changed after wp death/restart 0x9d --> 0x9c

      • ERROR => DpWPCheck: W1 (pid 13238) died (severity=0, status=65280) [dpxxdisp.c 15662]

child (pid=13238) exited with exit code 255

      • ERROR => DpWPCheck: W2 (pid 13241) died (severity=0, status=65280) [dpxxdisp.c 15662]

child (pid=13241) exited with exit code 255

      • ERROR => DpWPCheck: W3 (pid 13242) died (severity=0, status=0) [dpxxdisp.c 15662]

      • ERROR => DpWPCheck: W4 (pid 13243) died (severity=0, status=0) [dpxxdisp.c 15662]

      • ERROR => DpWPCheck: W5 (pid 13246) died (severity=0, status=0) [dpxxdisp.c 15662]

      • ERROR => DpWPCheck: W6 (pid 13251) died (severity=0, status=0) [dpxxdisp.c 15662]

      • ERROR => DpWPCheck: W7 (pid 13254) died (severity=0, status=65280) [dpxxdisp.c 15662]

child (pid=13254) exited with exit code 255

      • ERROR => DpWPCheck: W8 (pid 13259) died (severity=0, status=65280) [dpxxdisp.c 15662]

child (pid=13259) exited with exit code 255

      • ERROR => DpWPCheck: W9 (pid 13260) died (severity=0, status=0) [dpxxdisp.c 15662]

      • ERROR => DpWPCheck: W10 (pid 13261) died (severity=0, status=0) [dpxxdisp.c 15662]

my types changed after wp death/restart 0x9c --> 0x98

      • ERROR => DpWPCheck: W12 (pid 13263) died (severity=0, status=0) [dpxxdisp.c 15662]

my types changed after wp death/restart 0x98 --> 0x90

      • ERROR => DpWPCheck: W14 (pid 13269) died (severity=0, status=0) [dpxxdisp.c 15662]

my types changed after wp death/restart 0x90 --> 0x80

      • ERROR => DpWPCheck: W16 (pid 13271) died (severity=0, status=0) [dpxxdisp.c 15662]

      • DP_FATAL_ERROR => DpWPCheck: no more work processes

      • DISPATCHER EMERGENCY SHUTDOWN ***

increase tracelevel of WPs

NiWait: sleep (10000ms) ...

NiISelect: timeout 10000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

</pre>

Accepted Solutions (1)

Accepted Solutions (1)

Former Member
0 Kudos

<pre>

Fri Mar 12 12:04:52 2010

NiISelect: TIMEOUT occured (10000ms)

dump system status

Workprocess Table (long) Fri Mar 12 17:04:52 2010

========================

No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table

-


0 DIA 13237 Ended no 2 0 0

1 DIA 13238 Ended no 1 0 0

2 DIA 13241 Ended no 1 0 0

3 DIA 13242 Ended no 2 0 0

4 DIA 13243 Ended no 2 0 0

5 DIA 13246 Ended no 2 0 0

6 DIA 13251 Ended no 2 0 0

7 DIA 13254 Ended no 1 0 0

8 DIA 13259 Ended no 1 0 0

9 DIA 13260 Ended no 2 0 0

10 UPD 13261 Ended no 2 0 0

11 ENQ 13262 Ended no 1 0 0

12 BTC 13263 Ended no 2 0 0

13 BTC 13266 Ended no 1 0 0

14 BTC 13269 Ended no 2 0 0

15 SPO 13270 Ended no 1 0 0

16 UP2 13271 Ended no 2 0 0

Dispatcher Queue Statistics Fri Mar 12 17:04:52 2010

===========================

--------


+
+

+

+
--


+

Typ

now

high

max

writes

reads

--------


+
+

+

+
--


+

NOWP

2

2

2000

4

2

--------


+
+

+

+
--


+

DIA

3

3

2000

3

0

--------


+
+

+

+
--


+

UPD

0

0

2000

0

0

--------


+
+

+

+
--


+

ENQ

0

0

2000

0

0

--------


+
+

+

+
--


+

BTC

0

0

2000

0

0

--------


+
+

+

+
--


+

SPO

0

0

2000

0

0

--------


+
+

+

+
--


+

UP2

0

0

2000

0

0

--------


+
+

+

+
--


+

max_rq_id 10

wake_evt_udp_now 1

wake events total 6, udp 3 ( 50%), shm 3 ( 50%)

since last update total 6, udp 3 ( 50%), shm 3 ( 50%)

Dump of tm_adm structure: Fri Mar 12 17:04:52 2010

=========================

Term uid man user term lastop mod wp ta a/i (modes)

Workprocess Comm. Area Blocks Fri Mar 12 17:04:52 2010

=============================

Slots: 300, Used: 1, Max: 0

--------


+
+
--


+

id

owner

pid

eyecatcher

--------


+
+
--


+

0

DISPATCHER

-1

WPCAAD000

NiWait: sleep (5000ms) ...

NiISelect: timeout 5000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:04:57 2010

NiISelect: TIMEOUT occured (5000ms)

DpHalt: shutdown server >pink_OPQ_00 < (normal)

DpJ2eeDisableRestart

DpModState: buffer in state MBUF_PREPARED

NiBufSend starting

NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIModState: change state to SHUTDOWN

DpModState: change server state from STARTING to SHUTDOWN

Switch off Shared memory profiling

ShmProtect( 57, 3 )

ShmProtect( key 57 valid )

ShmProtect( slot Index 56 )

ShmProtect( Mode: 0 )

ShmProtect( before shmdt )

ShmProtect( after shmdt )

ShmProtect( before shmat )

ShmProtect( after shmat )

ShmProtect: shmat key 57 prot 3/0 done

ShmProtect(SHM_PROFILE, SHM_PROT_RW

ShmProtect( 57, 1 )

ShmProtect( key 57 valid )

ShmProtect( slot Index 56 )

ShmProtect( Mode: 0 )

ShmProtect( before shmdt )

ShmProtect( after shmdt )

ShmProtect( before shmat )

ShmProtect( after shmat )

ShmProtect: shmat key 57 prot 1/4096 done

ShmProtect(SHM_PROFILE, SHM_PROT_RD

DpWakeUpWps: wake up all wp's

Stop work processes

Stop gateway

killing proc (13235) (SOFT_KILL)

Stop icman

killing proc (13236) (SOFT_KILL)

Terminate gui connections

wait for end of work processes

wait for end of gateway

kill(13235,0) successful -> process alive

waiting for termination of gateway ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:04:58 2010

NiISelect: TIMEOUT occured (1000ms)

kill(13235,0) -> ESRCH: process died

wait for end of icman

kill(13236,0) successful -> process alive

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:04:59 2010

NiISelect: TIMEOUT occured (1000ms)

kill(13236,0) successful -> process alive

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:05:00 2010

NiISelect: TIMEOUT occured (1000ms)

kill(13236,0) successful -> process alive

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:05:01 2010

NiISelect: TIMEOUT occured (1000ms)

kill(13236,0) successful -> process alive

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:05:02 2010

NiISelect: TIMEOUT occured (1000ms)

kill(13236,0) successful -> process alive

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:05:03 2010

NiISelect: TIMEOUT occured (1000ms)

kill(13236,0) successful -> process alive

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:05:04 2010

NiISelect: TIMEOUT occured (1000ms)

kill(13236,0) successful -> process alive

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:05:05 2010

NiISelect: TIMEOUT occured (1000ms)

kill(13236,0) successful -> process alive

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:05:06 2010

NiISelect: TIMEOUT occured (1000ms)

kill(13236,0) successful -> process alive

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:05:07 2010

NiISelect: TIMEOUT occured (1000ms)

kill(13236,0) successful -> process alive

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:05:08 2010

NiISelect: TIMEOUT occured (1000ms)

kill(13236,0) successful -> process alive

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=17

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Mar 12 12:05:09 2010

NiISelect: TIMEOUT occured (1000ms)

kill(13236,0) -> ESRCH: process died

DpStartStopMsg: send stop message (myname is >pink_OPQ_00 <)

DpStartStopMsg: Write AD_STARTSTOP message with type= 0, name=pink_OPQ_00 , sapsysnr= 0, hostname=pink

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0

DpConvertRequest: net size = 189 bytes

NiBufSend starting

NiIWrite: hdl 2 sent data (wrt=562,pac=1,MESG_IO)

MsINiWrite: sent 562 bytes

send msg (len 110+452) to name -, type 4, key -

DpStartStopMsg: stop msg sent

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 recv would block (errno=EAGAIN)

NiIRead: read for hdl 2 timed out (0ms)

DpHalt: no more messages from the message server

DpHalt: send keepalive to synchronize with the message server

NiBufSend starting

NiIWrite: hdl 2 sent data (wrt=114,pac=1,MESG_IO)

MsINiWrite: sent 114 bytes

send msg (len 110+4) to name MSG_SERVER, type 0, key -

MsSndName: MS_NOOP ok

Send 4 bytes to MSG_SERVER

NiIRead: hdl 2 recv would block (errno=EAGAIN)

NiIPeek: peek successful for hdl 2 (r)

NiIRead: hdl 2 received data (rcd=114,pac=1,MESG_IO)

NiBufIIn: NIBUF len=114

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 114 bytes

MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -

Received 4 bytes from MSG_SERVER

Received opcode MS_NOOP from msg_server, reply MSOP_OK

MsOpReceive: ok

MsSendKeepalive : keepalive sent to message server

NiIRead: hdl 2 recv would block (errno=EAGAIN)

Fri Mar 12 12:05:10 2010

NiIPeek: peek for hdl 2 timed out (r; 1000ms)

NiIRead: read for hdl 2 timed out (1000ms)

DpHalt: no more messages from the message server

DpHalt: sync with message server o.k.

detach from message server

***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 12829]

NiBufSend starting

NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIDetach: send logout to msg_server

MsIDetach: call exit function

DpMsShutdownHook called

NiBufISelUpdate: new MODE -- (r-) for hdl 2 in set0

SiSelPSet: set events of sock 14 to: ---

NiBufISelRemove: remove hdl 2 from set0

SiSelPRemove: removed sock 14 (pos=3)

NiSelIRemove: removed hdl 2

MBUF state OFF

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/17

LOCK WP ca_blk 1

make DISP owner of wp_ca_blk 1

DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 13)

MBUF component DOWN

NiICloseHandle: shutdown and close hdl 2 / sock 14

NiBufIClose: clear extension for hdl 2

MsIDetach: detach MS-system

cleanup EM

EsCleanup ....

EsCleanup destroy slot 0

<EsMap: unlink /SAP_ES_00_000

EsCleanup destroy slot 1

<EsMap: unlink /SAP_ES_00_001

EsCleanup destroy slot 2

<EsMap: unlink /SAP_ES_00_002

EsCleanup destroy slot 3

<EsMap: unlink /SAP_ES_00_003

EmCleanup() -> 0

Es2Cleanup: Cleanup ES2

ShmCreate( 76, 0, 2, 0x0x550b210 )

ShmKeyPermission( 76 ) = 0740 (octal)

ShmDelete( 13 )

cleanup event management

cleanup shared memory/semaphores

ShmCleanup SHM_SYS_ADM_KEY

ShmCleanup( 1 )

ShmCreate( 1, 0, 2, 0x0x7fbfffd650 )

ShmProtect( 1, 3 )

ShmProtect( key 1 valid )

ShmProtect( slot Index 0 )

ShmProtect( Mode: 0 )

ShmProtect( before shmdt )

ShmProtect( after shmdt )

ShmProtect( before shmat )

ShmProtect( after shmat )

ShmProtect: shmat key 1 prot 3/0 done

ShmCreate( 1, 0, 2, -> 0x0x2aa17cc000 )

ShmCleanup SHM_DP_ADM_KEY

ShmCleanup( 2 )

</pre>

Former Member
0 Kudos

<pre>

Here is the final section of dev_disp:

ShmCreate( 2, 0, 2, 0x0x7fbfffd650 )

ShmProtect( 2, 3 )

ShmProtect( key 2 valid )

ShmProtect( slot Index 1 )

ShmProtect( Mode: 0 )

ShmProtect( before shmdt )

ShmProtect( after shmdt )

ShmProtect( before shmat )

ShmProtect( after shmat )

ShmProtect: shmat key 2 prot 3/0 done

ShmCreate( 2, 0, 2, -> 0x0x2aa18e5000 )

ShmCleanup SHM_DP_CA_KEY

ShmCleanup( 3 )

ShmCreate( 3, 0, 2, 0x0x7fbfffd650 )

ShmProtect( 3, 3 )

ShmProtect( key 3 valid )

ShmProtect( slot Index 2 )

ShmProtect( Mode: 0 )

ShmProtect( before shmdt )

ShmProtect( after shmdt )

ShmProtect( before shmat )

ShmProtect( after shmat )

ShmProtect: shmat key 3 prot 3/0 done

ShmCreate( 3, 0, 2, -> 0x0x2aa1f4c000 )

ShmCleanup SHM_PF_KEY

ShmCleanup( 4 )

ShmCreate( 4, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 4 ) = 0740 (octal)

ShmCleanup SHM_PRES_BUF

ShmCleanup( 14 )

ShmCreate( 14, 0, 2, 0x0x7fbfffd650 )

ShmGet( 10, 14, 0, 2, 0x0x7fbfffd5e0 )

ShmGet( 10, 14, 0, 2, -> 0x0x2a97a70000 )

ShmProtect( 14, 3 )

ShmProtect( key 14 valid )

ShmProtect( slot Index 13 )

ShmProtect: Key=14 not attached

ShmProtect( 14, 3 )

ShmProtect( key 14 valid )

ShmProtect( slot Index 13 )

ShmProtect( Mode: -10 )

ShmProtect( SegSlotIdx: 13 )

ShmCreate( 14, 0, 2, -> 0x0x2a97a70000 )

ShmCleanup SHM_CALI_BUFFER

ShmCleanup( 11 )

ShmCreate( 11, 0, 2, 0x0x7fbfffd650 )

ShmGet( 10, 11, 0, 2, 0x0x7fbfffd5e0 )

ShmCleanup SHM_DB_TBUFF

ShmCleanup( 19 )

ShmCreate( 19, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 19 ) = 0740 (octal)

ShmCleanup SHM_DB_TBUFF_P

ShmCleanup( 33 )

ShmCreate( 33, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 33 ) = 0740 (octal)

ShmCleanup SHM_DB_STBUFF

ShmCleanup( 41 )

ShmCreate( 41, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 41 ) = 0740 (octal)

ShmCleanup SHM_DB_TTBUFF

ShmCleanup( 42 )

ShmCreate( 42, 0, 2, 0x0x7fbfffd650 )

ShmGet( 40, 42, 0, 2, 0x0x7fbfffd5e0 )

ShmCreate( 40, 0, 2, 0x0x7fbfffd4d0 )

ShmKeyPermission( 40 ) = 0740 (octal)

ShmCleanup SHM_DB_FTBUFF

ShmCleanup( 43 )

ShmCreate( 43, 0, 2, 0x0x7fbfffd650 )

ShmGet( 40, 43, 0, 2, 0x0x7fbfffd5e0 )

ShmCreate( 40, 0, 2, 0x0x7fbfffd4d0 )

ShmKeyPermission( 40 ) = 0740 (octal)

ShmCleanup SHM_DB_SNTBUFF

ShmCleanup( 45 )

ShmCreate( 45, 0, 2, 0x0x7fbfffd650 )

ShmGet( 40, 45, 0, 2, 0x0x7fbfffd5e0 )

ShmCreate( 40, 0, 2, 0x0x7fbfffd4d0 )

ShmKeyPermission( 40 ) = 0740 (octal)

ShmCleanup SHM_DB_IRBUFF

ShmCleanup( 44 )

ShmCreate( 44, 0, 2, 0x0x7fbfffd650 )

ShmGet( 40, 44, 0, 2, 0x0x7fbfffd5e0 )

ShmCreate( 40, 0, 2, 0x0x7fbfffd4d0 )

ShmKeyPermission( 40 ) = 0740 (octal)

ShmCleanup SHM_DB_OBJ_BUFFER

ShmCleanup( 54 )

ShmCreate( 54, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 54 ) = 0740 (octal)

ShmCleanup SHM_DB_SYNC

ShmCleanup( 46 )

ShmCreate( 46, 0, 2, 0x0x7fbfffd650 )

ShmGet( 40, 46, 0, 2, 0x0x7fbfffd5e0 )

ShmCreate( 40, 0, 2, 0x0x7fbfffd4d0 )

ShmKeyPermission( 40 ) = 0740 (octal)

ShmCleanup SHM_DB_CUA_BUFFER

ShmCleanup( 47 )

ShmCreate( 47, 0, 2, 0x0x7fbfffd650 )

ShmGet( 40, 47, 0, 2, 0x0x7fbfffd5e0 )

ShmCreate( 40, 0, 2, 0x0x7fbfffd4d0 )

ShmKeyPermission( 40 ) = 0740 (octal)

ShmCleanup SHM_DB_OTR_BUFFER

ShmCleanup( 64 )

ShmCreate( 64, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 64 ) = 0740 (octal)

ShmCleanup SHM_DB_ESM_BUFFER

ShmCleanup( 65 )

ShmCreate( 65, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 65 ) = 0740 (octal)

ShmCleanup SHM_ROLL_AREA_KEY

ShmCleanup( 9 )

ShmCreate( 9, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 9 ) = 0740 (octal)

ShmCleanup SHM_PAGING_AREA_KEY

ShmCleanup( 8 )

ShmCreate( 8, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 8 ) = 0740 (octal)

ShmCleanup SHM_ROLL_ADM_KEY

ShmCleanup( 17 )

ShmCreate( 17, 0, 2, 0x0x7fbfffd650 )

ShmGet( 10, 17, 0, 2, 0x0x7fbfffd5e0 )

ShmCleanup SHM_PAGING_ADM_KEY

ShmCleanup( 18 )

ShmCreate( 18, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 18 ) = 0740 (octal)

ShmCleanup SHM_PXA_KEY

ShmCleanup( 6 )

ShmCreate( 6, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 6 ) = 0740 (octal)

ShmCleanup SHM_ENQ_TABLE_KEY

ShmCleanup( 34 )

ShmCreate( 34, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 34 ) = 0740 (octal)

ShmCleanup SHM_ENQID_KEY

ShmCleanup( 58 )

ShmCreate( 58, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 58 ) = 0740 (octal)

ShmCleanup SHM_VB_ADM_KEY

ShmCleanup( 7 )

ShmCreate( 7, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 7 ) = 0740 (octal)

ShmCleanup SHM_ES2_ADM

ShmCleanup( 76 )

ShmCreate( 76, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 76 ) = 0740 (octal)

ShmCleanup SHM_EM_ADM

ShmCleanup( 51 )

ShmCreate( 51, 0, 2, 0x0x7fbfffd650 )

ShmProtect( 51, 3 )

ShmProtect( key 51 valid )

ShmProtect( slot Index 50 )

ShmProtect( Mode: 0 )

ShmProtect( before shmdt )

ShmProtect( after shmdt )

ShmProtect( before shmat )

ShmProtect( after shmat )

ShmProtect: shmat key 51 prot 3/0 done

ShmCreate( 51, 0, 2, -> 0x0x2aa3b99000 )

ShmCleanup SHM_EM2_ADM

ShmCleanup( 77 )

ShmCreate( 77, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 77 ) = 0740 (octal)

ShmCleanup SHM_EG2_ADM

ShmCleanup( 78 )

ShmCreate( 78, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 78 ) = 0740 (octal)

ShmCleanup SHM_MSBUF

ShmCleanup( 52 )

ShmCreate( 52, 0, 2, 0x0x7fbfffd650 )

ShmProtect( 52, 3 )

ShmProtect( key 52 valid )

ShmProtect( slot Index 51 )

ShmProtect( Mode: 0 )

ShmProtect( before shmdt )

ShmProtect( after shmdt )

ShmProtect( before shmat )

ShmProtect( after shmat )

ShmProtect: shmat key 52 prot 3/0 done

ShmCreate( 52, 0, 2, -> 0x0x2aa2bc1000 )

ShmCleanup SHM_THRUN_ADM_KEY(th run adm)

ShmCleanup( 30 )

ShmCreate( 30, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 30 ) = 0740 (octal)

ShmCleanup SHM_JAVA

ShmCleanup( 70 )

ShmCreate( 70, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 70 ) = 0740 (octal)

ShmCleanup SHM_PF_AS_KEY(Appl.Statistics)

ShmCleanup( 56 )

ShmCreate( 56, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 56 ) = 0740 (octal)

ShmCleanup SHM_PROFILE

ShmCleanup( 57 )

ShmCreate( 57, 0, 2, 0x0x7fbfffd650 )

ShmProtect( 57, 3 )

ShmProtect( key 57 valid )

ShmProtect( slot Index 56 )

ShmProtect( Mode: 0 )

ShmProtect( before shmdt )

ShmProtect( after shmdt )

ShmProtect( before shmat )

ShmProtect( after shmat )

ShmProtect: shmat key 57 prot 3/0 done

ShmCreate( 57, 0, 2, -> 0x0x2a9794f000 )

ShmCleanup SHM_NO_BUFFER

ShmCleanup( 48 )

ShmCreate( 48, 0, 2, 0x0x7fbfffd650 )

ShmGet( 40, 48, 0, 2, 0x0x7fbfffd5e0 )

ShmCreate( 40, 0, 2, 0x0x7fbfffd4d0 )

ShmKeyPermission( 40 ) = 0740 (octal)

removing request queue

ShmCleanup( 31 )

ShmCreate( 31, 0, 2, 0x0x7fbfffd640 )

ShmProtect( 31, 3 )

ShmProtect( key 31 valid )

ShmProtect( slot Index 30 )

ShmProtect( Mode: 0 )

ShmProtect( before shmdt )

ShmProtect( after shmdt )

ShmProtect( before shmat )

ShmProtect( after shmat )

ShmProtect: shmat key 31 prot 3/0 done

ShmCreate( 31, 0, 2, -> 0x0x2aa2bd3000 )

ShmCleanup SHM_POOL_0

ShmCleanup( 10 )

ShmCreate( 10, 0, 2, 0x0x7fbfffd650 )

ShmProtect( 10, 3 )

ShmProtect( key 10 valid )

ShmProtect( slot Index 9 )

ShmProtect( Mode: 136000000 )

ShmCreate( 10, 0, 2, -> 0x0x2a97a69000 )

ShmCleanup SHM_DB_POOL

ShmCleanup( 40 )

ShmCreate( 40, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 40 ) = 0740 (octal)

ShmCleanup SHM_POOL_50

ShmCleanup( 50 )

ShmCreate( 50, 0, 2, 0x0x7fbfffd650 )

ShmKeyPermission( 50 ) = 0740 (octal)

MiCleanup:

ShmCleanup( 62 )

ShmCreate( 62, 0, 2, 0x0x7fbfffd630 )

ShmProtect( 62, 3 )

ShmProtect( key 62 valid )

ShmProtect( slot Index 61 )

ShmProtect( Mode: 0 )

ShmProtect( before shmdt )

ShmProtect( after shmdt )

ShmProtect( before shmat )

ShmProtect( after shmat )

ShmProtect: shmat key 62 prot 3/0 done

ShmCreate( 62, 0, 2, -> 0x0x2ba7efc000 )

MpiCleanup() -> 0

removing Semaphore-Management

closing connect handles (dgm + tcp)

DpDelSocketInfo: del info for socket 0 (type=2)

NiICloseHandle: shutdown and close hdl 0 / sock 11

DpDelSocketInfo: del info for socket 1 (type=1)

NiICloseHandle: shutdown and close hdl 1 / sock 12 - sock 13

***LOG Q05=> DpHalt, DPStop ( 13228) [dpxxdisp.c 11329]

      • shutdown completed - server stopped ***

Good Bye .....

</pre>

volker_borowski2
Active Contributor
0 Kudos

Hi,

your dispatcher dies because all children are dead.

Now this is a pretty good reason!

What is dev_w0 telling you about the reason for the death of wp 0?

All in all it looks like trouble in allocating shared memory resources,

so some linux-kernel-settings might not be sufficiant. Di you check the instguide?

It is complaining about having only 16G instead of 20G swap, but

this should be no issue for a standard installation. You might

get trouble with this later.

Volker

Former Member
0 Kudos

<pre>

Hi,

I'm not sure, but here's the dev_w0 file:

-


trc file: "dev_w0", trc level: 1, release: "701"

-


*

  • ACTIVE TRACE LEVEL 1

  • ACTIVE TRACE COMPONENTS all, MJ

*

M sysno 00

M sid OPQ

M systemid 390 (AMD/Intel x86_64 with Linux)

M relno 7010

M patchlevel 0

M patchno 32

M intno 20020600

M make: single threaded, Unicode, 64 bit, optimized

M pid 8826

M

M

M Fri Mar 12 13:09:43 2010

M kernel runs with dp version 241000(ext=110000) (@(#) DPLIB-INT-VERSION-241000-UC)

M length of sys_adm_ext is 576 bytes

M ***LOG Q01=> ThInit, WPStart (Workproc 0 1 8826) [thxxhead.c 1290]

M ThInit: running on host pink

M calling db_connect ...

C Oracle Client Version: '10.2.0.4.0'

C Client NLS setting (OCINlsGetInfo): 'AMERICAN_AMERICA.UTF8'

C Logon as OPS$-user to get SAPSR3's password

C Connecting as /@OPQ on connection 0 (nls_hdl 0) ... (dbsl 700 151208)

C Nls CharacterSet NationalCharSet C EnvHp ErrHp ErrHpBatch

C 0 UTF8 0 0x569b7f0 0x56a32f0 0x56b3a48

C Attaching to DB Server OPQ (con_hdl=0,svchp=0x56b3978,srvhp=0x56b68e8)

C Starting user session: OCISessionBegin(con_hdl=0, usr='/',svchp=0x56b3978, srvhp=0x56b68e8, usrhp=0x56f5e70)

C CbApplInfoGet() failed! Ignore, but uninstall callback to avoid more erroneous calls

C Now '/@OPQ' is connected: con_hdl=0, nls_hdl=0, session_id=132.

C Got SAPSR3's password from OPS$-user

C Disconnecting from connection 0 ...

C Closing user session (con_hdl=0,svchp=0x56b3978,usrhp=0x56f5e70)

C Now I'm disconnected from ORACLE

C Connecting as SAPSR3/<pwd>@OPQ on connection 0 (nls_hdl 0) ... (dbsl 700 151208)

C Nls CharacterSet NationalCharSet C EnvHp ErrHp ErrHpBatch

C 0 UTF8 0 0x569b7f0 0x56a32f0 0x56b3a48

C Starting user session: OCISessionBegin(con_hdl=0, usr=SAPSR3/<pwd>, svchp=0x56b3978, srvhp=0x56b68e8, usrhp=0x56f5e70)

C Now 'SAPSR3/<pwd>@OPQ' is connected: con_hdl=0, nls_hdl=0, session_id=132.

C Database NLS settings: AMERICAN_AMERICA.UTF8

C DB instance OPQ is running on pink with ORACLE version 10.2.0.4.0 since MAR 12, 2010, 12:27:20

B Connection 0 opened (DBSL handle 0)

B Wp Hdl ConName ConId ConState TX PRM RCT TIM MAX OPT Date Time DBHost

B 000 000 R/3 000000000 ACTIVE NO YES NO 000 255 255 20100312 130943 pink

C build_stmt: reallocating stmt buffer: 256 -> 2000 characters

M db_connect o.k.

M ICT: exclude compression: .zip,.cs,.rar,.arj,.z,.gz,.tar,.lzh,.cab,.hqx,.ace,.jar,.ear,.war,.css,.pdf,.js,.gzip,.uue,.bz2,.iso,.sda,.sar,.gif,.swc,.swf

I MtxInit: 0 0 0

M SHM_PRES_BUF (addr: 0x2a9b3de000, size: 4400000)

I *** ERROR => shmget(10009,1073741824,992) (22: Invalid argument) [shmux.c 1556]

M *** ERROR => ThShMCreate: ShmCreate SHM_ROLL_AREA_KEY failed [thxxhead.c 2617]

M *** ERROR => ThIPCInit: ThShMCreate [thxxhead.c 2095]

M ***LOG R19=> ThInit, ThIPCInit ( TSKH-IPC-000001) [thxxhead.c 1532]

M in_ThErrHandle: 1

M *** ERROR => ThInit: ThIPCInit (step 1, th_errno 17, action 3, level 1) [thxxhead.c 10563]

M

M Info for wp 0

M

M pid = 8826

M severity = 0

M status = 0

M stat = WP_RUN

M waiting_for = NO_WAITING

M reqtype = DP_RQ_DIAWP

M act_reqtype = NO_REQTYPE

M rq_info = 0

M tid = -1

M mode = 255

M len = -1

M rq_id = 65535

M rq_source =

M last_tid = 0

M last_mode = 0

M semaphore = 0

M act_cs_count = 0

M csTrack = 0

M csTrackRwExcl = 0

M csTrackRwShrd = 0

M mode_cleaned_counter = 0

M control_flag = 0

M int_checked_resource(RFC) = 0

M ext_checked_resource(RFC) = 0

M int_checked_resource(HTTP) = 0

M ext_checked_resource(HTTP) = 0

M report = > <

M action = 0

M tab_name = > <

M attachedVm = no VM

M PfStatDisconnect: disconnect statistics

M Entering TH_CALLHOOKS

M ThCallHooks: call hook >ThrSaveSPAFields< for event BEFORE_DUMP

M *** ERROR => ThrSaveSPAFields: no valid thr_wpadm [thxxrun1.c 723]

M *** ERROR => ThCallHooks: event handler ThrSaveSPAFields for event BEFORE_DUMP failed [thxxtool3.c 261]

M ThCallHooks: call hook >BtcCallLgCl< for event BEFORE_DUMP

M Entering ThSetStatError

M ThIErrHandle: do not call ThrCoreInfo (no_core_info=0, in_dynp_env=0)

M Entering ThReadDetachMode

M call ThrShutDown (1)...

M ***LOG Q02=> wp_halt, WPStop (Workproc 0 8826) [dpuxtool.c 269]

</pre>

Former Member
0 Kudos

Hi Volker,

Indeed it was a shared memory issue. We increased the size kernel.shmmax and kernel.shmall according to note 722273. We were able to get past this phase.

Many thanks!

Answers (0)