on 11-03-2010 10:46 AM
Hi Guys,
We are experiencing a stop in our SAP system dispatcher.
Below are the dev_disp contents:
ERROR => DpProcKill: kill failed [dpntdisp.c 371]
DpIJ2eeShutdown: j2ee state = SHUTDOWN
SiSelNClear: set events of sock 1452 to: ---
SiSelNRemove: removed sock 1452 (pos=2)
SiSelNRemove: removed sock 1452
NiSelIRemove: removed hdl 2
DpDelSocketInfo: del info for socket 2 (type=7)
NiICloseHandle: shutdown and close hdl 2 / sock 1452 - sock -1
DpModState: buffer in state MBUF_PREPARED
NiBufSend starting
NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIModState: change state to SHUTDOWN
DpModState: change server state from STARTING to SHUTDOWN
Switch off Shared memory profiling
ShmProtect( 57, 3 )
ShmProtect(SHM_PROFILE, SHM_PROT_RW
ShmProtect( 57, 1 )
ShmProtect(SHM_PROFILE, SHM_PROT_RD
DpWakeUpWps: wake up all wp's
Stop work processes
Stop gateway
killing process (208) (SOFT_KILL)
Stop icman
killing process (4040) (SOFT_KILL)
Terminate gui connections
wait for end of work processes
wait for end of gateway
[DpProcDied] Process lives (PID:208 HANDLE:1460)
waiting for termination of gateway ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:01 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died (PID:208 HANDLE:1460)
wait for end of icman
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:02 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:03 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:04 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:05 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:06 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:07 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:08 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:09 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:10 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:11 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died (PID:4040 HANDLE:1468)
[DpProcDied] Process died (PID:1204 HANDLE:1444)
DpStartStopMsg: send stop message (myname is >NGD_NGD_00 <)
AdGetSelfIdentRecord: > <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0
DpConvertRequest: net size = 189 bytes
NiBufSend starting
NiIWrite: hdl 3 sent data (wrt=562,pac=1,MESG_IO)
MsINiWrite: sent 562 bytes
send msg (len 110+452) to name -, type 4, key -
DpStartStopMsg: stop msg sent
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 received data (rcd=114,pac=1,MESG_IO)
NiBufIIn: NIBUF len=114
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 114 bytes
MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -
DpHalt: received 4 bytes from message server
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 recv would block (errno=EAGAIN)
NiIRead: read for hdl 3 timed out (0ms)
DpHalt: no more messages from the message server
DpHalt: send keepalive to synchronize with the message server
NiBufSend starting
NiIWrite: hdl 3 sent data (wrt=114,pac=1,MESG_IO)
MsINiWrite: sent 114 bytes
send msg (len 110+4) to name MSG_SERVER, type 0, key -
MsSndName: MS_NOOP ok
Send 4 bytes to MSG_SERVER
NiIRead: hdl 3 recv would block (errno=EAGAIN)
NiIPeek: peek successful for hdl 3 (r)
NiIRead: hdl 3 received data (rcd=114,pac=1,MESG_IO)
NiBufIIn: NIBUF len=114
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 114 bytes
MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -
Received 4 bytes from MSG_SERVER
Received opcode MS_NOOP from msg_server, reply MSOP_OK
MsOpReceive: ok
MsSendKeepalive : keepalive sent to message server
NiIRead: hdl 3 recv would block (errno=EAGAIN)
Wed Nov 03 10:32:12 2010
NiIPeek: peek for hdl 3 timed out (r; 1000ms)
NiIRead: read for hdl 3 timed out (1000ms)
DpHalt: no more messages from the message server
DpHalt: sync with message server o.k.
detach from message server
***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 12996]
NiBufSend starting
NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIDetach: send logout to msg_server
MsIDetach: call exit function
DpMsShutdownHook called
NiBufISelUpdate: new MODE -- (r-) for hdl 3 in set0
SiSelNSet: set events of sock 1296 to: ---
NiBufISelRemove: remove hdl 3 from set0
SiSelNRemove: removed sock 1296 (pos=3)
SiSelNRemove: removed sock 1296
NiSelIRemove: removed hdl 3
MBUF state OFF
AdGetSelfIdentRecord: > <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/35
LOCK WP ca_blk 1
make DISP owner of wp_ca_blk 1
DpSemRq: key: 2, units: 1, timeout: -1
DpSemRel: key: 2, units: 1
DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 15)
MBUF component DOWN
NiICloseHandle: shutdown and close hdl 3 / sock 1296
NiBufIClose: clear extension for hdl 3
MsIDetach: detach MS-system
cleanup EM
EsCleanup ....
EmCleanup() -> 0
Es2Cleanup: Cleanup ES2
***LOG Q05=> DpHalt, DPStop ( 8104) [dpxxdisp.c 11183]
Would appreciate any help.
Thank You.
Hello,
what does appear in dev_disp before the line:
ERROR => DpProcKill: kill failed [dpntdisp.c 371] ??
kind regards,
Mercedes
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi Mercedes,
Here are the earlier contents:
-
trc file: "dev_disp", trc level: 1, release: "700"
-
sysno 00
sid NGD
systemid 560 (PC with Windows NT)
relno 7000
patchlevel 0
patchno 236
intno 20050900
make: multithreaded, Unicode, optimized
pid 8104
Wed Nov 03 10:30:33 2010
kernel runs with dp version 243000(ext=110000) (@(#) DPLIB-INT-VERSION-243000-UC)
length of sys_adm_ext is 576 bytes
SWITCH TRC-HIDE on ***
***LOG Q00=> DpSapEnvInit, DPStart (00 8104) [dpxxdisp.c 1287]
shared lib "dw_xml.dll" version 236 successfully loaded
shared lib "dw_xtc.dll" version 236 successfully loaded
shared lib "dw_stl.dll" version 236 successfully loaded
shared lib "dw_gui.dll" version 236 successfully loaded
shared lib "dw_mdm.dll" version 236 successfully loaded
rdisp/softcancel_sequence : -> 0,5,-1
use internal message server connection to port 3900
Wed Nov 03 10:30:39 2010
WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 5 seconds
***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 5521]
MtxInit: 30000 0 0
DpSysAdmExtInit: ABAP is active
DpSysAdmExtInit: VMC (JAVA VM in WP) is not active
DpIPCInit2: start server >NGD_NGD_00 <
DpShMCreate: sizeof(wp_adm) 59640 (1704)
DpShMCreate: sizeof(tm_adm) 4415616 (21968)
DpShMCreate: sizeof(wp_ca_adm) 24064 (80)
DpShMCreate: sizeof(appc_ca_adm) 8000 (80)
DpCommTableSize: max/headSize/ftSize/tableSize=500/8/528056/528064
DpShMCreate: sizeof(comm_adm) 528064 (1048)
DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0
DpShMCreate: sizeof(slock_adm) 0 (96)
DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0
DpShMCreate: sizeof(file_adm) 0 (72)
DpShMCreate: sizeof(vmc_adm) 0 (1544)
DpShMCreate: sizeof(wall_adm) (38456/34360/64/184)
DpShMCreate: sizeof(gw_adm) 48
DpShMCreate: SHM_DP_ADM_KEY (addr: 07B80040, size: 5116936)
DpShMCreate: allocated sys_adm at 07B80040
DpShMCreate: allocated wp_adm at 07B82178
DpShMCreate: allocated tm_adm_list at 07B90A70
DpShMCreate: allocated tm_adm at 07B90AA0
DpShMCreate: allocated wp_ca_adm at 07FC6B20
DpShMCreate: allocated appc_ca_adm at 07FCC920
DpShMCreate: allocated comm_adm at 07FCE860
DpShMCreate: system runs without slock table
DpShMCreate: system runs without file table
DpShMCreate: allocated vmc_adm_list at 0804F720
DpShMCreate: allocated gw_adm at 0804F760
DpShMCreate: system runs without vmc_adm
DpShMCreate: allocated ca_info at 0804F790
DpShMCreate: allocated wall_adm at 0804F798
MBUF state OFF
DpCommInitTable: init table for 500 entries
rdisp/queue_size_check_value : -> off
ThTaskStatus: rdisp/reset_online_during_debug 0
EmInit: MmSetImplementation( 2 ).
MM global diagnostic options set: 0
<ES> client 0 initializing ....
<ES> InitFreeList
<ES> block size is 2048 kByte.
Using implementation view
<EsNT> Using memory model view.
<EsNT> Memory Reset disabled as NT default
<ES> 511 blocks reserved for free list.
ES initialized.
mm.dump: set maximum dump mem to 96 MB
Wed Nov 03 10:30:41 2010
J2EE server info
start = TRUE
state = STARTED
pid = 1204
argv[0] = D:\usr\sap\NGD\DVEBMGS00\exe\jcontrol.EXE
argv[1] = D:\usr\sap\NGD\DVEBMGS00\exe\jcontrol.EXE
argv[2] = pf=D:\usr\sap\NGD\SYS\profile\NGD_DVEBMGS00_NGD
argv[3] = -DSAPSTART=1
argv[4] = -DCONNECT_PORT=65000
argv[5] = -DSAPSYSTEM=00
argv[6] = -DSAPSYSTEMNAME=NGD
argv[7] = -DSAPMYNAME=NGD_NGD_00
argv[8] = -DSAPPROFILE=D:\usr\sap\NGD\SYS\profile\NGD_DVEBMGS00_NGD
argv[9] = -DFRFC_FALLBACK=ON
argv[10] = -DFRFC_FALLBACK_HOST=localhost
start_lazy = 0
start_control = SAP J2EE startup framework
DpJ2eeStart: j2ee state = STARTED
Wed Nov 03 10:31:04 2010
rdisp/http_min_wait_dia_wp : 1 -> 1
***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1694]
Wed Nov 03 10:31:05 2010
***LOG Q0K=> DpMsAttach, mscon ( NGD) [dpxxdisp.c 12650]
DpStartStopMsg: send start message (myname is >NGD_NGD_00 <)
DpStartStopMsg: start msg sent
CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.
Wed Nov 03 10:31:06 2010
CCMS: start to initalize 3.X shared alert area (first segment).
DpJ2eeLogin: j2ee state = CONNECTED
DpMsgAdmin: Set release to 7000, patchlevel 0
MBUF state PREPARED
MBUF component UP
DpMBufHwIdSet: set Hardware-ID
***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1050]
DpMsgAdmin: Set patchno for this platform to 236
Release check o.K.
Wed Nov 03 10:31:25 2010
***LOG Q0I=> NiIRead: recv (10054: WSAECONNRESET: Connection reset by peer) [nixxi.cpp 4424]
ERROR => NiIRead: SiRecv failed for hdl 4 / sock 1272
(SI_ECONN_BROKEN/10054; I4; ST; 127.0.0.1:21181) [nixxi.cpp 4424]
ERROR => DpJ2eeMsgProcess: NiRead failed (NIECONN_BROKEN) [dpxxj2ee.c 1212]
DpJ2eeMsgProcess: j2ee state = CONNECTED (NIECONN_BROKEN)
Wed Nov 03 10:31:45 2010
my types changed after wp death/restart 0xbf --> 0xbe
my types changed after wp death/restart 0xbe --> 0xbc
my types changed after wp death/restart 0xbc --> 0xb8
my types changed after wp death/restart 0xb8 --> 0xb0
my types changed after wp death/restart 0xb0 --> 0xa0
my types changed after wp death/restart 0xa0 --> 0x80
DP_FATAL_ERROR => DpWPCheck: no more work processes
DISPATCHER EMERGENCY SHUTDOWN ***
increase tracelevel of WPs
NiWait: sleep (10000ms) ...
NiISelect: timeout 10000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:31:55 2010
NiISelect: TIMEOUT occured (10000ms)
dump system status
Workprocess Table (long) Wed Nov 03 09:31:55 2010
========================
No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table
-
0 DIA 2248 Ended no 1 0 0
1 DIA 4180 Ended no 1 0 0
2 DIA 7712 Ended no 1 0 0
3 DIA 2664 Ended no 1 0 0
4 DIA 7332 Ended no 1 0 0
5 DIA 2584 Ended no 1 0 0
6 DIA 1908 Ended no 1 0 0
7 DIA 4508 Ended no 1 0 0
8 DIA 7460 Ended no 1 0 0
9 DIA 7900 Ended no 1 0 0
10 DIA 7864 Ended no 1 0 0
11 DIA 2884 Ended no 1 0 0
12 DIA 7792 Ended no 1 0 0
13 DIA 5184 Ended no 1 0 0
14 DIA 8180 Ended no 1 0 0
15 DIA 7644 Ended no 1 0 0
16 UPD 6644 Ended no 1 0 0
17 UPD 6416 Ended no 1 0 0
18 UPD 392 Ended no 1 0 0
19 UPD 6528 Ended no 1 0 0
20 UPD 764 Ended no 1 0 0
21 UPD 940 Ended no 1 0 0
22 UPD 2136 Ended no 1 0 0
23 UPD 5932 Ended no 1 0 0
24 UPD 6432 Ended no 1 0 0
25 UPD 4752 Ended no 1 0 0
26 UPD 5944 Ended no 1 0 0
27 UPD 6564 Ended no 1 0 0
28 ENQ 5520 Ended no 1 0 0
29 BTC 7004 Ended no 1 0 0
30 BTC 1752 Ended no 1 0 0
31 BTC 5016 Ended no 1 0 0
32 SPO 7080 Ended no 1 0 0
33 UP2 5264 Ended no 1 0 0
34 UP2 880 Ended no 1 0 0
Dispatcher Queue Statistics Wed Nov 03 09:31:55 2010
===========================
--------
+
Typ | now | high | max | writes | reads |
--------
+
NOWP | 0 | 4 | 2000 | 5 | 5 |
--------
+
DIA | 5 | 5 | 2000 | 5 | 0 |
--------
+
UPD | 0 | 0 | 2000 | 0 | 0 |
--------
+
ENQ | 0 | 0 | 2000 | 0 | 0 |
--------
+
BTC | 0 | 0 | 2000 | 0 | 0 |
--------
+
SPO | 0 | 0 | 2000 | 0 | 0 |
--------
+
UP2 | 0 | 0 | 2000 | 0 | 0 |
--------
+
max_rq_id 12
wake_evt_udp_now 0
wake events total 8, udp 2 ( 25%), shm 6 ( 75%)
since last update total 8, udp 2 ( 25%), shm 6 ( 75%)
Dump of tm_adm structure: Wed Nov 03 09:31:55 2010
=========================
Term uid man user term lastop mod wp ta a/i (modes)
Workprocess Comm. Area Blocks Wed Nov 03 09:31:55 2010
=============================
Slots: 300, Used: 1, Max: 0
--------
+
id | owner | pid | eyecatcher |
--------
+
0 | DISPATCHER | -1 | WPCAAD000 |
NiWait: sleep (5000ms) ...
NiISelect: timeout 5000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:00 2010
NiISelect: TIMEOUT occured (5000ms)
DpHalt: shutdown server >NGD_NGD_00 < (normal)
DpJ2eeDisableRestart
MsIDelService: delete service J2EE for myself
NiBufSend starting
NiIWrite: hdl 3 sent data (wrt=161,pac=1,MESG_IO)
MsINiWrite: sent 161 bytes
send msg (len 110+51) to name MSG_SERVER, type 0, key -
MsSndName: MS_DEL_PROPERTY ok
Send 51 bytes to MSG_SERVER
MS_DEL_PROPERTY : asynchronous call
send MsDelService(J2EE) to msgserver
DpIJ2eeShutdown: send SIGINT to SAP J2EE startup framework (pid=1204)
killing process (1204) (SOFT_KILL)
Regards.
User | Count |
---|---|
85 | |
10 | |
10 | |
10 | |
7 | |
6 | |
6 | |
5 | |
4 | |
4 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.