on 07-28-2016 3:18 PM
Hi,
After starting the SAP MMC, it shows Dispatcher(Disp+Work.exe) Stopped in process list of SAP MMC.
Please help me to resolve this issue.
Regards,
William
Here is the developer trace file.
===
---------------------------------------------------
trc file: "dev_disp", trc level: 1, release: "701"
---------------------------------------------------
sysno 00
sid ECC
systemid 562 (PC with Windows NT)
relno 7010
patchlevel 0
patchno 32
intno 20020600
make: multithreaded, Unicode, 64 bit, optimized
pid 2396
Thu Jul 28 21:56:37 2016
kernel runs with dp version 241000(ext=110000) (@(#) DPLIB-INT-VERSION-241000-UC)
length of sys_adm_ext is 576 bytes
*** SWITCH TRC-HIDE on ***
***LOG Q00=> DpSapEnvInit, DPStart (00 2396) [dpxxdisp.c 1286]
shared lib "dw_xml.dll" version 32 successfully loaded
shared lib "dw_xtc.dll" version 32 successfully loaded
shared lib "dw_stl.dll" version 32 successfully loaded
shared lib "dw_gui.dll" version 32 successfully loaded
shared lib "dw_mdm.dll" version 32 successfully loaded
rdisp/softcancel_sequence : -> 0,5,-1
use internal message server connection to port 3900
Thu Jul 28 21:56:46 2016
*** WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 9 seconds
***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 5529]
MtxInit: 30000 0 0
DpSysAdmExtInit: ABAP is active
DpSysAdmExtInit: VMC (JAVA VM in WP) is not active
DpIPCInit2: start server >SAPECC6_ECC_00 <
DpShMCreate: sizeof(wp_adm) 29792 (1752)
DpShMCreate: sizeof(tm_adm) 5912704 (29416)
DpShMCreate: sizeof(wp_ca_adm) 24064 (80)
DpShMCreate: sizeof(appc_ca_adm) 8000 (80)
DpCommTableSize: max/headSize/ftSize/tableSize=500/16/552064/552080
DpShMCreate: sizeof(comm_adm) 552080 (1088)
DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0
DpShMCreate: sizeof(slock_adm) 0 (104)
DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0
DpShMCreate: sizeof(file_adm) 0 (72)
DpShMCreate: sizeof(vmc_adm) 0 (1864)
DpShMCreate: sizeof(wall_adm) (41664/36752/64/192)
DpShMCreate: sizeof(gw_adm) 48
DpShMCreate: SHM_DP_ADM_KEY (addr: 000000000BD10050, size: 6614144)
DpShMCreate: allocated sys_adm at 000000000BD10050
DpShMCreate: allocated wp_adm at 000000000BD12270
DpShMCreate: allocated tm_adm_list at 000000000BD196D0
DpShMCreate: allocated tm_adm at 000000000BD19730
DpShMCreate: allocated wp_ca_adm at 000000000C2BCFB0
DpShMCreate: allocated appc_ca_adm at 000000000C2C2DB0
DpShMCreate: allocated comm_adm at 000000000C2C4CF0
DpShMCreate: system runs without slock table
DpShMCreate: system runs without file table
DpShMCreate: allocated vmc_adm_list at 000000000C34B980
DpShMCreate: allocated gw_adm at 000000000C34BA00
DpShMCreate: system runs without vmc_adm
DpShMCreate: allocated ca_info at 000000000C34BA30
DpShMCreate: allocated wall_adm at 000000000C34BA40
MBUF state OFF
DpCommInitTable: init table for 500 entries
rdisp/queue_size_check_value : -> off
ThTaskStatus: rdisp/reset_online_during_debug 0
EmInit: MmSetImplementation( 2 ).
MM global diagnostic options set: 0
<ES> client 0 initializing ....
<ES> InitFreeList
<ES> block size is 4096 kByte.
<ES> Info: em/initial_size_MB( 16243MB) not multiple of em/blocksize_KB( 4096KB)
<ES> Info: em/initial_size_MB rounded up to 16244MB
Using implementation view
<EsNT> Using memory model view.
<EsNT> Memory Reset disabled as NT default
<ES> 4060 blocks reserved for free list.
ES initialized.
rdisp/http_min_wait_dia_wp : 1 -> 1
***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1681]
***LOG Q0K=> DpMsAttach, mscon ( SAPECC6) [dpxxdisp.c 12483]
DpStartStopMsg: send start message (myname is >SAPECC6_ECC_00 <)
DpStartStopMsg: start msg sent
CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.
CCMS: Initalizing shared memory of size 60000000 for monitoring segment.
CCMS: Checking Downtime Configuration of Monitoring Segment.
CCMS: start to initalize 3.X shared alert area (first segment).
DpMsgAdmin: Set release to 7010, patchlevel 0
MBUF state PREPARED
MBUF component UP
DpMBufHwIdSet: set Hardware-ID
***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1048]
DpMsgAdmin: Set patchno for this platform to 32
Release check o.K.
***LOG Q0I=> NiIRead: recv (10054: WSAECONNRESET: Connection reset by peer) [nixxi.cpp 4436]
*** ERROR => NiIRead: SiRecv failed for hdl 4 / sock 1168
(SI_ECONN_BROKEN/10054; I4; ST; 127.0.0.1:65000) [nixxi.cpp 4436]
*** ERROR => DpIcmMsgProcess: IcmRecMsg (rc=-8,-6) [dpxxdisp.c 19007]
Thu Jul 28 21:57:26 2016
my types changed after wp death/restart 0xbf --> 0xbe
my types changed after wp death/restart 0xbe --> 0xbc
my types changed after wp death/restart 0xbc --> 0xb8
my types changed after wp death/restart 0xb8 --> 0xb0
my types changed after wp death/restart 0xb0 --> 0xa0
my types changed after wp death/restart 0xa0 --> 0x80
*** DP_FATAL_ERROR => DpWPCheck: no more work processes
*** DISPATCHER EMERGENCY SHUTDOWN ***
increase tracelevel of WPs
NiWait: sleep (10000ms) ...
NiISelect: timeout 10000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:36 2016
NiISelect: TIMEOUT occured (10000ms)
dump system status
Workprocess Table (long) Thu Jul 28 13:57:36 2016
========================
No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table
-------------------------------------------------------------------------------------------------------------------------------
0 DIA 3744 Ended no 1 0 0
1 DIA 5812 Ended no 1 0 0
2 DIA 6824 Ended no 1 0 0
3 DIA 2540 Ended no 1 0 0
4 DIA 2500 Ended no 1 0 0
5 DIA 1364 Ended no 1 0 0
6 DIA 5612 Ended no 1 0 0
7 DIA 6980 Ended no 1 0 0
8 DIA 5520 Ended no 1 0 0
9 DIA 4160 Ended no 1 0 0
10 UPD 6968 Ended no 1 0 0
11 ENQ 3436 Ended no 1 0 0
12 BTC 3048 Ended no 1 0 0
13 BTC 2444 Ended no 1 0 0
14 BTC 7120 Ended no 1 0 0
15 SPO 6348 Ended no 1 0 0
16 UP2 7128 Ended no 1 0 0
Dispatcher Queue Statistics Thu Jul 28 13:57:36 2016
===========================
+------+--------+--------+--------+--------+--------+
| Typ | now | high | max | writes | reads |
+------+--------+--------+--------+--------+--------+
| NOWP | 1 | 2 | 2000 | 14 | 13 |
+------+--------+--------+--------+--------+--------+
| DIA | 5 | 5 | 2000 | 5 | 0 |
+------+--------+--------+--------+--------+--------+
| UPD | 1 | 1 | 2000 | 1 | 0 |
+------+--------+--------+--------+--------+--------+
| ENQ | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
| BTC | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
| SPO | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
| UP2 | 0 | 0 | 2000 | 0 | 0 |
+------+--------+--------+--------+--------+--------+
max_rq_id 13
wake_evt_udp_now 0
wake events total 10, udp 9 ( 90%), shm 1 ( 10%)
since last update total 10, udp 9 ( 90%), shm 1 ( 10%)
Dump of tm_adm structure: Thu Jul 28 13:57:36 2016
=========================
Term uid man user term lastop mod wp ta a/i (modes)
Workprocess Comm. Area Blocks Thu Jul 28 13:57:36 2016
=============================
Slots: 300, Used: 2, Max: 1
+------+--------------+----------+-------------+
| id | owner | pid | eyecatcher |
+------+--------------+----------+-------------+
| 0 | DISPATCHER | -1 | *WPCAAD000* |
| 150 | DISPATCHER | -1 | *WPCAAD150* |
NiWait: sleep (5000ms) ...
NiISelect: timeout 5000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:41 2016
NiISelect: TIMEOUT occured (5000ms)
DpHalt: shutdown server >SAPECC6_ECC_00 < (normal)
DpJ2eeDisableRestart
DpModState: buffer in state MBUF_PREPARED
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIModState: change state to SHUTDOWN
DpModState: change server state from STARTING to SHUTDOWN
Switch off Shared memory profiling
ShmProtect( 57, 3 )
ShmProtect(SHM_PROFILE, SHM_PROT_RW
ShmProtect( 57, 1 )
ShmProtect(SHM_PROFILE, SHM_PROT_RD
DpWakeUpWps: wake up all wp's
Stop work processes
Stop gateway
killing process (956) (SOFT_KILL)
Stop icman
killing process (6720) (SOFT_KILL)
Terminate gui connections
wait for end of work processes
wait for end of gateway
[DpProcDied] Process lives (PID:956 HANDLE:1056)
waiting for termination of gateway ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:42 2016
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died (PID:956 HANDLE:1056)
wait for end of icman
[DpProcDied] Process lives (PID:6720 HANDLE:1064)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:43 2016
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:6720 HANDLE:1064)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:44 2016
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:6720 HANDLE:1064)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:45 2016
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:6720 HANDLE:1064)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:46 2016
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:6720 HANDLE:1064)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:47 2016
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:6720 HANDLE:1064)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:48 2016
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:6720 HANDLE:1064)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:49 2016
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:6720 HANDLE:1064)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:50 2016
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:6720 HANDLE:1064)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:51 2016
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:6720 HANDLE:1064)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:52 2016
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:6720 HANDLE:1064)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1169
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Thu Jul 28 21:57:53 2016
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died (PID:6720 HANDLE:1064)
DpStartStopMsg: send stop message (myname is >SAPECC6_ECC_00 <)
DpStartStopMsg: Write AD_STARTSTOP message with type= 0, name=SAPECC6_ECC_00 , sapsysnr= 0, hostname=SAPECC6
AdGetSelfIdentRecord: > <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0
DpConvertRequest: net size = 189 bytes
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=562,pac=1,MESG_IO)
MsINiWrite: sent 562 bytes
send msg (len 110+452) to name -, type 4, key -
DpStartStopMsg: stop msg sent
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 recv would block (errno=EAGAIN)
NiIRead: read for hdl 2 timed out (0ms)
DpHalt: no more messages from the message server
DpHalt: send keepalive to synchronize with the message server
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=114,pac=1,MESG_IO)
MsINiWrite: sent 114 bytes
send msg (len 110+4) to name MSG_SERVER, type 0, key -
MsSndName: MS_NOOP ok
Send 4 bytes to MSG_SERVER
NiIRead: hdl 2 recv would block (errno=EAGAIN)
NiIPeek: peek successful for hdl 2 (r)
NiIRead: hdl 2 received data (rcd=114,pac=1,MESG_IO)
NiBufIIn: NIBUF len=114
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 114 bytes
MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -
Received 4 bytes from MSG_SERVER
Received opcode MS_NOOP from msg_server, reply MSOP_OK
MsOpReceive: ok
MsSendKeepalive : keepalive sent to message server
NiIRead: hdl 2 recv would block (errno=EAGAIN)
Thu Jul 28 21:57:54 2016
NiIPeek: peek for hdl 2 timed out (r; 1000ms)
NiIRead: read for hdl 2 timed out (1000ms)
DpHalt: no more messages from the message server
DpHalt: sync with message server o.k.
detach from message server
***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 12829]
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIDetach: send logout to msg_server
MsIDetach: call exit function
DpMsShutdownHook called
NiBufISelUpdate: new MODE -- (r-) for hdl 2 in set0
SiSelNSet: set events of sock 1052 to: ---
NiBufISelRemove: remove hdl 2 from set0
SiSelNRemove: removed sock 1052 (pos=2)
SiSelNRemove: removed sock 1052
NiSelIRemove: removed hdl 2
MBUF state OFF
AdGetSelfIdentRecord: > <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
blks_in_queue/wp_ca_blk_no/wp_max_no = 2/300/17
LOCK WP ca_blk 1
make DISP owner of wp_ca_blk 1
DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 16)
MBUF component DOWN
NiICloseHandle: shutdown and close hdl 2 / sock 1052
NiBufIClose: clear extension for hdl 2
MsIDetach: detach MS-system
cleanup EM
EsCleanup ....
EmCleanup() -> 0
Es2Cleanup: Cleanup ES2
***LOG Q05=> DpHalt, DPStop ( 2396) [dpxxdisp.c 11045]
Good Bye .....
Hi William,
On the dispatcher trace file, we can see it has been stopped because there were no more available work processes:
Thu Jul 28 21:57:26 2016
my types changed after wp death/restart 0xbf --> 0xbe
my types changed after wp death/restart 0xbe --> 0xbc
my types changed after wp death/restart 0xbc --> 0xb8
my types changed after wp death/restart 0xb8 --> 0xb0
my types changed after wp death/restart 0xb0 --> 0xa0
my types changed after wp death/restart 0xa0 --> 0x80
*** DP_FATAL_ERROR => DpWPCheck: no more work processes
*** DISPATCHER EMERGENCY SHUTDOWN ***
Workprocess Table shows all WP in 'Ended' status. Please attach into this thread dev_w0 and dev_w1, so that we can check why work processes died.
Regards,
Raquel
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi William,
Could you post "dev_w0" and "dev_icm" logs?
Regards,
Ganesan
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
User | Count |
---|---|
84 | |
25 | |
12 | |
9 | |
6 | |
6 | |
5 | |
5 | |
4 | |
4 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.