cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

SAP MMC Dispatcher (disp+work.exe) stopped

Former Member

on ‎02-20-2014 3:52 AM

0 Kudos

Hi,

I have the subject issue and below is the developer trace


---------------------------------------------------


trc file: "dev_disp", trc level: 1, release: "700"


---------------------------------------------------


sysno      00


sid        RDP


systemid   562 (PC with Windows NT)


relno      7000


patchlevel 0


patchno    221


intno      20050900


make: multithreaded, Unicode, 64 bit, optimized


pid        5172



　


Thu Feb 20 03:41:57 2014


kernel runs with dp version 243000(ext=110000) (@(#) DPLIB-INT-VERSION-243000-UC)


length of sys_adm_ext is 576 bytes


*** SWITCH TRC-HIDE on ***


***LOG Q00=> DpSapEnvInit, DPStart (00 5172) [dpxxdisp.c   1287]


shared lib "dw_xml.dll" version 221 successfully loaded


shared lib "dw_xtc.dll" version 221 successfully loaded


shared lib "dw_stl.dll" version 221 successfully loaded


shared lib "dw_gui.dll" version 221 successfully loaded


shared lib "dw_mdm.dll" version 221 successfully loaded


rdisp/softcancel_sequence :  -> 0,5,-1


use internal message server connection to port 3900



Thu Feb 20 03:42:02 2014


*** WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 4 seconds


***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c  5521]


MtxInit: 30000 0 0


DpSysAdmExtInit: ABAP is active


DpSysAdmExtInit: VMC (JAVA VM in WP) is not active


DpIPCInit2: start server >rdcprd_RDP_00                           <


DpShMCreate: sizeof(wp_adm) 31536 (1752)


DpShMCreate: sizeof(tm_adm) 58861440 (29416)


DpShMCreate: sizeof(wp_ca_adm) 80000 (80)


DpShMCreate: sizeof(appc_ca_adm) 160000 (80)


DpCommTableSize: max/headSize/ftSize/tableSize=2000/16/2208064/2208080


DpShMCreate: sizeof(comm_adm) 2208080 (1088)


DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0


DpShMCreate: sizeof(slock_adm) 0 (104)


DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0


DpShMCreate: sizeof(file_adm) 0 (72)


DpShMCreate: sizeof(vmc_adm) 0 (1864)


DpShMCreate: sizeof(wall_adm) (416064/346352/64/192)


DpShMCreate: sizeof(gw_adm) 48


DpShMCreate: SHM_DP_ADM_KEY (addr: 000000000D430050, size: 62112560)


DpShMCreate: allocated sys_adm at 000000000D430050


DpShMCreate: allocated wp_adm at 000000000D432270


DpShMCreate: allocated tm_adm_list at 000000000D439DA0


DpShMCreate: allocated tm_adm at 000000000D439E00


DpShMCreate: allocated wp_ca_adm at 0000000010C5C580


DpShMCreate: allocated appc_ca_adm at 0000000010C6FE00


DpShMCreate: allocated comm_adm at 0000000010C96F00


DpShMCreate: system runs without slock table


DpShMCreate: system runs without file table


DpShMCreate: allocated vmc_adm_list at 0000000010EB2050


DpShMCreate: allocated gw_adm at 0000000010EB20D0


DpShMCreate: system runs without vmc_adm


DpShMCreate: allocated ca_info at 0000000010EB2100


DpShMCreate: allocated wall_adm at 0000000010EB2110


MBUF state OFF


DpCommInitTable: init table for 2000 entries


rdisp/queue_size_check_value :  -> off


ThTaskStatus: rdisp/reset_online_during_debug 0


EmInit: MmSetImplementation( 2 ).


MM global diagnostic options set: 0


<ES> client 0 initializing ....


<ES> InitFreeList


<ES> block size is 4096 kByte.


<ES> Info: em/initial_size_MB( 5734MB) not multiple of em/blocksize_KB( 4096KB)


<ES> Info: em/initial_size_MB rounded up to 5736MB


Using implementation view


<EsNT> Using memory model view.


<EsNT> Memory Reset disabled as NT default


<ES> 1433 blocks reserved for free list.


ES initialized.


mm.dump: set maximum dump mem to 96 MB



Thu Feb 20 03:42:03 2014


rdisp/http_min_wait_dia_wp : 1 -> 1


***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c   1694]


***LOG Q0K=> DpMsAttach, mscon ( rdcprd) [dpxxdisp.c   12639]


DpStartStopMsg: send start message (myname is >rdcprd_RDP_00                           <)


DpStartStopMsg: start msg sent


CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.


CCMS: Initalizing shared memory of size 60000000 for monitoring segment.


CCMS: Checking Downtime Configuration of Monitoring Segment.


CCMS: start to initalize 3.X shared alert area (first segment).


DpMsgAdmin: Set release to 7000, patchlevel 0


MBUF state PREPARED


MBUF component UP


DpMBufHwIdSet: set Hardware-ID


***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c   1050]


DpMsgAdmin: Set patchno for this platform to 221


Release check o.K.



Thu Feb 20 03:42:43 2014


my types changed after wp death/restart 0xbf --> 0xbe


my types changed after wp death/restart 0xbe --> 0xbc


my types changed after wp death/restart 0xbc --> 0xb8


my types changed after wp death/restart 0xb8 --> 0xb0


my types changed after wp death/restart 0xb0 --> 0xa0


my types changed after wp death/restart 0xa0 --> 0x80


*** DP_FATAL_ERROR => DpWPCheck: no more work processes


*** DISPATCHER EMERGENCY SHUTDOWN ***


increase tracelevel of WPs


NiWait: sleep (10000ms) ...


NiISelect: timeout 10000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:42:53 2014


NiISelect: TIMEOUT occured (10000ms)


dump system status


Workprocess Table (long) Wed Feb 19 22:12:53 2014


========================



No Ty. Pid      Status  Cause Start Err Sem CPU    Time  Program          Cl  User         Action                    Table


-------------------------------------------------------------------------------------------------------------------------------


0 DIA     5304 Ended         no      1   0        0                                                                         


1 DIA     4876 Ended         no      1   0        0                                                                         


2 DIA     4748 Ended         no      1   0        0                                                                         


3 DIA     4720 Ended         no      1   0        0                                                                         


4 DIA     1636 Ended         no      1   0        0                                                                         


5 DIA     6120 Ended         no      1   0        0                                                                         


6 DIA     2176 Ended         no      1   0        0                                                                         


7 DIA     2380 Ended         no      1   0        0                                                                         


8 UPD     3732 Ended         no      1   0        0                                                                         


9 UPD     5112 Ended         no      1   0        0                                                                         


10 ENQ     3340 Ended         no      1   0        0                                                                         


11 BTC     4904 Ended         no      1   0        0                                                                         


12 BTC     4772 Ended         no      1   0        0                                                                         


13 BTC     5136 Ended         no      1   0        0                                                                         


14 BTC     5328 Ended         no      1   0        0                                                                         


15 SPO     5228 Ended         no      1   0        0                                                                         


16 UP2     1432 Ended         no      1   0        0                                                                         


17 UP2     5052 Ended         no      1   0        0                                                                         


Dispatcher Queue Statistics Wed Feb 19 22:12:53 2014


===========================



+------+--------+--------+--------+--------+--------+


|  Typ |    now |   high |    max | writes |  reads |


+------+--------+--------+--------+--------+--------+


| NOWP |      0 |      2 |   2000 |      5 |      5 |


+------+--------+--------+--------+--------+--------+


|  DIA |      5 |      5 |   2000 |      5 |      0 |


+------+--------+--------+--------+--------+--------+


|  UPD |      0 |      0 |   2000 |      0 |      0 |


+------+--------+--------+--------+--------+--------+


|  ENQ |      0 |      0 |   2000 |      0 |      0 |


+------+--------+--------+--------+--------+--------+


|  BTC |      0 |      0 |   2000 |      0 |      0 |


+------+--------+--------+--------+--------+--------+


|  SPO |      0 |      0 |   2000 |      0 |      0 |


+------+--------+--------+--------+--------+--------+


|  UP2 |      0 |      0 |   2000 |      0 |      0 |


+------+--------+--------+--------+--------+--------+



　


max_rq_id 12


wake_evt_udp_now 0



wake events      total     8,  udp     6 ( 75%),  shm     2 ( 25%)


since last update total     8,  udp     6 ( 75%),  shm     2 ( 25%)



　


Dump of tm_adm structure: Wed Feb 19 22:12:53 2014


=========================



Term    uid  man user    term   lastop  mod wp  ta   a/i (modes)



Workprocess Comm. Area Blocks Wed Feb 19 22:12:53 2014


=============================



Slots: 1000, Used: 1, Max: 0


+------+--------------+----------+-------------+


|   id | owner        |   pid    | eyecatcher  |


+------+--------------+----------+-------------+


|    0 | DISPATCHER   |       -1 | *WPCAAD000* |



NiWait: sleep (5000ms) ...


NiISelect: timeout 5000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:42:58 2014


NiISelect: TIMEOUT occured (5000ms)


DpHalt: shutdown server >rdcprd_RDP_00                           < (normal)


DpJ2eeDisableRestart


DpModState: buffer in state MBUF_PREPARED



NiBufSend starting


NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)


MsINiWrite: sent 110 bytes


MsIModState: change state to SHUTDOWN


DpModState: change server state from STARTING to SHUTDOWN


Switch off Shared memory profiling


ShmProtect( 57, 3 )


ShmProtect(SHM_PROFILE, SHM_PROT_RW


ShmProtect( 57, 1 )


ShmProtect(SHM_PROFILE, SHM_PROT_RD


DpWakeUpWps: wake up all wp's


Stop work processes


Stop gateway


killing process (5668) (SOFT_KILL)


Stop icman


killing process (2632) (SOFT_KILL)


Terminate gui connections


wait for end of work processes


wait for end of gateway


[DpProcDied] Process lives  (PID:5668  HANDLE:1512)


waiting for termination of gateway ...


NiWait: sleep (1000ms) ...


NiISelect: timeout 1000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:42:59 2014


NiISelect: TIMEOUT occured (1000ms)


[DpProcDied] Process died  (PID:5668  HANDLE:1512)


wait for end of icman


[DpProcDied] Process lives  (PID:2632  HANDLE:1524)


waiting for termination of icman ...


NiWait: sleep (1000ms) ...


NiISelect: timeout 1000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:43:00 2014


NiISelect: TIMEOUT occured (1000ms)


[DpProcDied] Process lives  (PID:2632  HANDLE:1524)


waiting for termination of icman ...


NiWait: sleep (1000ms) ...


NiISelect: timeout 1000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:43:01 2014


NiISelect: TIMEOUT occured (1000ms)


[DpProcDied] Process lives  (PID:2632  HANDLE:1524)


waiting for termination of icman ...


NiWait: sleep (1000ms) ...


NiISelect: timeout 1000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:43:02 2014


NiISelect: TIMEOUT occured (1000ms)


[DpProcDied] Process lives  (PID:2632  HANDLE:1524)


waiting for termination of icman ...


NiWait: sleep (1000ms) ...


NiISelect: timeout 1000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:43:03 2014


NiISelect: TIMEOUT occured (1000ms)


[DpProcDied] Process lives  (PID:2632  HANDLE:1524)


waiting for termination of icman ...


NiWait: sleep (1000ms) ...


NiISelect: timeout 1000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:43:04 2014


NiISelect: TIMEOUT occured (1000ms)


[DpProcDied] Process lives  (PID:2632  HANDLE:1524)


waiting for termination of icman ...


NiWait: sleep (1000ms) ...


NiISelect: timeout 1000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:43:05 2014


NiISelect: TIMEOUT occured (1000ms)


[DpProcDied] Process lives  (PID:2632  HANDLE:1524)


waiting for termination of icman ...


NiWait: sleep (1000ms) ...


NiISelect: timeout 1000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:43:06 2014


NiISelect: TIMEOUT occured (1000ms)


[DpProcDied] Process lives  (PID:2632  HANDLE:1524)


waiting for termination of icman ...


NiWait: sleep (1000ms) ...


NiISelect: timeout 1000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:43:07 2014


NiISelect: TIMEOUT occured (1000ms)


[DpProcDied] Process lives  (PID:2632  HANDLE:1524)


waiting for termination of icman ...


NiWait: sleep (1000ms) ...


NiISelect: timeout 1000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:43:08 2014


NiISelect: TIMEOUT occured (1000ms)


[DpProcDied] Process lives  (PID:2632  HANDLE:1524)


waiting for termination of icman ...


NiWait: sleep (1000ms) ...


NiISelect: timeout 1000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:43:09 2014


NiISelect: TIMEOUT occured (1000ms)


[DpProcDied] Process lives  (PID:2632  HANDLE:1524)


waiting for termination of icman ...


NiWait: sleep (1000ms) ...


NiISelect: timeout 1000ms


NiISelect: maximum fd=1545


NiISelect: read-mask is NULL


NiISelect: write-mask is NULL


Thu Feb 20 03:43:10 2014


NiISelect: TIMEOUT occured (1000ms)


[DpProcDied] Process died  (PID:2632  HANDLE:1524)


DpStartStopMsg: send stop message (myname is >rdcprd_RDP_00                           <)


AdGetSelfIdentRecord: >                                                                           <


AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0


AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0


DpConvertRequest: net size = 189 bytes



NiBufSend starting


NiIWrite: hdl 2 sent data (wrt=562,pac=1,MESG_IO)


MsINiWrite: sent 562 bytes


send msg (len 110+452) to name                    -, type 4, key -


DpStartStopMsg: stop msg sent


NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)


NiBufIIn: NIBUF len=274


NiBufIIn: packet complete for hdl 2



NiBufReceive starting


MsINiRead: received 274 bytes


MSG received, len 110+164, flag 1, from MSG_SERVER          , typ 0, key -


DpHalt: received 164 bytes from message server


NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)


NiBufIIn: NIBUF len=274


NiBufIIn: packet complete for hdl 2



NiBufReceive starting


MsINiRead: received 274 bytes


MSG received, len 110+164, flag 1, from MSG_SERVER          , typ 0, key -


DpHalt: received 164 bytes from message server


NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)


NiBufIIn: NIBUF len=274


NiBufIIn: packet complete for hdl 2



NiBufReceive starting


MsINiRead: received 274 bytes


MSG received, len 110+164, flag 1, from MSG_SERVER          , typ 0, key -


DpHalt: received 164 bytes from message server


NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)


NiBufIIn: NIBUF len=274


NiBufIIn: packet complete for hdl 2



NiBufReceive starting


MsINiRead: received 274 bytes


MSG received, len 110+164, flag 1, from MSG_SERVER          , typ 0, key -


DpHalt: received 164 bytes from message server


NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)


NiBufIIn: NIBUF len=274


NiBufIIn: packet complete for hdl 2



NiBufReceive starting


MsINiRead: received 274 bytes


MSG received, len 110+164, flag 1, from MSG_SERVER          , typ 0, key -


DpHalt: received 164 bytes from message server


NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)


NiBufIIn: NIBUF len=274


NiBufIIn: packet complete for hdl 2



NiBufReceive starting


MsINiRead: received 274 bytes


MSG received, len 110+164, flag 1, from MSG_SERVER          , typ 0, key -


DpHalt: received 164 bytes from message server


NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)


NiBufIIn: NIBUF len=274


NiBufIIn: packet complete for hdl 2



NiBufReceive starting


MsINiRead: received 274 bytes


MSG received, len 110+164, flag 1, from MSG_SERVER          , typ 0, key -


DpHalt: received 164 bytes from message server


NiIRead: hdl 2 recv would block (errno=EAGAIN)


NiIRead: read for hdl 2 timed out (0ms)


DpHalt: no more messages from the message server


DpHalt: send keepalive to synchronize with the message server



NiBufSend starting


NiIWrite: hdl 2 sent data (wrt=114,pac=1,MESG_IO)


MsINiWrite: sent 114 bytes


send msg (len 110+4) to name           MSG_SERVER, type 0, key -


MsSndName: MS_NOOP ok


Send 4 bytes to MSG_SERVER


NiIRead: hdl 2 recv would block (errno=EAGAIN)


NiIPeek: peek successful for hdl 2 (r)


NiIRead: hdl 2 received data (rcd=114,pac=1,MESG_IO)


NiBufIIn: NIBUF len=114


NiBufIIn: packet complete for hdl 2



NiBufReceive starting


MsINiRead: received 114 bytes


MSG received, len 110+4, flag 3, from MSG_SERVER          , typ 0, key -


Received 4 bytes from MSG_SERVER                             


Received opcode MS_NOOP from msg_server, reply MSOP_OK


MsOpReceive: ok


MsSendKeepalive : keepalive sent to message server


NiIRead: hdl 2 recv would block (errno=EAGAIN)


Thu Feb 20 03:43:11 2014


NiIPeek: peek for hdl 2 timed out (r; 1000ms)


NiIRead: read for hdl 2 timed out (1000ms)


DpHalt: no more messages from the message server


DpHalt: sync with message server o.k.


detach from message server


***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c   12985]



NiBufSend starting


NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)


MsINiWrite: sent 110 bytes


MsIDetach: send logout to msg_server


MsIDetach: call exit function


DpMsShutdownHook called


NiBufISelUpdate: new MODE -- (r-) for hdl 2 in set0


SiSelNSet: set events of sock 1376 to: ---


NiBufISelRemove: remove hdl 2 from set0


SiSelNRemove: removed sock 1376 (pos=2)


SiSelNRemove: removed sock 1376


NiSelIRemove: removed hdl 2


MBUF state OFF


AdGetSelfIdentRecord: >                                                                           <


AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0


AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0


AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0


blks_in_queue/wp_ca_blk_no/wp_max_no = 1/1000/18


LOCK WP ca_blk 1


make DISP owner of wp_ca_blk 1


DpSemRq: key: 2, units: 1, timeout: -1


DpSemRel: key: 2, units: 1


DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 15)


MBUF component DOWN


NiICloseHandle: shutdown and close hdl 2 / sock 1376


NiBufIClose: clear extension for hdl 2


MsIDetach: detach MS-system


cleanup EM


EsCleanup ....


EmCleanup() -> 0


Es2Cleanup: Cleanup ES2


***LOG Q05=> DpHalt, DPStop ( 5172) [dpxxdisp.c   11183]


Good Bye .....

Show replies
Show replies
Answer

Accepted Solutions (0)

Answers (5)

Answers (5)

deeraj_shetty
Participant
‎02-21-2014 6:55 AM
0 Kudos

Hi Anand,

As suggested, please restart your system (DB + SAP).

Also check if you are able to run R3trans -d? what is the output?

Regards,

Deeraj Shetty

Show replies
Show replies
Former Member
‎02-20-2014 4:57 AM
0 Kudos

Hello Anand,

Does your DB reside on the same O.S? If yes, please check your DB status using the command stated by Nick above and take necessary steps to bring DB online and start the application.

Regards,

Abhinav.

Show replies
Show replies
Sriram2009
Active Contributor
‎02-20-2014 4:40 AM
0 Kudos

Hi Anand

1. Just restart the system and then try again. if it is failed follow the point number 2

2.  You kernel level is low better apply the kernel and than check

Regards

Ram

Show replies
Show replies
Former Member
‎02-20-2014 4:34 AM
0 Kudos

Hi,

Always explain your issue in more detail:

Is there any recent change happened (Kernel update etc.) ?

Check R3trans -dx and paste ERROR lines from trans.log and dev_w0.

Regards,

Nick Loy

Show replies
Show replies
Former Member
‎02-20-2014 4:39 AM
0 Kudos

Hi Nick,

due to Power supply issue on the server, the server got abruptly powered OFF, after we replaced the Power supply unit we got this issue.

Please help,

Anand

Former Member
‎02-20-2014 5:53 AM
0 Kudos

OK....So an abnormal shutdown!

What is the status of database? Try to start database and confirm.

If your database is up then paste the ERROR lines from trans.log and dev_w0

Regards,

Nick Loy

Former Member
‎02-20-2014 4:14 AM
0 Kudos

Hello Anand,

It seems to be a kernel issue.

Please go through below note.

916050 - Emergency shutdown of the dispatcher

Regards,

Abhinav


Show replies
Show replies
former_member186895
Participant
‎02-20-2014 6:15 AM
0 Kudos

Hi,

try to connect database from o.s level using commond "r3trans -d". use user <sid>adm

also paste output of same.

return code should be "0000".

Thanks

Ramesh

Ask a Question