cancel
Showing results for 
Search instead for 
Did you mean: 

SAP MMC DISPATCHER(Disp+Work.exe) STOPPED

william_wang1
Newcomer
0 Kudos

Hi,

After starting the SAP MMC, it shows Dispatcher(Disp+Work.exe) Stopped in process list of SAP MMC.

Please help me to resolve this issue.

Regards,

William

Here is the developer trace file.

===

---------------------------------------------------

trc file: "dev_disp", trc level: 1, release: "701"

---------------------------------------------------

sysno      00

sid        ECC

systemid   562 (PC with Windows NT)

relno      7010

patchlevel 0

patchno    32

intno      20020600

make:      multithreaded, Unicode, 64 bit, optimized

pid        2396

Thu Jul 28 21:56:37 2016

kernel runs with dp version 241000(ext=110000) (@(#) DPLIB-INT-VERSION-241000-UC)

length of sys_adm_ext is 576 bytes

*** SWITCH TRC-HIDE on ***

***LOG Q00=> DpSapEnvInit, DPStart (00 2396) [dpxxdisp.c 1286]

            shared lib "dw_xml.dll" version 32 successfully loaded

            shared lib "dw_xtc.dll" version 32 successfully loaded

            shared lib "dw_stl.dll" version 32 successfully loaded

            shared lib "dw_gui.dll" version 32 successfully loaded

            shared lib "dw_mdm.dll" version 32 successfully loaded

rdisp/softcancel_sequence :  -> 0,5,-1

use internal message server connection to port 3900

Thu Jul 28 21:56:46 2016

*** WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 9 seconds

***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c  5529]

MtxInit: 30000 0 0

DpSysAdmExtInit: ABAP is active

DpSysAdmExtInit: VMC (JAVA VM in WP) is not active

DpIPCInit2: start server >SAPECC6_ECC_00 <

DpShMCreate: sizeof(wp_adm)                     29792  (1752)

DpShMCreate: sizeof(tm_adm)                      5912704          (29416)

DpShMCreate: sizeof(wp_ca_adm)               24064  (80)

DpShMCreate: sizeof(appc_ca_adm) 8000    (80)

DpCommTableSize: max/headSize/ftSize/tableSize=500/16/552064/552080

DpShMCreate: sizeof(comm_adm)                552080            (1088)

DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0

DpShMCreate: sizeof(slock_adm)                  0          (104)

DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0

DpShMCreate: sizeof(file_adm)                     0          (72)

DpShMCreate: sizeof(vmc_adm)                   0          (1864)

DpShMCreate: sizeof(wall_adm)                   (41664/36752/64/192)

DpShMCreate: sizeof(gw_adm)         48

DpShMCreate: SHM_DP_ADM_KEY                     (addr: 000000000BD10050, size: 6614144)

DpShMCreate: allocated sys_adm at 000000000BD10050

DpShMCreate: allocated wp_adm at 000000000BD12270

DpShMCreate: allocated tm_adm_list at 000000000BD196D0

DpShMCreate: allocated tm_adm at 000000000BD19730

DpShMCreate: allocated wp_ca_adm at 000000000C2BCFB0

DpShMCreate: allocated appc_ca_adm at 000000000C2C2DB0

DpShMCreate: allocated comm_adm at 000000000C2C4CF0

DpShMCreate: system runs without slock table

DpShMCreate: system runs without file table

DpShMCreate: allocated vmc_adm_list at 000000000C34B980

DpShMCreate: allocated gw_adm at 000000000C34BA00

DpShMCreate: system runs without vmc_adm

DpShMCreate: allocated ca_info at 000000000C34BA30

DpShMCreate: allocated wall_adm at 000000000C34BA40

MBUF state OFF

DpCommInitTable: init table for 500 entries

rdisp/queue_size_check_value :  -> off

ThTaskStatus: rdisp/reset_online_during_debug 0

EmInit: MmSetImplementation( 2 ).

MM global diagnostic options set: 0

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 4096 kByte.

<ES> Info: em/initial_size_MB( 16243MB) not multiple of em/blocksize_KB( 4096KB)

<ES> Info: em/initial_size_MB rounded up to 16244MB

Using implementation view

<EsNT> Using memory model view.

<EsNT> Memory Reset disabled as NT default

<ES> 4060 blocks reserved for free list.

ES initialized.

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1681]

***LOG Q0K=> DpMsAttach, mscon ( SAPECC6) [dpxxdisp.c 12483]

DpStartStopMsg: send start message (myname is >SAPECC6_ECC_00 <)

DpStartStopMsg: start msg sent

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

CCMS: Initalizing shared memory of size 60000000 for monitoring segment.

CCMS: Checking Downtime Configuration of Monitoring Segment.

CCMS: start to initalize 3.X shared alert area (first segment).

DpMsgAdmin: Set release to 7010, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c   1048]

DpMsgAdmin: Set patchno for this platform to 32

Release check o.K.

***LOG Q0I=> NiIRead: recv (10054: WSAECONNRESET: Connection reset by peer) [nixxi.cpp 4436]

*** ERROR => NiIRead: SiRecv failed for hdl 4 / sock 1168

    (SI_ECONN_BROKEN/10054; I4; ST; 127.0.0.1:65000) [nixxi.cpp    4436]

*** ERROR => DpIcmMsgProcess: IcmRecMsg (rc=-8,-6) [dpxxdisp.c   19007]

Thu Jul 28 21:57:26 2016

my types changed after wp death/restart 0xbf --> 0xbe

my types changed after wp death/restart 0xbe --> 0xbc

my types changed after wp death/restart 0xbc --> 0xb8

my types changed after wp death/restart 0xb8 --> 0xb0

my types changed after wp death/restart 0xb0 --> 0xa0

my types changed after wp death/restart 0xa0 --> 0x80

*** DP_FATAL_ERROR => DpWPCheck: no more work processes

*** DISPATCHER EMERGENCY SHUTDOWN ***

increase tracelevel of WPs

NiWait: sleep (10000ms) ...

NiISelect: timeout 10000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:36 2016

NiISelect: TIMEOUT occured (10000ms)

dump system status

Workprocess Table (long)                               Thu Jul 28 13:57:36 2016

========================

No Ty. Pid      Status  Cause Start Err Sem CPU    Time  Program          Cl User         Action Table

-------------------------------------------------------------------------------------------------------------------------------

0 DIA     3744 Ended no      1   0        0 

1 DIA     5812 Ended no      1   0        0 

2 DIA     6824 Ended no      1   0        0 

3 DIA     2540 Ended no      1   0        0 

4 DIA     2500 Ended no      1   0        0 

5 DIA     1364 Ended no      1   0        0 

6 DIA     5612 Ended no      1   0        0 

7 DIA     6980 Ended no      1   0        0 

8 DIA     5520 Ended no      1   0        0 

9 DIA     4160 Ended no      1   0        0 

10 UPD     6968 Ended no      1   0        0 

11 ENQ     3436 Ended no      1   0        0 

12 BTC     3048 Ended no      1   0        0 

13 BTC     2444 Ended no      1   0        0 

14 BTC     7120 Ended no      1   0        0 

15 SPO     6348 Ended no      1   0        0 

16 UP2     7128 Ended no      1   0        0 

Dispatcher Queue Statistics                            Thu Jul 28 13:57:36 2016

===========================

+------+--------+--------+--------+--------+--------+

|  Typ |    now |   high | max | writes |  reads |

+------+--------+--------+--------+--------+--------+

| NOWP |      1 |      2 | 2000 |     14 |     13 |

+------+--------+--------+--------+--------+--------+

|  DIA |      5 |      5 |   2000 |      5 |      0 |

+------+--------+--------+--------+--------+--------+

|  UPD |      1 |      1 |   2000 |      1 |      0 |

+------+--------+--------+--------+--------+--------+

|  ENQ |      0 |      0 |   2000 |      0 |      0 |

+------+--------+--------+--------+--------+--------+

|  BTC |      0 |      0 |   2000 |      0 |      0 |

+------+--------+--------+--------+--------+--------+

|  SPO |      0 |      0 |   2000 |      0 |      0 |

+------+--------+--------+--------+--------+--------+

|  UP2 |      0 |      0 |   2000 |      0 |      0 |

+------+--------+--------+--------+--------+--------+

max_rq_id                   13

wake_evt_udp_now   0

wake events                total    10, udp     9 ( 90%),  shm     1 ( 10%)

since last update          total    10, udp     9 ( 90%),  shm     1 ( 10%)

Dump of tm_adm structure:                           Thu Jul 28 13:57:36 2016

=========================

Term    uid  man user    term lastop  mod wp  ta   a/i (modes)

Workprocess Comm. Area Blocks                              Thu Jul 28 13:57:36 2016

=============================

Slots: 300, Used: 2, Max: 1

+------+--------------+----------+-------------+

|   id | owner        |   pid | eyecatcher  |

+------+--------------+----------+-------------+

|    0 | DISPATCHER   | -1 | *WPCAAD000* |

|  150 | DISPATCHER   |       -1 | *WPCAAD150* |

NiWait: sleep (5000ms) ...

NiISelect: timeout 5000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:41 2016

NiISelect: TIMEOUT occured (5000ms)

DpHalt: shutdown server >SAPECC6_ECC_00 < (normal)

DpJ2eeDisableRestart

DpModState: buffer in state MBUF_PREPARED

NiBufSend starting

NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIModState: change state to SHUTDOWN

DpModState: change server state from STARTING to SHUTDOWN

Switch off Shared memory profiling

ShmProtect( 57, 3 )

ShmProtect(SHM_PROFILE, SHM_PROT_RW

ShmProtect( 57, 1 )

ShmProtect(SHM_PROFILE, SHM_PROT_RD

DpWakeUpWps: wake up all wp's

Stop work processes

Stop gateway

killing process (956) (SOFT_KILL)

Stop icman

killing process (6720) (SOFT_KILL)

Terminate gui connections

wait for end of work processes

wait for end of gateway

[DpProcDied] Process lives  (PID:956  HANDLE:1056)

waiting for termination of gateway ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:42 2016

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died  (PID:956  HANDLE:1056)

wait for end of icman

[DpProcDied] Process lives  (PID:6720 HANDLE:1064)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:43 2016

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives  (PID:6720 HANDLE:1064)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:44 2016

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives  (PID:6720 HANDLE:1064)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:45 2016

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives  (PID:6720 HANDLE:1064)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:46 2016

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives  (PID:6720 HANDLE:1064)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:47 2016

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives  (PID:6720 HANDLE:1064)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:48 2016

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives  (PID:6720 HANDLE:1064)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:49 2016

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives  (PID:6720 HANDLE:1064)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:50 2016

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives  (PID:6720 HANDLE:1064)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:51 2016

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives  (PID:6720 HANDLE:1064)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:52 2016

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives  (PID:6720 HANDLE:1064)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1169

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Thu Jul 28 21:57:53 2016

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died  (PID:6720  HANDLE:1064)

DpStartStopMsg: send stop message (myname is >SAPECC6_ECC_00 <)

DpStartStopMsg: Write AD_STARTSTOP message with type= 0, name=SAPECC6_ECC_00      , sapsysnr= 0, hostname=SAPECC6 

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0

DpConvertRequest: net size = 189 bytes

NiBufSend starting

NiIWrite: hdl 2 sent data (wrt=562,pac=1,MESG_IO)

MsINiWrite: sent 562 bytes

send msg (len 110+452) to name -, type 4, key -

DpStartStopMsg: stop msg sent

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 recv would block (errno=EAGAIN)

NiIRead: read for hdl 2 timed out (0ms)

DpHalt: no more messages from the message server

DpHalt: send keepalive to synchronize with the message server

NiBufSend starting

NiIWrite: hdl 2 sent data (wrt=114,pac=1,MESG_IO)

MsINiWrite: sent 114 bytes

send msg (len 110+4) to name MSG_SERVER, type 0, key -

MsSndName: MS_NOOP ok

Send 4 bytes to MSG_SERVER

NiIRead: hdl 2 recv would block (errno=EAGAIN)

NiIPeek: peek successful for hdl 2 (r)

NiIRead: hdl 2 received data (rcd=114,pac=1,MESG_IO)

NiBufIIn: NIBUF len=114

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 114 bytes

MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -

Received 4 bytes from MSG_SERVER

Received opcode MS_NOOP from msg_server, reply MSOP_OK

MsOpReceive: ok

MsSendKeepalive : keepalive sent to message server

NiIRead: hdl 2 recv would block (errno=EAGAIN)

Thu Jul 28 21:57:54 2016

NiIPeek: peek for hdl 2 timed out (r; 1000ms)

NiIRead: read for hdl 2 timed out (1000ms)

DpHalt: no more messages from the message server

DpHalt: sync with message server o.k.

detach from message server

***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 12829]

NiBufSend starting

NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIDetach: send logout to msg_server

MsIDetach: call exit function

DpMsShutdownHook called

NiBufISelUpdate: new MODE -- (r-) for hdl 2 in set0

SiSelNSet: set events of sock 1052 to: ---

NiBufISelRemove: remove hdl 2 from set0

SiSelNRemove: removed sock 1052 (pos=2)

SiSelNRemove: removed sock 1052

NiSelIRemove: removed hdl 2

MBUF state OFF

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

blks_in_queue/wp_ca_blk_no/wp_max_no = 2/300/17

LOCK WP ca_blk 1

make DISP owner of wp_ca_blk 1

DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 16)

MBUF component DOWN

NiICloseHandle: shutdown and close hdl 2 / sock 1052

NiBufIClose: clear extension for hdl 2

MsIDetach: detach MS-system

cleanup EM

EsCleanup ....

EmCleanup() -> 0

Es2Cleanup: Cleanup ES2

***LOG Q05=> DpHalt, DPStop ( 2396) [dpxxdisp.c 11045]

Good Bye .....

Accepted Solutions (0)

Answers (2)

Answers (2)

raquel_gomez
Employee
Employee
0 Kudos

Hi William,

On the dispatcher trace file, we can see it has been stopped because there were no more available work processes:

  Thu Jul 28 21:57:26 2016

my types changed after wp death/restart 0xbf --> 0xbe

my types changed after wp death/restart 0xbe --> 0xbc

my types changed after wp death/restart 0xbc --> 0xb8

my types changed after wp death/restart 0xb8 --> 0xb0

my types changed after wp death/restart 0xb0 --> 0xa0

my types changed after wp death/restart 0xa0 --> 0x80

  *** DP_FATAL_ERROR => DpWPCheck: no more work processes

*** DISPATCHER EMERGENCY SHUTDOWN ***

Workprocess Table shows all WP in 'Ended' status. Please attach into this thread dev_w0 and dev_w1, so that we can check why work processes died.

Regards,
Raquel

Former Member
0 Kudos

Hi William,

Could you post "dev_w0" and "dev_icm" logs?

Regards,

Ganesan

isaias_freitas
Advisor
Advisor
0 Kudos

Hello William,

In addition to posting the logs requested by Ganesan, is this the only instance running on the server?

Or are there other instances (for the ECC or other system) running at the same server (sapecc6)?

Regards,

Isaías