cancel
Showing results for 
Search instead for 
Did you mean: 

dispatcher stopped

Former Member
0 Kudos

Hi Guys,

We are experiencing a stop in our SAP system dispatcher.

Below are the dev_disp contents:

      • ERROR => DpProcKill: kill failed [dpntdisp.c 371]

DpIJ2eeShutdown: j2ee state = SHUTDOWN

SiSelNClear: set events of sock 1452 to: ---

SiSelNRemove: removed sock 1452 (pos=2)

SiSelNRemove: removed sock 1452

NiSelIRemove: removed hdl 2

DpDelSocketInfo: del info for socket 2 (type=7)

NiICloseHandle: shutdown and close hdl 2 / sock 1452 - sock -1

DpModState: buffer in state MBUF_PREPARED

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIModState: change state to SHUTDOWN

DpModState: change server state from STARTING to SHUTDOWN

Switch off Shared memory profiling

ShmProtect( 57, 3 )

ShmProtect(SHM_PROFILE, SHM_PROT_RW

ShmProtect( 57, 1 )

ShmProtect(SHM_PROFILE, SHM_PROT_RD

DpWakeUpWps: wake up all wp's

Stop work processes

Stop gateway

killing process (208) (SOFT_KILL)

Stop icman

killing process (4040) (SOFT_KILL)

Terminate gui connections

wait for end of work processes

wait for end of gateway

[DpProcDied] Process lives (PID:208 HANDLE:1460)

waiting for termination of gateway ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:32:01 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died (PID:208 HANDLE:1460)

wait for end of icman

[DpProcDied] Process lives (PID:4040 HANDLE:1468)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:32:02 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4040 HANDLE:1468)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:32:03 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4040 HANDLE:1468)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:32:04 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4040 HANDLE:1468)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:32:05 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4040 HANDLE:1468)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:32:06 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4040 HANDLE:1468)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:32:07 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4040 HANDLE:1468)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:32:08 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4040 HANDLE:1468)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:32:09 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4040 HANDLE:1468)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:32:10 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4040 HANDLE:1468)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:32:11 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died (PID:4040 HANDLE:1468)

[DpProcDied] Process died (PID:1204 HANDLE:1444)

DpStartStopMsg: send stop message (myname is >NGD_NGD_00 <)

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0

DpConvertRequest: net size = 189 bytes

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=562,pac=1,MESG_IO)

MsINiWrite: sent 562 bytes

send msg (len 110+452) to name -, type 4, key -

DpStartStopMsg: stop msg sent

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=114,pac=1,MESG_IO)

NiBufIIn: NIBUF len=114

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 114 bytes

MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -

DpHalt: received 4 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 recv would block (errno=EAGAIN)

NiIRead: read for hdl 3 timed out (0ms)

DpHalt: no more messages from the message server

DpHalt: send keepalive to synchronize with the message server

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=114,pac=1,MESG_IO)

MsINiWrite: sent 114 bytes

send msg (len 110+4) to name MSG_SERVER, type 0, key -

MsSndName: MS_NOOP ok

Send 4 bytes to MSG_SERVER

NiIRead: hdl 3 recv would block (errno=EAGAIN)

NiIPeek: peek successful for hdl 3 (r)

NiIRead: hdl 3 received data (rcd=114,pac=1,MESG_IO)

NiBufIIn: NIBUF len=114

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 114 bytes

MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -

Received 4 bytes from MSG_SERVER

Received opcode MS_NOOP from msg_server, reply MSOP_OK

MsOpReceive: ok

MsSendKeepalive : keepalive sent to message server

NiIRead: hdl 3 recv would block (errno=EAGAIN)

Wed Nov 03 10:32:12 2010

NiIPeek: peek for hdl 3 timed out (r; 1000ms)

NiIRead: read for hdl 3 timed out (1000ms)

DpHalt: no more messages from the message server

DpHalt: sync with message server o.k.

detach from message server

***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 12996]

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIDetach: send logout to msg_server

MsIDetach: call exit function

DpMsShutdownHook called

NiBufISelUpdate: new MODE -- (r-) for hdl 3 in set0

SiSelNSet: set events of sock 1296 to: ---

NiBufISelRemove: remove hdl 3 from set0

SiSelNRemove: removed sock 1296 (pos=3)

SiSelNRemove: removed sock 1296

NiSelIRemove: removed hdl 3

MBUF state OFF

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/35

LOCK WP ca_blk 1

make DISP owner of wp_ca_blk 1

DpSemRq: key: 2, units: 1, timeout: -1

DpSemRel: key: 2, units: 1

DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 15)

MBUF component DOWN

NiICloseHandle: shutdown and close hdl 3 / sock 1296

NiBufIClose: clear extension for hdl 3

MsIDetach: detach MS-system

cleanup EM

EsCleanup ....

EmCleanup() -> 0

Es2Cleanup: Cleanup ES2

***LOG Q05=> DpHalt, DPStop ( 8104) [dpxxdisp.c 11183]

Would appreciate any help.

Thank You.

Accepted Solutions (0)

Answers (1)

Answers (1)

0 Kudos

Hello,

what does appear in dev_disp before the line:

ERROR => DpProcKill: kill failed [dpntdisp.c 371] ??

kind regards,

Mercedes

Former Member
0 Kudos

Hi Mercedes,

Here are the earlier contents:

-


trc file: "dev_disp", trc level: 1, release: "700"

-


sysno 00

sid NGD

systemid 560 (PC with Windows NT)

relno 7000

patchlevel 0

patchno 236

intno 20050900

make: multithreaded, Unicode, optimized

pid 8104

Wed Nov 03 10:30:33 2010

kernel runs with dp version 243000(ext=110000) (@(#) DPLIB-INT-VERSION-243000-UC)

length of sys_adm_ext is 576 bytes

      • SWITCH TRC-HIDE on ***

***LOG Q00=> DpSapEnvInit, DPStart (00 8104) [dpxxdisp.c 1287]

shared lib "dw_xml.dll" version 236 successfully loaded

shared lib "dw_xtc.dll" version 236 successfully loaded

shared lib "dw_stl.dll" version 236 successfully loaded

shared lib "dw_gui.dll" version 236 successfully loaded

shared lib "dw_mdm.dll" version 236 successfully loaded

rdisp/softcancel_sequence : -> 0,5,-1

use internal message server connection to port 3900

Wed Nov 03 10:30:39 2010

      • WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 5 seconds

***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 5521]

MtxInit: 30000 0 0

DpSysAdmExtInit: ABAP is active

DpSysAdmExtInit: VMC (JAVA VM in WP) is not active

DpIPCInit2: start server >NGD_NGD_00 <

DpShMCreate: sizeof(wp_adm) 59640 (1704)

DpShMCreate: sizeof(tm_adm) 4415616 (21968)

DpShMCreate: sizeof(wp_ca_adm) 24064 (80)

DpShMCreate: sizeof(appc_ca_adm) 8000 (80)

DpCommTableSize: max/headSize/ftSize/tableSize=500/8/528056/528064

DpShMCreate: sizeof(comm_adm) 528064 (1048)

DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0

DpShMCreate: sizeof(slock_adm) 0 (96)

DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0

DpShMCreate: sizeof(file_adm) 0 (72)

DpShMCreate: sizeof(vmc_adm) 0 (1544)

DpShMCreate: sizeof(wall_adm) (38456/34360/64/184)

DpShMCreate: sizeof(gw_adm) 48

DpShMCreate: SHM_DP_ADM_KEY (addr: 07B80040, size: 5116936)

DpShMCreate: allocated sys_adm at 07B80040

DpShMCreate: allocated wp_adm at 07B82178

DpShMCreate: allocated tm_adm_list at 07B90A70

DpShMCreate: allocated tm_adm at 07B90AA0

DpShMCreate: allocated wp_ca_adm at 07FC6B20

DpShMCreate: allocated appc_ca_adm at 07FCC920

DpShMCreate: allocated comm_adm at 07FCE860

DpShMCreate: system runs without slock table

DpShMCreate: system runs without file table

DpShMCreate: allocated vmc_adm_list at 0804F720

DpShMCreate: allocated gw_adm at 0804F760

DpShMCreate: system runs without vmc_adm

DpShMCreate: allocated ca_info at 0804F790

DpShMCreate: allocated wall_adm at 0804F798

MBUF state OFF

DpCommInitTable: init table for 500 entries

rdisp/queue_size_check_value : -> off

ThTaskStatus: rdisp/reset_online_during_debug 0

EmInit: MmSetImplementation( 2 ).

MM global diagnostic options set: 0

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 2048 kByte.

Using implementation view

<EsNT> Using memory model view.

<EsNT> Memory Reset disabled as NT default

<ES> 511 blocks reserved for free list.

ES initialized.

mm.dump: set maximum dump mem to 96 MB

Wed Nov 03 10:30:41 2010

J2EE server info

start = TRUE

state = STARTED

pid = 1204

argv[0] = D:\usr\sap\NGD\DVEBMGS00\exe\jcontrol.EXE

argv[1] = D:\usr\sap\NGD\DVEBMGS00\exe\jcontrol.EXE

argv[2] = pf=D:\usr\sap\NGD\SYS\profile\NGD_DVEBMGS00_NGD

argv[3] = -DSAPSTART=1

argv[4] = -DCONNECT_PORT=65000

argv[5] = -DSAPSYSTEM=00

argv[6] = -DSAPSYSTEMNAME=NGD

argv[7] = -DSAPMYNAME=NGD_NGD_00

argv[8] = -DSAPPROFILE=D:\usr\sap\NGD\SYS\profile\NGD_DVEBMGS00_NGD

argv[9] = -DFRFC_FALLBACK=ON

argv[10] = -DFRFC_FALLBACK_HOST=localhost

start_lazy = 0

start_control = SAP J2EE startup framework

DpJ2eeStart: j2ee state = STARTED

Wed Nov 03 10:31:04 2010

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1694]

Wed Nov 03 10:31:05 2010

***LOG Q0K=> DpMsAttach, mscon ( NGD) [dpxxdisp.c 12650]

DpStartStopMsg: send start message (myname is >NGD_NGD_00 <)

DpStartStopMsg: start msg sent

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

Wed Nov 03 10:31:06 2010

CCMS: start to initalize 3.X shared alert area (first segment).

DpJ2eeLogin: j2ee state = CONNECTED

DpMsgAdmin: Set release to 7000, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1050]

DpMsgAdmin: Set patchno for this platform to 236

Release check o.K.

Wed Nov 03 10:31:25 2010

***LOG Q0I=> NiIRead: recv (10054: WSAECONNRESET: Connection reset by peer) [nixxi.cpp 4424]

      • ERROR => NiIRead: SiRecv failed for hdl 4 / sock 1272

(SI_ECONN_BROKEN/10054; I4; ST; 127.0.0.1:21181) [nixxi.cpp 4424]

      • ERROR => DpJ2eeMsgProcess: NiRead failed (NIECONN_BROKEN) [dpxxj2ee.c 1212]

DpJ2eeMsgProcess: j2ee state = CONNECTED (NIECONN_BROKEN)

Wed Nov 03 10:31:45 2010

my types changed after wp death/restart 0xbf --> 0xbe

my types changed after wp death/restart 0xbe --> 0xbc

my types changed after wp death/restart 0xbc --> 0xb8

my types changed after wp death/restart 0xb8 --> 0xb0

my types changed after wp death/restart 0xb0 --> 0xa0

my types changed after wp death/restart 0xa0 --> 0x80

      • DP_FATAL_ERROR => DpWPCheck: no more work processes

      • DISPATCHER EMERGENCY SHUTDOWN ***

increase tracelevel of WPs

NiWait: sleep (10000ms) ...

NiISelect: timeout 10000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:31:55 2010

NiISelect: TIMEOUT occured (10000ms)

dump system status

Workprocess Table (long) Wed Nov 03 09:31:55 2010

========================

No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table

-


0 DIA 2248 Ended no 1 0 0

1 DIA 4180 Ended no 1 0 0

2 DIA 7712 Ended no 1 0 0

3 DIA 2664 Ended no 1 0 0

4 DIA 7332 Ended no 1 0 0

5 DIA 2584 Ended no 1 0 0

6 DIA 1908 Ended no 1 0 0

7 DIA 4508 Ended no 1 0 0

8 DIA 7460 Ended no 1 0 0

9 DIA 7900 Ended no 1 0 0

10 DIA 7864 Ended no 1 0 0

11 DIA 2884 Ended no 1 0 0

12 DIA 7792 Ended no 1 0 0

13 DIA 5184 Ended no 1 0 0

14 DIA 8180 Ended no 1 0 0

15 DIA 7644 Ended no 1 0 0

16 UPD 6644 Ended no 1 0 0

17 UPD 6416 Ended no 1 0 0

18 UPD 392 Ended no 1 0 0

19 UPD 6528 Ended no 1 0 0

20 UPD 764 Ended no 1 0 0

21 UPD 940 Ended no 1 0 0

22 UPD 2136 Ended no 1 0 0

23 UPD 5932 Ended no 1 0 0

24 UPD 6432 Ended no 1 0 0

25 UPD 4752 Ended no 1 0 0

26 UPD 5944 Ended no 1 0 0

27 UPD 6564 Ended no 1 0 0

28 ENQ 5520 Ended no 1 0 0

29 BTC 7004 Ended no 1 0 0

30 BTC 1752 Ended no 1 0 0

31 BTC 5016 Ended no 1 0 0

32 SPO 7080 Ended no 1 0 0

33 UP2 5264 Ended no 1 0 0

34 UP2 880 Ended no 1 0 0

Dispatcher Queue Statistics Wed Nov 03 09:31:55 2010

===========================

--------


+
+

+

+
--


+

Typ

now

high

max

writes

reads

--------


+
+

+

+
--


+

NOWP

0

4

2000

5

5

--------


+
+

+

+
--


+

DIA

5

5

2000

5

0

--------


+
+

+

+
--


+

UPD

0

0

2000

0

0

--------


+
+

+

+
--


+

ENQ

0

0

2000

0

0

--------


+
+

+

+
--


+

BTC

0

0

2000

0

0

--------


+
+

+

+
--


+

SPO

0

0

2000

0

0

--------


+
+

+

+
--


+

UP2

0

0

2000

0

0

--------


+
+

+

+
--


+

max_rq_id 12

wake_evt_udp_now 0

wake events total 8, udp 2 ( 25%), shm 6 ( 75%)

since last update total 8, udp 2 ( 25%), shm 6 ( 75%)

Dump of tm_adm structure: Wed Nov 03 09:31:55 2010

=========================

Term uid man user term lastop mod wp ta a/i (modes)

Workprocess Comm. Area Blocks Wed Nov 03 09:31:55 2010

=============================

Slots: 300, Used: 1, Max: 0

--------


+
+
--


+

id

owner

pid

eyecatcher

--------


+
+
--


+

0

DISPATCHER

-1

WPCAAD000

NiWait: sleep (5000ms) ...

NiISelect: timeout 5000ms

NiISelect: maximum fd=1489

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Wed Nov 03 10:32:00 2010

NiISelect: TIMEOUT occured (5000ms)

DpHalt: shutdown server >NGD_NGD_00 < (normal)

DpJ2eeDisableRestart

MsIDelService: delete service J2EE for myself

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=161,pac=1,MESG_IO)

MsINiWrite: sent 161 bytes

send msg (len 110+51) to name MSG_SERVER, type 0, key -

MsSndName: MS_DEL_PROPERTY ok

Send 51 bytes to MSG_SERVER

MS_DEL_PROPERTY : asynchronous call

send MsDelService(J2EE) to msgserver

DpIJ2eeShutdown: send SIGINT to SAP J2EE startup framework (pid=1204)

killing process (1204) (SOFT_KILL)

Regards.

Former Member
0 Kudos

Some problem with your ABAP stack, can you please check your dev_disp and dev_ms trace files.

Have you done any system parameter changes?

0 Kudos

Hello,

please have a look as well in the dev_w0, dev_w1 files...

kind regards,

Mercedes