Dispatcher dies after afew seconds

[Former Member]

The dispatcher on my CI dies after afew seconds. In SAPMMC the SID becomes green then the message server closes the connection to the dispatcher forcing all WP's to die.

The error on the message server:

ERROR => MsSClientHandle: no server provides service ENQ

I have here the seveloper traces for the message server and the dispatcher just in case.

-

---

trc file: "dev_ms", trc level: 1, release: "620"

-

---

[Thr 1736] Tue Mar 28 14:09:10 2006

[Thr 1736] MsSSetTrcLog: trc logging not active

[Thr 1736] relno 6200

[Thr 1736] patchlevel 0

[Thr 1736] patchno 1529

[Thr 1736] intno 20020600

[Thr 1736] pid 524

[Thr 1736] ***LOG Q01=> MsSInit, MSStart (Msg Server 1 524) [msxxserv.c 1533]

[Thr 1736] MsHttpPortInsert: set HTTP state to LISTEN

[Thr 1736] *** I listen to port sapmsRD1 (3610) ***

[Thr 1736] *** HTTP port 8110 state LISTEN ***

[Thr 1736] CUSTOMER KEY: >S1988002762<

[Thr 1736] Tue Mar 28 14:10:41 2006

[Thr 1736] *** ERROR => MsSClientHandle: no server provides service ENQ (4), requested from <HOST_SID_nr [msxxserv.c 4078]

[Thr 1736] ***LOG Q0I=> NiPRead: recv (10054: WSAECONNRESET: Connection reset by peer) [ninti.c 1094]

[Thr 1736] *** ERROR => MsSRead: NiBufReceive (rc=NIECONN_BROKEN) [msxxserv.c 8618]

[Thr 1736] *** ERROR => MsSClientHandle: MsSRead C1 (belrd110_RD1_10), MSEINTERN [msxxserv.c 3675]

====================================================

Dispatcher:

-

---

trc file: "dev_disp", trc level: 1, release: "620"

-

---

Tue Mar 28 14:09:11 2006

kernel runs with dp version 13(ext=2) (@(#) DPLIB-INT-VERSION-13)

length of sys_adm_ext is 304 bytes

systemid 560 (PC with Windows NT)

relno 6200

patchlevel 0

patchno 1640

intno 20020600

make: multithreaded, ASCII

pid 3512

***LOG Q00=> DpSapEnvInit, DPStart (10 3512) [dpxxdisp.c 1022]

shared lib "dw_xml.dll" version 1640 successfully loaded

shared lib "dw_xtc.dll" version 1640 successfully loaded

shared lib "dw_stl.dll" version 1640 successfully loaded

Tue Mar 28 14:09:23 2006

• WARNING => DpNetCheck: NiHostToAddr(www.doesnotexist0201.qqq.nxst) took 12 seconds

Tue Mar 28 14:09:41 2006

• WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 18 seconds

***LOG GZZ=> 2 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 3452]

MtxInit: -2 0 0

DpShMCreate: sizeof(wp_adm) 9880 (760)

DpShMCreate: sizeof(tm_adm) 1835536 (9132)

DpShMCreate: sizeof(wp_ca_adm) 18000 (60)

DpShMCreate: sizeof(appc_ca_adm) 6000 (60)

DpShMCreate: sizeof(comm_adm) 192000 (384)

DpShMCreate: sizeof(wall_adm) (22440/34344/56/100)

DpShMCreate: SHM_DP_ADM_KEY (addr: 03A30040, size: 2119920)

DpShMCreate: allocated sys_adm at 03A30040

DpShMCreate: allocated wp_adm at 03A30678

DpShMCreate: allocated tm_adm_list at 03A32D10

DpShMCreate: allocated tm_adm at 03A32D38

DpShMCreate: allocated wp_ca_adm at 03BF2F48

DpShMCreate: allocated appc_ca_adm at 03BF7598

DpShMCreate: allocated comm_adm_list at 03BF8D08

DpShMCreate: allocated comm_adm at 03BF8D20

DpShMCreate: allocated ca_info at 03C27B20

DpShMCreate: allocated wall_adm at 03C27B28

MBUF state OFF

EmInit: MmSetImplementation( 2 ).

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 1024 kByte.

Using implementation std

<EsNT> Memory Reset enabled as NT default

<EsNT> EsIUnamFileMapInit: Initialize the memory 2048 MB

<ES> 2047 blocks reserved for free list.

ES initialized.

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG Q0K=> DpMsAttach, mscon ( belrd110) [dpxxdisp.c 9447]

CCMS: Initalizing shared memory of size 20000000 for monitoring segment.

CCMS: start to initalize 3.X shared alert area (first segment).

DpMsgAdmin: Set release to 6200, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 941]

DpMsgAdmin: Set patchno for this platform to 1640

Release check o.K.

Tue Mar 28 14:10:21 2006

• ERROR => W0 (pid 2812) died [dpxxdisp.c 11848]

• ERROR => W1 (pid 3120) died [dpxxdisp.c 11848]

• ERROR => W2 (pid 1532) died [dpxxdisp.c 11848]

• ERROR => W3 (pid 2864) died [dpxxdisp.c 11848]

• ERROR => W4 (pid 2828) died [dpxxdisp.c 11848]

• ERROR => W5 (pid 1312) died [dpxxdisp.c 11848]

my types changed after wp death/restart 0xbf --> 0xbe

• ERROR => W6 (pid 1300) died [dpxxdisp.c 11848]

• ERROR => W7 (pid 3688) died [dpxxdisp.c 11848]

my types changed after wp death/restart 0xbe --> 0xbc

• ERROR => W8 (pid 4064) died [dpxxdisp.c 11848]

my types changed after wp death/restart 0xbc --> 0xb8

• ERROR => W9 (pid 3464) died [dpxxdisp.c 11848]

• ERROR => W10 (pid 1516) died [dpxxdisp.c 11848]

my types changed after wp death/restart 0xb8 --> 0xb0

• ERROR => W11 (pid 2888) died [dpxxdisp.c 11848]

my types changed after wp death/restart 0xb0 --> 0xa0

• ERROR => W12 (pid 2092) died [dpxxdisp.c 11848]

my types changed after wp death/restart 0xa0 --> 0x80

• DP_FATAL_ERROR => DpEnvCheck: no more work processes

• DISPATCHER EMERGENCY SHUTDOWN ***

increase tracelevel of WPs

killing W0-2812 (SIGUSR2)

• ERROR => DpWpKill(2812, SIGUSR2) failed [dpxxtool.c 2645]

killing W1-3120 (SIGUSR2)

• ERROR => DpWpKill(3120, SIGUSR2) failed [dpxxtool.c 2645]

killing W2-1532 (SIGUSR2)

• ERROR => DpWpKill(1532, SIGUSR2) failed [dpxxtool.c 2645]

killing W3-2864 (SIGUSR2)

• ERROR => DpWpKill(2864, SIGUSR2) failed [dpxxtool.c 2645]

killing W4-2828 (SIGUSR2)

• ERROR => DpWpKill(2828, SIGUSR2) failed [dpxxtool.c 2645]

killing W5-1312 (SIGUSR2)

• ERROR => DpWpKill(1312, SIGUSR2) failed [dpxxtool.c 2645]

killing W6-1300 (SIGUSR2)

• ERROR => DpWpKill(1300, SIGUSR2) failed [dpxxtool.c 2645]

killing W7-3688 (SIGUSR2)

• ERROR => DpWpKill(3688, SIGUSR2) failed [dpxxtool.c 2645]

killing W8-4064 (SIGUSR2)

• ERROR => DpWpKill(4064, SIGUSR2) failed [dpxxtool.c 2645]

killing W9-3464 (SIGUSR2)

• ERROR => DpWpKill(3464, SIGUSR2) failed [dpxxtool.c 2645]

killing W10-1516 (SIGUSR2)

• ERROR => DpWpKill(1516, SIGUSR2) failed [dpxxtool.c 2645]

killing W11-2888 (SIGUSR2)

• ERROR => DpWpKill(2888, SIGUSR2) failed [dpxxtool.c 2645]

killing W12-2092 (SIGUSR2)

• ERROR => DpWpKill(2092, SIGUSR2) failed [dpxxtool.c 2645]

NiWait: sleep (10000 msecs) ...

NiISelect: timeout 10000 ms

Tue Mar 28 14:10:31 2006

NiISelect: TIMEOUT occured(10000 msecs)

dump system status

Workprocess Table (long) Tue Mar 28 18:10:31 2006

========================

No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table

-

---

0 DIA 2812 Ended no 1 0 0

1 DIA 3120 Ended no 1 0 0

2 DIA 1532 Ended no 1 0 0

3 DIA 2864 Ended no 1 0 0

4 DIA 2828 Ended no 1 0 0

5 DIA 1312 Ended no 1 0 0

6 UPD 1300 Ended no 1 0 0

7 UPD 3688 Ended no 1 0 0

8 ENQ 4064 Ended no 1 0 0

9 BTC 3464 Ended no 1 0 0

10 BTC 1516 Ended no 1 0 0

11 SPO 2888 Ended no 1 0 0

12 UP2 2092 Ended no 1 0 0

Dispatcher Queue Statistics Tue Mar 28 18:10:31 2006

===========================

--------

---

+

---

+

---

+

---

+--

---

+

Typ

now

high

max

writes

reads

--------

---

+

---

+

---

+

---

+--

---

+

NOWP

0

1

2000

4

4

--------

---

+

---

+

---

+

---

+--

---

+

DIA

3

3

2000

3

0

--------

---

+

---

+

---

+

---

+--

---

+

UPD

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+--

---

+

ENQ

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+--

---

+

BTC

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+--

---

+

SPO

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+--

---

+

UP2

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+--

---

+

max_rq_id 10

wake_evt_udp_now 0

wake events total 6, udp 5 ( 83%), shm 1 ( 16%)

since last update total 6, udp 5 ( 83%), shm 1 ( 16%)

Dump of tm_adm structure: Tue Mar 28 18:10:31 2006

=========================

Term uid man user term lastop mod wp ta a/i (modes)

Workprocess Comm. Area Blocks Tue Mar 28 18:10:31 2006

=============================

Slots: 300, Used: 1, Max: 0

--------

---

+

---

+--

---

+

id

owner

pid

eyecatcher

--------

---

+

---

+--

---

+

0

DISPATCHER

-1

WPCAAD000

NiWait: sleep (5000 msecs) ...

NiISelect: timeout 5000 ms

Tue Mar 28 14:10:36 2006

NiISelect: TIMEOUT occured(5000 msecs)

DpModState: buffer in state MBUF_PREPARED

NiBufSend starting

NiIWrite: write 110, 1 packs, MESG_IO, handle 3, data complete

MsINiWrite: sent 110 bytes

MsIModState: change state to SHUTDOWN

DpModState: change server state from STARTING to SHUTDOWN

Switch off Shared memory profiling

ShmProtect( 57, 3 )

ShmProtect(SHM_PROFILE, SHM_PROT_RW

ShmProtect( 57, 1 )

ShmProtect(SHM_PROFILE, SHM_PROT_RD

DpWakeUpWps: wake up all wp's

killing process (1096) (SOFT_KILL)

killing process (3368) (SOFT_KILL)

[DpProcDied] Process lives (PID:1096 HANDLE:1556)

wait for end of gateway

NiWait: sleep (1000 msecs) ...

NiISelect: timeout 1000 ms

Tue Mar 28 14:10:37 2006

NiISelect: TIMEOUT occured(1000 msecs)

[DpProcDied] Process died (PID:1096 HANDLE:1556)

[DpProcDied] Process lives (PID:3368 HANDLE:1548)

wait for end of icman

NiWait: sleep (1000 msecs) ...

NiISelect: timeout 1000 ms

Tue Mar 28 14:10:38 2006

NiISelect: TIMEOUT occured(1000 msecs)

[DpProcDied] Process lives (PID:3368 HANDLE:1548)

wait for end of icman

NiWait: sleep (1000 msecs) ...

NiISelect: timeout 1000 ms

Tue Mar 28 14:10:39 2006

NiISelect: TIMEOUT occured(1000 msecs)

[DpProcDied] Process lives (PID:3368 HANDLE:1548)

wait for end of icman

NiWait: sleep (1000 msecs) ...

NiISelect: timeout 1000 ms

Tue Mar 28 14:10:40 2006

NiISelect: TIMEOUT occured(1000 msecs)

[DpProcDied] Process lives (PID:3368 HANDLE:1548)

wait for end of icman

NiWait: sleep (1000 msecs) ...

NiISelect: timeout 1000 ms

Tue Mar 28 14:10:41 2006

NiISelect: TIMEOUT occured(1000 msecs)

[DpProcDied] Process died (PID:3368 HANDLE:1548)

DpHalt: cancel all lcom connections

MPI CancelAll 2 -> 0

MPI DeleteAll 2 -> 0

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60, ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 4, ser 0, ex 0, errno 0

DpConvertRequest: net size = 163 bytes

NiBufSend starting

NiIWrite: write 562, 1 packs, MESG_IO, handle 3, data complete

MsINiWrite: sent 562 bytes

send msg (len 110+452) to name -, type 4, key -

***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 9673]

NiBufSend starting

NiIWrite: write 110, 1 packs, MESG_IO, handle 3, data complete

MsINiWrite: sent 110 bytes

MsIDetach: send logout to msg_server

MsIDetach: call exit function

DpMsShutdownHook called

NiSelClear: removed hdl 3 from selectset

MBUF state OFF

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60, ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40, ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40, ser 0, ex 0, errno 0

blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/13

LOCK WP ca_blk 1

make DISP owner of wp_ca_blk 1

DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 12)

MBUF component DOWN

NiBufClose: clear extensions for handle 3

NiBufSetStat: bufstat of hdl 3 changed from OK to OFF

NiICloseHandle: shutdown and close nihandle-socket 3-1560

MsIDetach: detach MS-system

EsCleanup ....

***LOG Q05=> DpHalt, DPStop ( 3512) [dpxxdisp.c 8207]

Good Bye .....

[Former Member]

I have got this same problem, I have restarted services but problem is still occured. Can you give me precise tip?

[Former Member]

I added the sapservice and sidadm accounts in the login properties for the respective databases for some reason those users did not have access rights to the DB.

Strange! windows thing I guess!

Anyhow. I solved it. thanks for your help.

Damien

[Former Member]

hi Damien,

Welcome to SDN!

WP's die because your Database is not up fully.

Start all the DB Services(ControlPanel --> Administration --> Services) and restart the server. That should solve your problem.

Regards

Arunkumar