cancel
Showing results for 
Search instead for 
Did you mean: 

Disp+Work down(urgent)

Former Member
0 Kudos

Hi All,

my Dispatcher is down, can any body help on this.

Developer Trace:

-


trc file: "dev_disp", trc level: 1, release: "700"

-


sysno 00

sid CRQ

systemid 562 (PC with Windows NT)

relno 7000

patchlevel 0

patchno 145

intno 20050900

make: multithreaded, Unicode, 64 bit, optimized

pid 4372

Tue May 20 10:51:54 2008

kernel runs with dp version 232000(ext=109000) (@(#) DPLIB-INT-VERSION-232000-UC)

length of sys_adm_ext is 576 bytes

      • SWITCH TRC-HIDE on ***

***LOG Q00=> DpSapEnvInit, DPStart (00 4372) [dpxxdisp.c 1243]

shared lib "dw_xml.dll" version 146 successfully loaded

shared lib "dw_xtc.dll" version 146 successfully loaded

shared lib "dw_stl.dll" version 146 successfully loaded

shared lib "dw_gui.dll" version 146 successfully loaded

shared lib "dw_mdm.dll" version 146 successfully loaded

rdisp/softcancel_sequence : -> 0,5,-1

use internal message server connection to port 3900

Tue May 20 10:51:59 2008

      • WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 4 seconds

***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 5371]

MtxInit: 30000 0 0

DpSysAdmExtInit: ABAP is active

DpSysAdmExtInit: VMC (JAVA VM in WP) is not active

DpIPCInit2: start server >sap-crq_CRQ_00 <

DpShMCreate: sizeof(wp_adm) 25168 (1480)

DpShMCreate: sizeof(tm_adm) 5652128 (28120)

DpShMCreate: sizeof(wp_ca_adm) 24000 (80)

DpShMCreate: sizeof(appc_ca_adm) 8000 (80)

DpCommTableSize: max/headSize/ftSize/tableSize=500/16/552064/552080

DpShMCreate: sizeof(comm_adm) 552080 (1088)

DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0

DpShMCreate: sizeof(slock_adm) 0 (104)

DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0

DpShMCreate: sizeof(file_adm) 0 (72)

DpShMCreate: sizeof(vmc_adm) 0 (1864)

DpShMCreate: sizeof(wall_adm) (41664/36752/64/192)

DpShMCreate: sizeof(gw_adm) 48

DpShMCreate: SHM_DP_ADM_KEY (addr: 000000000E9E0050, size: 6348592)

DpShMCreate: allocated sys_adm at 000000000E9E0050

DpShMCreate: allocated wp_adm at 000000000E9E2150

DpShMCreate: allocated tm_adm_list at 000000000E9E83A0

DpShMCreate: allocated tm_adm at 000000000E9E8400

DpShMCreate: allocated wp_ca_adm at 000000000EF4C2A0

DpShMCreate: allocated appc_ca_adm at 000000000EF52060

DpShMCreate: allocated comm_adm at 000000000EF53FA0

DpShMCreate: system runs without slock table

DpShMCreate: system runs without file table

DpShMCreate: allocated vmc_adm_list at 000000000EFDAC30

DpShMCreate: allocated gw_adm at 000000000EFDACB0

DpShMCreate: system runs without vmc_adm

DpShMCreate: allocated ca_info at 000000000EFDACE0

DpShMCreate: allocated wall_adm at 000000000EFDACF0

MBUF state OFF

DpCommInitTable: init table for 500 entries

ThTaskStatus: rdisp/reset_online_during_debug 0

Tue May 20 10:52:00 2008

EmInit: MmSetImplementation( 2 ).

MM global diagnostic options set: 0

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 4096 kByte.

Using implementation view

<EsNT> Using memory model view.

<EsNT> Memory Reset disabled as NT default

<ES> 127 blocks reserved for free list.

ES initialized.

J2EE server info

start = TRUE

state = STARTED

pid = 4592

argv[0] = E:\usr\sap\CRQ\DVEBMGS00\exe\jcontrol.EXE

argv[1] = E:\usr\sap\CRQ\DVEBMGS00\exe\jcontrol.EXE

argv[2] = pf=E:\usr\sap\CRQ\SYS\profile\CRQ_DVEBMGS00_sap-crq

argv[3] = -DSAPSTART=1

argv[4] = -DCONNECT_PORT=65000

argv[5] = -DSAPSYSTEM=00

argv[6] = -DSAPSYSTEMNAME=CRQ

argv[7] = -DSAPMYNAME=sap-crq_CRQ_00

argv[8] = -DSAPPROFILE=E:\usr\sap\CRQ\SYS\profile\CRQ_DVEBMGS00_sap-crq

argv[9] = -DFRFC_FALLBACK=ON

argv[10] = -DFRFC_FALLBACK_HOST=localhost

start_lazy = 0

start_control = SAP J2EE startup framework

DpJ2eeStart: j2ee state = STARTED

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1633]

***LOG Q0K=> DpMsAttach, mscon ( sap-crq) [dpxxdisp.c 11822]

DpStartStopMsg: send start message (myname is >sap-crq_CRQ_00 <)

DpStartStopMsg: start msg sent

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

CCMS: start to initalize 3.X shared alert area (first segment).

DpJ2eeLogin: j2ee state = CONNECTED

DpMsgAdmin: Set release to 7000, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1050]

DpMsgAdmin: Set patchno for this platform to 145

Release check o.K.

Tue May 20 10:52:05 2008

***LOG Q0I=> NiIRead: recv (10054: WSAECONNRESET: Connection reset by peer) [nixxi.cpp 4424]

      • ERROR => NiIRead: SiRecv failed for hdl 4 / sock 292

(SI_ECONN_BROKEN/10054; I4; ST; 127.0.0.1:1186) [nixxi.cpp 4424]

DpJ2eeMsgProcess: j2ee state = CONNECTED (NIECONN_BROKEN)

DpIJ2eeShutdown: send SIGINT to SAP J2EE startup framework (pid=4592)

      • ERROR => DpProcKill: kill failed [dpntdisp.c 371]

DpIJ2eeShutdown: j2ee state = SHUTDOWN

Tue May 20 10:52:40 2008

      • ERROR => DpHdlDeadWp: W0 (pid 4600) died [dpxxdisp.c 14532]

      • ERROR => DpHdlDeadWp: W1 (pid 4608) died [dpxxdisp.c 14532]

      • ERROR => DpHdlDeadWp: W2 (pid 4616) died [dpxxdisp.c 14532]

      • ERROR => DpHdlDeadWp: W3 (pid 4624) died [dpxxdisp.c 14532]

      • ERROR => DpHdlDeadWp: W4 (pid 4632) died [dpxxdisp.c 14532]

      • ERROR => DpHdlDeadWp: W5 (pid 4640) died [dpxxdisp.c 14532]

      • ERROR => DpHdlDeadWp: W6 (pid 4648) died [dpxxdisp.c 14532]

      • ERROR => DpHdlDeadWp: W7 (pid 4660) died [dpxxdisp.c 14532]

      • ERROR => DpHdlDeadWp: W8 (pid 4668) died [dpxxdisp.c 14532]

      • ERROR => DpHdlDeadWp: W9 (pid 4684) died [dpxxdisp.c 14532]

my types changed after wp death/restart 0xbf --> 0xbe

      • ERROR => DpHdlDeadWp: W10 (pid 4692) died [dpxxdisp.c 14532]

my types changed after wp death/restart 0xbe --> 0xbc

      • ERROR => DpHdlDeadWp: W11 (pid 4704) died [dpxxdisp.c 14532]

my types changed after wp death/restart 0xbc --> 0xb8

      • ERROR => DpHdlDeadWp: W12 (pid 4712) died [dpxxdisp.c 14532]

      • ERROR => DpHdlDeadWp: W13 (pid 4724) died [dpxxdisp.c 14532]

      • ERROR => DpHdlDeadWp: W14 (pid 4732) died [dpxxdisp.c 14532]

my types changed after wp death/restart 0xb8 --> 0xb0

      • ERROR => DpHdlDeadWp: W15 (pid 4740) died [dpxxdisp.c 14532]

my types changed after wp death/restart 0xb0 --> 0xa0

      • ERROR => DpHdlDeadWp: W16 (pid 4768) died [dpxxdisp.c 14532]

my types changed after wp death/restart 0xa0 --> 0x80

      • DP_FATAL_ERROR => DpWPCheck: no more work processes

      • DISPATCHER EMERGENCY SHUTDOWN ***

increase tracelevel of WPs

NiWait: sleep (10000ms) ...

NiISelect: timeout 10000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:52:51 2008

NiISelect: TIMEOUT occured (10000ms)

dump system status

Workprocess Table (long) Tue May 20 17:52:51 2008

========================

No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table

-


0 DIA 4600 Ended no 1 0 0

1 DIA 4608 Ended no 1 0 0

2 DIA 4616 Ended no 1 0 0

3 DIA 4624 Ended no 1 0 0

4 DIA 4632 Ended no 1 0 0

5 DIA 4640 Ended no 1 0 0

6 DIA 4648 Ended no 1 0 0

7 DIA 4660 Ended no 1 0 0

8 DIA 4668 Ended no 1 0 0

9 DIA 4684 Ended no 1 0 0

10 UPD 4692 Ended no 1 0 0

11 ENQ 4704 Ended no 1 0 0

12 BTC 4712 Ended no 1 0 0

13 BTC 4724 Ended no 1 0 0

14 BTC 4732 Ended no 1 0 0

15 SPO 4740 Ended no 1 0 0

16 UP2 4768 Ended no 1 0 0

Dispatcher Queue Statistics Tue May 20 17:52:51 2008

===========================

--------


+
+

+

+
--


+

Typ

now

high

max

writes

reads

--------


+
+

+

+
--


+

NOWP

0

2

2000

6

6

--------


+
+

+

+
--


+

DIA

5

5

2000

5

0

--------


+
+

+

+
--


+

UPD

0

0

2000

0

0

--------


+
+

+

+
--


+

ENQ

0

0

2000

0

0

--------


+
+

+

+
--


+

BTC

0

0

2000

0

0

--------


+
+

+

+
--


+

SPO

0

0

2000

0

0

--------


+
+

+

+
--


+

UP2

0

0

2000

0

0

--------


+
+

+

+
--


+

max_rq_id 12

wake_evt_udp_now 0

wake events total 8, udp 5 ( 62%), shm 3 ( 37%)

since last update total 8, udp 5 ( 62%), shm 3 ( 37%)

Dump of tm_adm structure: Tue May 20 17:52:51 2008

=========================

Term uid man user term lastop mod wp ta a/i (modes)

Workprocess Comm. Area Blocks Tue May 20 17:52:51 2008

=============================

Slots: 300, Used: 1, Max: 0

--------


+
+
--


+

id

owner

pid

eyecatcher

--------


+
+
--


+

0

DISPATCHER

-1

WPCAAD000

NiWait: sleep (5000ms) ...

NiISelect: timeout 5000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:52:56 2008

NiISelect: TIMEOUT occured (5000ms)

DpHalt: shutdown server >sap-crq_CRQ_00 < (normal)

DpJ2eeDisableRestart

DpModState: buffer in state MBUF_PREPARED

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIModState: change state to SHUTDOWN

DpModState: change server state from STARTING to SHUTDOWN

Switch off Shared memory profiling

ShmProtect( 57, 3 )

ShmProtect(SHM_PROFILE, SHM_PROT_RW

ShmProtect( 57, 1 )

ShmProtect(SHM_PROFILE, SHM_PROT_RD

DpWakeUpWps: wake up all wp's

Stop work processes

Stop gateway

killing process (4548) (SOFT_KILL)

Stop icman

killing process (4572) (SOFT_KILL)

Terminate gui connections

wait for end of work processes

wait for end of gateway

[DpProcDied] Process lives (PID:4548 HANDLE:408)

waiting for termination of gateway ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:52:57 2008

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died (PID:4548 HANDLE:408)

wait for end of icman

[DpProcDied] Process lives (PID:4572 HANDLE:416)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:52:58 2008

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4572 HANDLE:416)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:52:59 2008

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4572 HANDLE:416)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:53:00 2008

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4572 HANDLE:416)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:53:01 2008

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4572 HANDLE:416)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:53:02 2008

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4572 HANDLE:416)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:53:03 2008

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4572 HANDLE:416)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:53:04 2008

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4572 HANDLE:416)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:53:05 2008

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4572 HANDLE:416)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:53:06 2008

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4572 HANDLE:416)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:53:07 2008

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:4572 HANDLE:416)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=441

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Tue May 20 10:53:08 2008

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died (PID:4572 HANDLE:416)

[DpProcDied] Process died (PID:4592 HANDLE:392)

DpStartStopMsg: send stop message (myname is >sap-crq_CRQ_00 <)

NiIMyHostName: hostname = 'sap-crq'

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0

DpConvertRequest: net size = 189 bytes

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=562,pac=1,MESG_IO)

MsINiWrite: sent 562 bytes

send msg (len 110+452) to name -, type 4, key -

DpStartStopMsg: stop msg sent

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 recv would block (errno=EAGAIN)

NiIRead: read for hdl 3 timed out (0ms)

DpHalt: no more messages from the message server

DpHalt: send keepalive to synchronize with the message server

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=114,pac=1,MESG_IO)

MsINiWrite: sent 114 bytes

send msg (len 110+4) to name MSG_SERVER, type 0, key -

MsSndName: MS_NOOP ok

Send 4 bytes to MSG_SERVER

NiIRead: hdl 3 recv would block (errno=EAGAIN)

NiIPeek: peek successful for hdl 3 (r)

NiIRead: hdl 3 received data (rcd=114,pac=1,MESG_IO)

NiBufIIn: NIBUF len=114

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 114 bytes

MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -

Received 4 bytes from MSG_SERVER

Received opcode MS_NOOP from msg_server, reply MSOP_OK

MsOpReceive: ok

MsSendKeepalive : keepalive sent to message server

NiIRead: hdl 3 recv would block (errno=EAGAIN)

Tue May 20 10:53:09 2008

NiIPeek: peek for hdl 3 timed out (r; 1000ms)

NiIRead: read for hdl 3 timed out (1000ms)

DpHalt: no more messages from the message server

DpHalt: sync with message server o.k.

detach from message server

***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 12168]

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIDetach: send logout to msg_server

MsIDetach: call exit function

DpMsShutdownHook called

NiBufISelUpdate: new MODE -- (r-) for hdl 3 in set0

SiSelNSet: set events of sock 320 to: ---

NiBufISelRemove: remove hdl 3 from set0

SiSelNRemove: removed sock 320 (pos=3)

SiSelNRemove: removed sock 320

NiSelIRemove: removed hdl 3

MBUF state OFF

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/17

LOCK WP ca_blk 1

make DISP owner of wp_ca_blk 1

DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 15)

MBUF component DOWN

NiICloseHandle: shutdown and close hdl 3 / sock 320

NiBufIClose: clear extension for hdl 3

MsIDetach: detach MS-system

cleanup EM

EsCleanup ....

EmCleanup() -> 0

Es2Cleanup: Cleanup ES2

***LOG Q05=> DpHalt, DPStop ( 4372) [dpxxdisp.c 10421]

Good Bye .....

Accepted Solutions (0)

Answers (2)

Answers (2)

Former Member
0 Kudos

Hello Ram,

Check for the DB connectivity ussing R3trans-d , if this is giving return code =00, kindly paste the dev_w0 trace file for more analysis.If R3trans -d is giving the error then you need to check the trans.log for the error situation so paste the trans.log also.

Thanks and Regards,

-Bijesh.

Former Member
0 Kudos

Hi,

Check your oracle services also check whether the service tnslstnr has started if not start it and then start you server.

IF still you can not then paste ur dev_wx file here.

Regards,

Vamshi.

Former Member
0 Kudos

Hi Ram,

It appears that you have a network issue. Please see Note 155147 - WinNT: Connection reset by peer, error 10054.

Best Regards,

Matt