cancel
Showing results for 
Search instead for 
Did you mean: 

Dispatcher down in Solution Manger 3.2

Former Member
0 Kudos

Hi all,

Dispatcher down in Solution Manager 3.2 on Windows 2003 and Oracle 9.2.

I have tried looking up on this forum for a solution, but without success.

Below are the dev_disp and dev_w0 files

dev_disp


---------------------------------------------------
trc file: "dev_disp", trc level: 1, release: "640"
---------------------------------------------------

Tue Mar 24 03:56:30 2009
kernel runs with dp version 128000(ext=102000) (@(#) DPLIB-INT-VERSION-128000-UC)
length of sys_adm_ext is 524 bytes
systemid   560 (PC with Windows NT)
relno      6400
patchlevel 0
patchno    43
intno      20020600
make:      multithreaded, Unicode
pid        6100

***LOG Q00=> DpSapEnvInit, DPStart (00 6100) [dpxxdisp.c   1100]
	shared lib "dw_xml.dll" version 43 successfully loaded
	shared lib "dw_xtc.dll" version 43 successfully loaded
	shared lib "dw_stl.dll" version 43 successfully loaded
	shared lib "dw_gui.dll" version 43 successfully loaded

Tue Mar 24 03:56:35 2009
*** WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 5 seconds
***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c  3886]
MtxInit: -2 0 0
DpSysAdmExtInit: ABAP is active
DpSysAdmExtInit: JAVA is not active
DpShMCreate: sizeof(wp_adm)		10528	(1316)
DpShMCreate: sizeof(tm_adm)		2780232	(13832)
DpShMCreate: sizeof(wp_ca_adm)		24000	(80)
DpShMCreate: sizeof(appc_ca_adm)	8000	(80)
DpShMCreate: sizeof(comm_adm)		290000	(580)
DpShMCreate: sizeof(vmc_adm)		0	(372)
DpShMCreate: sizeof(wall_adm)		(38456/34360/64/184)
DpShMCreate: SHM_DP_ADM_KEY		(addr: 04E80040, size: 3192688)
DpShMCreate: allocated sys_adm at 04E80040
DpShMCreate: allocated wp_adm at 04E81B58
DpShMCreate: allocated tm_adm_list at 04E84478
DpShMCreate: allocated tm_adm at 04E844A0
DpShMCreate: allocated wp_ca_adm at 0512B0E8
DpShMCreate: allocated appc_ca_adm at 05130EA8
DpShMCreate: allocated comm_adm_list at 05132DE8
DpShMCreate: allocated comm_adm at 05132E00
DpShMCreate: allocated vmc_adm_list at 05179AD0
DpShMCreate: system runs without vmc_adm
DpShMCreate: allocated ca_info at 05179AF8
DpShMCreate: allocated wall_adm at 05179B00
MBUF state OFF
EmInit: MmSetImplementation( 2 ).
<ES> client 0 initializing ....
<ES> InitFreeList
<ES> block size is 1024 kByte.
Using implementation flat
<EsNT> Memory Reset disabled as NT default
<ES> 2457 blocks reserved for free list.
ES initialized.
rdisp/http_min_wait_dia_wp : 1 -> 1
***LOG CPS=> DpLoopInit, ICU ( 2.6.1 2.6 4.0) [dpxxdisp.c   1462]
***LOG Q0K=> DpMsAttach, mscon ( dlwsdv10) [dpxxdisp.c   9736]
CCMS: Initalizing shared memory of size 60000000 for monitoring segment.
CCMS: start to initalize 3.X shared alert area (first segment).
DpMsgAdmin: Set release to 6400, patchlevel 0
MBUF state PREPARED
MBUF component UP
DpMBufHwIdSet: set Hardware-ID
***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c   1025]
DpMsgAdmin: Set patchno for this platform to 43
Release check o.K.

Tue Mar 24 03:57:15 2009
*** ERROR => W0 (pid 5632) died [dpxxdisp.c   12187]
*** ERROR => W1 (pid 2688) died [dpxxdisp.c   12187]
my types changed after wp death/restart 0xbf --> 0xbe
*** ERROR => W2 (pid 6532) died [dpxxdisp.c   12187]
my types changed after wp death/restart 0xbe --> 0xbc
*** ERROR => W3 (pid 4980) died [dpxxdisp.c   12187]
my types changed after wp death/restart 0xbc --> 0xb8
*** ERROR => W4 (pid 6956) died [dpxxdisp.c   12187]
*** ERROR => W5 (pid 7812) died [dpxxdisp.c   12187]
my types changed after wp death/restart 0xb8 --> 0xb0
*** ERROR => W6 (pid 1528) died [dpxxdisp.c   12187]
my types changed after wp death/restart 0xb0 --> 0xa0
*** ERROR => W7 (pid 216) died [dpxxdisp.c   12187]
my types changed after wp death/restart 0xa0 --> 0x80
*** DP_FATAL_ERROR => DpWPCheck: no more work processes
*** DISPATCHER EMERGENCY SHUTDOWN ***
increase tracelevel of WPs
killing W0-5632 (SIGUSR2)
*** ERROR => DpWpKill(5632, SIGUSR2) failed [dpxxtool.c   2468]
killing W1-2688 (SIGUSR2)
*** ERROR => DpWpKill(2688, SIGUSR2) failed [dpxxtool.c   2468]
killing W2-6532 (SIGUSR2)
*** ERROR => DpWpKill(6532, SIGUSR2) failed [dpxxtool.c   2468]
killing W3-4980 (SIGUSR2)
*** ERROR => DpWpKill(4980, SIGUSR2) failed [dpxxtool.c   2468]
killing W4-6956 (SIGUSR2)
*** ERROR => DpWpKill(6956, SIGUSR2) failed [dpxxtool.c   2468]
killing W5-7812 (SIGUSR2)
*** ERROR => DpWpKill(7812, SIGUSR2) failed [dpxxtool.c   2468]
killing W6-1528 (SIGUSR2)
*** ERROR => DpWpKill(1528, SIGUSR2) failed [dpxxtool.c   2468]
killing W7-216 (SIGUSR2)
*** ERROR => DpWpKill(216, SIGUSR2) failed [dpxxtool.c   2468]
NiWait: sleep (10000 msecs) ...
NiISelect: timeout 10000 ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue Mar 24 03:57:25 2009
NiISelect: TIMEOUT occured (10000 ms)
dump system status
Workprocess Table (long)			Tue Mar 24 08:57:25 2009
========================

No Ty. Pid      Status  Cause Start Err Sem CPU    Time  Program  Cl  User         Action                    Table
-----------------------------------------------------------------------------------------------------------------------
 0 DIA     5632 Ended         no      1   0             0                                                              
 1 DIA     2688 Ended         no      1   0             0                                                              
 2 UPD     6532 Ended         no      1   0             0                                                              
 3 ENQ     4980 Ended         no      1   0             0                                                              
 4 BTC     6956 Ended         no      1   0             0                                                              
 5 BTC     7812 Ended         no      1   0             0                                                              
 6 SPO     1528 Ended         no      1   0             0                                                              
 7 UP2      216 Ended         no      1   0             0                                                              
Dispatcher Queue Statistics			Tue Mar 24 08:57:25 2009
===========================

+------+--------+--------+--------+--------+--------+
|  Typ |    now |   high |    max | writes |  reads |
+------+--------+--------+--------+--------+--------+
| NOWP |      0 |      3 |   2000 |     10 |     10 |
+------+--------+--------+--------+--------+--------+
|  DIA |      5 |      5 |   2000 |      5 |      0 |
+------+--------+--------+--------+--------+--------+
|  UPD |      0 |      0 |   2000 |      0 |      0 |
+------+--------+--------+--------+--------+--------+
|  ENQ |      0 |      0 |   2000 |      0 |      0 |
+------+--------+--------+--------+--------+--------+
|  BTC |      0 |      0 |   2000 |      0 |      0 |
+------+--------+--------+--------+--------+--------+
|  SPO |      0 |      0 |   2000 |      0 |      0 |
+------+--------+--------+--------+--------+--------+
|  UP2 |      0 |      0 |   2000 |      0 |      0 |
+------+--------+--------+--------+--------+--------+


max_rq_id		13
wake_evt_udp_now	0

wake events      	total     9,  udp     8 ( 88%),  shm     1 ( 11%)
since last update	total     9,  udp     8 ( 88%),  shm     1 ( 11%)


Dump of tm_adm structure:			Tue Mar 24 08:57:25 2009
=========================

Term    uid  man user    term   lastop  mod wp  ta   a/i (modes)

Workprocess Comm. Area Blocks			Tue Mar 24 08:57:25 2009
=============================

Slots: 300, Used: 1, Max: 0
+------+--------------+----------+-------------+
|   id | owner        |   pid    | eyecatcher  |
+------+--------------+----------+-------------+
|    0 | DISPATCHER   |       -1 | *WPCAAD000* |

NiWait: sleep (5000 msecs) ...
NiISelect: timeout 5000 ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue Mar 24 03:57:30 2009
NiISelect: TIMEOUT occured (5000 ms)
Shutdown server ...
DpJ2eeDisableRestart
DpModState: buffer in state MBUF_PREPARED

NiBufSend starting
NiIWrite: write 110, 1 packs, MESG_IO, hdl 3, data complete
MsINiWrite: sent 110 bytes
MsIModState: change state to SHUTDOWN
DpModState: change server state from STARTING to SHUTDOWN
Switch off Shared memory profiling
ShmProtect( 57, 3 )
ShmProtect(SHM_PROFILE, SHM_PROT_RW
ShmProtect( 57, 1 )
ShmProtect(SHM_PROFILE, SHM_PROT_RD
DpWakeUpWps: wake up all wp's
Stop work processes...
Stop gateway
killing process (3216) (SOFT_KILL)
Stop icman
killing process (2568) (SOFT_KILL)
Terminate gui connections
[DpProcDied] Process lives  (PID:3216  HANDLE:1504)
waiting for termination of gateway
NiWait: sleep (1000 msecs) ...
NiISelect: timeout 1000 ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue Mar 24 03:57:31 2009
NiISelect: TIMEOUT occured (1000 ms)
[DpProcDied] Process died  (PID:3216  HANDLE:1504)
[DpProcDied] Process lives  (PID:2568  HANDLE:1496)
waiting for termination of icman
NiWait: sleep (1000 msecs) ...
NiISelect: timeout 1000 ms
NiISelect: maximum fd=1525
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Tue Mar 24 03:57:32 2009
NiISelect: TIMEOUT occured (1000 ms)
[DpProcDied] Process died  (PID:2568  HANDLE:1496)
DpHalt: cancel all lcom connections
MPI CancelAll 2 -> 0
MPI DeleteAll 2 -> 0
NiIMyHostName: hostname = 'dlwsdv10'
AdGetSelfIdentRecord: >                                                                           <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0
DpConvertRequest: net size = 163 bytes

NiBufSend starting
NiIWrite: write 562, 1 packs, MESG_IO, hdl 3, data complete
MsINiWrite: sent 562 bytes
send msg (len 110+452) to name          -, type 4, key -
detach from message server
***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c   9962]

NiBufSend starting
NiIWrite: write 110, 1 packs, MESG_IO, hdl 3, data complete
MsINiWrite: sent 110 bytes
MsIDetach: send logout to msg_server
MsIDetach: call exit function
DpMsShutdownHook called
NiSelClear: removed hdl 3 from selectset
MBUF state OFF
AdGetSelfIdentRecord: >                                                                           <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/8
LOCK WP ca_blk 1
make DISP owner of wp_ca_blk 1
DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 19)
MBUF component DOWN
NiBufClose: clear extensions for hdl 3
NiBufSetStat: bufstat of hdl 3 changed from OK to OFF
NiICloseHandle: shutdown and close hdl 3 / socket 1508
MsIDetach: detach MS-system
EsCleanup ....
***LOG Q05=> DpHalt, DPStop ( 6100) [dpxxdisp.c   8495]
Good Bye ..... 

Appreciate any help,

Thanks,

vishnu

Accepted Solutions (0)

Answers (5)

Answers (5)

Former Member
0 Kudos

Hi

M DpSysAdmExtCreate: ABAP is active

M DpSysAdmExtCreate: JAVA is not active

Is ABAP active ?

Try upgrading you kernel once with latest patch level

Regards

Uday

Former Member
0 Kudos

Hi

Check R3trans -d

when you start sap, it tries to connect to the db with the OPS$ user.the OPS$ user has the password of the SAPSID account stored in the table SAPUSER check is that user locked

Regards

Uday

Former Member
0 Kudos

Hi

what is the shared pool size available.

login to oracle level

sql>show parameter shared_pool_size;

btw what is the RAM available

Regards

Uday

Former Member
0 Kudos

Hi Uday,

shared_pool_size--260046484bytes

RAM Available is 12gb.

Thanks,

vishnu

Former Member
0 Kudos

Hi all,

Any Ideas where the problem is? I am quite not able to figure this out.

Oracle is up in this case, looking at the dev_w0 trace file, i think that there is no connection

between the application server and the database.

Thanks,

vishnu

Edited by: vishnuarigela on Mar 31, 2009 5:53 AM

Former Member
0 Kudos

Hi

Have you checked all your oracle services are up and running like listner service.

Regards

Uday

Former Member
0 Kudos

Hi Uday,

I have checked all the Oracle Services are running fine. Even the listener.

Thanks,

vishnu.

Former Member
0 Kudos

Hi all,

Any help would be greatly appreciated. Looked up for solutions on this forum,

and gone throught the trace files, but unable to figure out what the problem is.

Thanks,

vishnu.

Former Member
0 Kudos

Hi all,

Below the dev_w0 file

dev_w0




---------------------------------------------------
trc file: "dev_w0", trc level: 1, release: "640"
---------------------------------------------------
*
*  ACTIVE TRACE LEVEL           1
*  ACTIVE TRACE COMPONENTS      all, M
*
B  
B Tue Mar 24 03:56:36 2009
B  create_con (con_name=R/3)
B  Loading DB library 'D:\usr\sap\SM6\SYS\exe\run\dboraslib.dll' ...
B  Library 'D:\usr\sap\SM6\SYS\exe\run\dboraslib.dll' loaded
B  Version of 'D:\usr\sap\SM6\SYS\exe\run\dboraslib.dll' is "640.00", patchlevel (0.39)
B  New connection 0 created
M systemid   560 (PC with Windows NT)
M relno      6400
M patchlevel 0
M patchno    43
M intno      20020600
M make:      multithreaded, Unicode
M pid        5632
M 
M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 0 5632) [dpxxdisp.c   1160]
I  MtxInit: -2 0 0
M  DpSysAdmExtCreate: ABAP is active
M  DpSysAdmExtCreate: JAVA is not active
M  DpShMCreate: sizeof(wp_adm)		10528	(1316)
M  DpShMCreate: sizeof(tm_adm)		2780232	(13832)
M  DpShMCreate: sizeof(wp_ca_adm)		24000	(80)
M  DpShMCreate: sizeof(appc_ca_adm)	8000	(80)
M  DpShMCreate: sizeof(comm_adm)		290000	(580)
M  DpShMCreate: sizeof(vmc_adm)		0	(372)
M  DpShMCreate: sizeof(wall_adm)		(38456/34360/64/184)
M  DpShMCreate: SHM_DP_ADM_KEY		(addr: 04E80040, size: 3192688)
M  DpShMCreate: allocated sys_adm at 04E80040
M  DpShMCreate: allocated wp_adm at 04E81B58
M  DpShMCreate: allocated tm_adm_list at 04E84478
M  DpShMCreate: allocated tm_adm at 04E844A0
M  DpShMCreate: allocated wp_ca_adm at 0512B0E8
M  DpShMCreate: allocated appc_ca_adm at 05130EA8
M  DpShMCreate: allocated comm_adm_list at 05132DE8
M  DpShMCreate: allocated comm_adm at 05132E00
M  DpShMCreate: allocated vmc_adm_list at 05179AD0
M  DpShMCreate: system runs without vmc_adm
M  DpShMCreate: allocated ca_info at 05179AF8
M  DpShMCreate: allocated wall_adm at 05179B00
X  EmInit: MmSetImplementation( 2 ).
X  <ES> client 0 initializing ....
X  Using implementation flat
M  <EsNT> Memory Reset disabled as NT default
X  ES initialized.
M  
M Tue Mar 24 03:56:37 2009
M  calling db_connect ...
C  Got ORACLE_HOME=D:\oracle\sm6\924 from environment
C  *** ERROR => OCI-call 'OCIInitialize' failed: rc = -1
 [dboci.c      1848]
C  *** ERROR => OCI-call 'OCIErrorGet' failed: rc = -2
 [dboci.c      1742]
B  ***LOG BY2=> sql error -1     performing CON [dbsh#2 @ 1200] [dbsh    1200 ]
B  ***LOG BY0=> Cannot get Oracle error text. [dbsh#2 @ 1200] [dbsh    1200 ]
B  ***LOG BY2=> sql error -1     performing CON [dblink#1 @ 419] [dblink  0419 ]
B  ***LOG BY0=> Cannot get Oracle error text. [dblink#1 @ 419] [dblink  0419 ]
M  ***LOG R19=> tskh_init, db_connect ( DB-Connect 000256) [thxxhead.c   1269]
M  in_ThErrHandle: 1
M  *** ERROR => tskh_init: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   9413]
M  
M  Info for wp 0
M  
M    stat = 4
M    reqtype = 1
M    act_reqtype = -1
M    rq_info = 0
M    tid = -1
M    mode = 255
M    len = -1
M    rq_id = 65535
M    rq_source = 255
M    last_tid = 0
M    last_mode = 0
M    int_checked_resource(RFC) = 0
M    ext_checked_resource(RFC) = 0
M    int_checked_resource(HTTP) = 0
M    ext_checked_resource(HTTP) = 0
M    report = >                                        <
M    action = 0
M    tab_name = >                              <
M  
M  *****************************************************************************
M  *
M  *  LOCATION    SAP-Server dlwsdv10_SM6_00 on host dlwsdv10 (wp 0)
M  *  ERROR       tskh_init: db_connect
M  *
M  *  TIME        Tue Mar 24 03:56:37 2009
M  *  RELEASE     640
M  *  COMPONENT   Taskhandler
M  *  VERSION     1
M  *  RC          13
M  *  MODULE      thxxhead.c
M  *  LINE        9589
M  *  COUNTER     1
M  *
M  *****************************************************************************
M  
M  PfStatDisconnect: disconnect statistics
M  Entering TH_CALLHOOKS
M  ThCallHooks: call hook >ThrSaveSPAFields< for event BEFORE_DUMP
M  *** ERROR => ThrSaveSPAFields: no valid thr_wpadm [thxxrun1.c   730]
M  *** ERROR => ThCallHooks: event handler ThrSaveSPAFields for event BEFORE_DUMP failed [thxxtool3.c  252]
M  Entering ThSetStatError
M  Entering ThReadDetachMode
M  call ThrShutDown (1)...
M  ***LOG Q02=> wp_halt, WPStop (Workproc 0 5632) [dpnttool.c   357]

Thanks,

vishnu.