cancel
Showing results for 
Search instead for 
Did you mean: 

Dispatcher shutdown due to DP_FATAL_ERROR => DpWPCheck: no more work proces

Former Member
0 Kudos

Performed a client copy of NW4 client 800, since the copy I have not been able to log on to the NW4 instance. Dispatcher stopped.

Trace file listed.

---------------------------------------------------
trc file: "dev_disp", trc level: 1, release: "700"
---------------------------------------------------
sysno      09
sid        NW4
systemid   560 (PC with Windows NT)
relno      7000
patchlevel 0
patchno    111
intno      20050900
make:      multithreaded, Unicode, optimized
pid        2700


Fri Mar 13 15:39:00 2009
kernel runs with dp version 229000(ext=109000) (@(#) DPLIB-INT-VERSION-229000-UC)
length of sys_adm_ext is 576 bytes
*** SWITCH TRC-HIDE on ***
***LOG Q00=> DpSapEnvInit, DPStart (09 2700) [dpxxdisp.c   1239]
	shared lib "dw_xml.dll" version 111 successfully loaded
	shared lib "dw_xtc.dll" version 111 successfully loaded
	shared lib "dw_stl.dll" version 111 successfully loaded
	shared lib "dw_gui.dll" version 111 successfully loaded
	shared lib "dw_mdm.dll" version 111 successfully loaded
rdisp/softcancel_sequence :  -> 0,5,-1
use internal message server connection to port 3909

Fri Mar 13 15:39:05 2009
*** WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 5 seconds
***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c  5361]
MtxInit: 30000 0 0
DpSysAdmExtInit: ABAP is active
DpSysAdmExtInit: VMC (JAVA VM in WP) is not active
DpIPCInit2: start server >sapserver_NW4_09                        <
DpShMCreate: sizeof(wp_adm)		8616	(1436)
DpShMCreate: sizeof(tm_adm)		4232256	(21056)
DpShMCreate: sizeof(wp_ca_adm)		24000	(80)
DpShMCreate: sizeof(appc_ca_adm)	8000	(80)
DpCommTableSize: max/headSize/ftSize/tableSize=500/8/528056/528064
DpShMCreate: sizeof(comm_adm)		528064	(1048)
DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0
DpShMCreate: sizeof(slock_adm)		0	(96)
DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0
DpShMCreate: sizeof(file_adm)		0	(72)
DpShMCreate: sizeof(vmc_adm)		0	(1536)
DpShMCreate: sizeof(wall_adm)		(38456/34360/64/184)
DpShMCreate: sizeof(gw_adm)	48
DpShMCreate: SHM_DP_ADM_KEY		(addr: 06A10040, size: 4882256)
DpShMCreate: allocated sys_adm at 06A10040
DpShMCreate: allocated wp_adm at 06A12090
DpShMCreate: allocated tm_adm_list at 06A14238
DpShMCreate: allocated tm_adm at 06A14268
DpShMCreate: allocated wp_ca_adm at 06E1D6A8
DpShMCreate: allocated appc_ca_adm at 06E23468
DpShMCreate: allocated comm_adm at 06E253A8
DpShMCreate: system runs without slock table
DpShMCreate: system runs without file table
DpShMCreate: allocated vmc_adm_list at 06EA6268
DpShMCreate: allocated gw_adm at 06EA62A8
DpShMCreate: system runs without vmc_adm
DpShMCreate: allocated ca_info at 06EA62D8
DpShMCreate: allocated wall_adm at 06EA62E0
MBUF state OFF
DpCommInitTable: init table for 500 entries
EmInit: MmSetImplementation( 2 ).
MM global diagnostic options set: 0
<ES> client 0 initializing ....
<ES> InitFreeList
<ES> block size is 1024 kByte.
Using implementation view
<EsNT> Using memory model view.
<EsNT> Memory Reset disabled as NT default
<ES> 8180 blocks reserved for free list.
ES initialized.

Fri Mar 13 15:39:06 2009
J2EE server info
  start = TRUE
  state = STARTED
  pid = 4148
  argv[0] = D:\usr\sap\NW4\DVEBMGS09\exe\jcontrol.EXE
  argv[1] = D:\usr\sap\NW4\DVEBMGS09\exe\jcontrol.EXE
  argv[2] = pf=D:\usr\sap\NW4\SYS\profile\NW4_DVEBMGS09_sapserver
  argv[3] = -DSAPSTART=1
  argv[4] = -DCONNECT_PORT=1081
  argv[5] = -DSAPSYSTEM=09
  argv[6] = -DSAPSYSTEMNAME=NW4
  argv[7] = -DSAPMYNAME=sapserver_NW4_09
  argv[8] = -DSAPPROFILE=D:\usr\sap\NW4\SYS\profile\NW4_DVEBMGS09_sapserver
  argv[9] = -DFRFC_FALLBACK=ON
  argv[10] = -DFRFC_FALLBACK_HOST=localhost
  start_lazy = 0
  start_control = SAP J2EE startup framework

DpJ2eeStart: j2ee state = STARTED
***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c   1629]
***LOG Q0K=> DpMsAttach, mscon ( sapserver) [dpxxdisp.c   11753]
DpStartStopMsg: send start message (myname is >sapserver_NW4_09                        <)
DpStartStopMsg: start msg sent
CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

Fri Mar 13 15:39:07 2009
CCMS: start to initalize 3.X shared alert area (first segment).
DpMsgAdmin: Set release to 7000, patchlevel 0
MBUF state PREPARED
MBUF component UP
DpMBufHwIdSet: set Hardware-ID
***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c   1050]
DpJ2eeLogin: j2ee state = CONNECTED
DpMsgAdmin: Set patchno for this platform to 111
Release check o.K.

Fri Mar 13 15:39:25 2009
***LOG Q0I=> NiIRead: recv (10054: WSAECONNRESET: Connection reset by peer) [nixxi.cpp 4248]
*** ERROR => NiIRead: SiRecv failed for hdl 5 / sock 1456
    (SI_ECONN_BROKEN/10054; I4; ST; 127.0.0.1:1093) [nixxi.cpp    4248]
DpJ2eeMsgProcess: j2ee state = CONNECTED (NIECONN_BROKEN)
DpIJ2eeShutdown: send SIGINT to SAP J2EE startup framework (pid=4148)
*** ERROR => DpProcKill: kill failed [dpntdisp.c   371]
DpIJ2eeShutdown: j2ee state = SHUTDOWN

Fri Mar 13 15:39:46 2009
*** ERROR => W0 (pid 4156) died [dpxxdisp.c   14441]
my types changed after wp death/restart 0xbf --> 0xbe
*** ERROR => W1 (pid 4164) died [dpxxdisp.c   14441]
my types changed after wp death/restart 0xbe --> 0xbc
*** ERROR => W2 (pid 4172) died [dpxxdisp.c   14441]
my types changed after wp death/restart 0xbc --> 0xb8
*** ERROR => W3 (pid 4180) died [dpxxdisp.c   14441]
my types changed after wp death/restart 0xb8 --> 0xb0
*** ERROR => W4 (pid 4188) died [dpxxdisp.c   14441]
my types changed after wp death/restart 0xb0 --> 0xa0
*** ERROR => W5 (pid 4204) died [dpxxdisp.c   14441]
my types changed after wp death/restart 0xa0 --> 0x80
*** DP_FATAL_ERROR => DpWPCheck: no more work processes
*** DISPATCHER EMERGENCY SHUTDOWN ***
increase tracelevel of WPs
NiWait: sleep (10000ms) ...
NiISelect: timeout 10000ms
NiISelect: maximum fd=1569
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Fri Mar 13 15:39:56 2009
NiISelect: TIMEOUT occured (10000ms)
dump system status
Workprocess Table (long)			Fri Mar 13 22:39:56 2009
========================

No Ty. Pid      Status  Cause Start Err Sem CPU    Time  Program          Cl  User         Action                    Table
-------------------------------------------------------------------------------------------------------------------------------
 0 DIA     4156 Ended         no      1   0        0                                                                          
 1 UPD     4164 Ended         no      1   0        0                                                                          
 2 ENQ     4172 Ended         no      1   0        0                                                                          
 3 BTC     4180 Ended         no      1   0        0                                                                          
 4 SPO     4188 Ended         no      1   0        0                                                                          
 5 UP2     4204 Ended         no      1   0        0                                                                          
Dispatcher Queue Statistics			Fri Mar 13 22:39:56 2009
===========================

+------+--------+--------+--------+--------+--------+
|  Typ |    now |   high |    max | writes |  reads |
+------+--------+--------+--------+--------+--------+
| NOWP |      0 |      2 |   2000 |      5 |      5 |
+------+--------+--------+--------+--------+--------+
|  DIA |      5 |      5 |   2000 |      5 |      0 |
+------+--------+--------+--------+--------+--------+
|  UPD |      0 |      0 |   2000 |      0 |      0 |
+------+--------+--------+--------+--------+--------+
|  ENQ |      0 |      0 |   2000 |      0 |      0 |
+------+--------+--------+--------+--------+--------+
|  BTC |      0 |      0 |   2000 |      0 |      0 |
+------+--------+--------+--------+--------+--------+
|  SPO |      0 |      0 |   2000 |      0 |      0 |
+------+--------+--------+--------+--------+--------+
|  UP2 |      0 |      0 |   2000 |      0 |      0 |
+------+--------+--------+--------+--------+--------+


max_rq_id		12
wake_evt_udp_now	0

wake events      	total     8,  udp     5 ( 62%),  shm     3 ( 37%)


Stop gateway

How do I resolved this problem?

Accepted Solutions (1)

Accepted Solutions (1)

Former Member
0 Kudos

Hi,

I had never faced this issue on UNIX environment. This is possibly due to improper shutdown of SAP system. The memory areas always remains occupied.

In windows environment 90% problem get resolved by rebooting the server.

If you could reboot your server, it might solve the problem.

Also please post dev_w0 log as well.

Regards,

Sachin Rane.

Answers (6)

Answers (6)

Former Member
0 Kudos

stop all the process by stopsap. Use cleanipc <Instancenumber. remove, to remove the shared memory. stop the saposcol -k.

First start the database using startsap DB. check the database logs for any abnormal information.

Then start the SAP by issuing startsap.

Post the dev_dispatcher log again.

Thanks

Manny.

Former Member
0 Kudos

Hi,

Looking at dev_w0 log we can figure out ORA-28000.

Your schema (SAPR3 / SAPSID ) id is locked at oracle level. unlock it and try to start the SAP.

Also Check SAP note 951167.

Regards,

Sachin Rane.

Edited by: Sachin Rane on Mar 16, 2009 2:57 PM

Former Member
0 Kudos

Added copy of dev_w0 log.

---------------------------------------------------
trc file: "dev_w0", trc level: 1, release: "700"
---------------------------------------------------
*
*  ACTIVE TRACE LEVEL           1
*  ACTIVE TRACE COMPONENTS      all, MJ
*
B  
B Fri Mar 13 15:39:06 2009
B  create_con (con_name=R/3)
B  Loading DB library 'D:\usr\sap\NW4\DVEBMGS09\exe\dboraslib.dll' ...
B  Library 'D:\usr\sap\NW4\DVEBMGS09\exe\dboraslib.dll' loaded
B  Version of 'D:\usr\sap\NW4\DVEBMGS09\exe\dboraslib.dll' is "700.08", patchlevel (0.107)
B  New connection 0 created
M sysno      09
M sid        NW4
M systemid   560 (PC with Windows NT)
M relno      7000
M patchlevel 0
M patchno    111
M intno      20050900
M make:      multithreaded, Unicode, optimized
M pid        4156
M 
M  kernel runs with dp version 229000(ext=109000) (@(#) DPLIB-INT-VERSION-229000-UC)
M  length of sys_adm_ext is 576 bytes
M  ***LOG Q0Q=> tskh_init, WPStart (Workproc 0 4156) [dpxxdisp.c   1301]
I  MtxInit: 30000 0 0
M  DpSysAdmExtCreate: ABAP is active
M  DpSysAdmExtCreate: VMC (JAVA VM in WP) is not active
M  DpShMCreate: sizeof(wp_adm)		8616	(1436)
M  DpShMCreate: sizeof(tm_adm)		4232256	(21056)
M  DpShMCreate: sizeof(wp_ca_adm)		24000	(80)
M  DpShMCreate: sizeof(appc_ca_adm)	8000	(80)
M  DpCommTableSize: max/headSize/ftSize/tableSize=500/8/528056/528064
M  DpShMCreate: sizeof(comm_adm)		528064	(1048)
M  DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0
M  DpShMCreate: sizeof(slock_adm)		0	(96)
M  DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0
M  DpShMCreate: sizeof(file_adm)		0	(72)
M  DpShMCreate: sizeof(vmc_adm)		0	(1536)
M  DpShMCreate: sizeof(wall_adm)		(38456/34360/64/184)
M  DpShMCreate: sizeof(gw_adm)	48
M  DpShMCreate: SHM_DP_ADM_KEY		(addr: 06A10040, size: 4882256)
M  DpShMCreate: allocated sys_adm at 06A10040
M  DpShMCreate: allocated wp_adm at 06A12090
M  DpShMCreate: allocated tm_adm_list at 06A14238
M  DpShMCreate: allocated tm_adm at 06A14268
M  DpShMCreate: allocated wp_ca_adm at 06E1D6A8
M  DpShMCreate: allocated appc_ca_adm at 06E23468
M  DpShMCreate: allocated comm_adm at 06E253A8
M  DpShMCreate: system runs without slock table
M  DpShMCreate: system runs without file table
M  DpShMCreate: allocated vmc_adm_list at 06EA6268
M  DpShMCreate: allocated gw_adm at 06EA62A8
M  DpShMCreate: system runs without vmc_adm
M  DpShMCreate: allocated ca_info at 06EA62D8
M  DpShMCreate: allocated wall_adm at 06EA62E0
X  EmInit: MmSetImplementation( 2 ).
X  MM global diagnostic options set: 0
X  <ES> client 0 initializing ....
X  Using implementation view
X  <EsNT> Using memory model view.
M  <EsNT> Memory Reset disabled as NT default
X  ES initialized.
M  
M Fri Mar 13 15:39:07 2009
M  ThInit: running on host sapserver
M  calling db_connect ...
C  Prepending D:\usr\sap\NW4\DVEBMGS09\exe to Path.
C  
C Fri Mar 13 15:39:10 2009
C  Oracle Client Version: '10.2.0.2.0'
C  Client NLS settings: AMERICAN_AMERICA.UTF8
C  Logon as OPS$-user to get SAPSR3's password
C  Connecting as /@NW4 on connection 0 (nls_hdl 0) ... (dbsl 700 250407)
C  Nls CharacterSet                 NationalCharSet              C      EnvHp      ErrHp ErrHpBatch
C    0 UTF8                                                      1   067415F8   06746C94   0674651C
C  Attaching to DB Server NW4 (con_hdl=0,svchp=06746468,srvhp=06758064)
C  Starting user session (con_hdl=0,svchp=06746468,srvhp=06758064,usrhp=0676CDF8)
C  
C Fri Mar 13 15:39:12 2009
C  Now '/@NW4' is connected (con_hdl 0, nls_hdl 0).
C  Got SAPSR3's password from OPS$-user
C  Disconnecting from connection 0 ...
C  Closing user session (con_hdl=0,svchp=06746468,usrhp=0676CDF8)
C  Now I'm disconnected from ORACLE
C  Connecting as SAPSR3/<pwd>@NW4 on connection 0 (nls_hdl 0) ... (dbsl 700 250407)
C  Nls CharacterSet                 NationalCharSet              C      EnvHp      ErrHp ErrHpBatch
C    0 UTF8                                                      1   067415F8   06746C94   0674651C
C  Starting user session (con_hdl=0,svchp=06746468,srvhp=06758064,usrhp=0676CDF8)
C  *** ERROR => OCI-call 'OCISessionBegin' failed with rc=28000
 [dboci.c      4532]
C  Detaching from DB Server (con_hdl=0,svchp=06746468,srvhp=06758064)
C  *** ERROR => CONNECT failed with sql error '28000'
 [dbsloci.c    11042]
B  ***LOG BY2=> sql error 28000  performing CON [dbsh#2 @ 1204] [dbsh    1204 ]
B  ***LOG BY0=> ORA-28000: the account is locked [dbsh#2 @ 1204] [dbsh    1204 ]
B  ***LOG BY2=> sql error 28000  performing CON [dblink#3 @ 431] [dblink  0431 ]
B  ***LOG BY0=> ORA-28000: the account is locked [dblink#3 @ 431] [dblink  0431 ]
M  ***LOG R19=> ThInit, db_connect ( DB-Connect 000256) [thxxhead.c   1426]
M  in_ThErrHandle: 1
M  *** ERROR => ThInit: db_connect (step 1, th_errno 13, action 3, level 1) [thxxhead.c   10283]
M  
M  Info for wp 0
M  
M    stat = WP_RUN
M    waiting_for = NO_WAITING
M    reqtype = DP_RQ_DIAWP
M    act_reqtype = NO_REQTYPE
M    rq_info = 0
M    tid = -1
M    mode = 255
M    len = -1
M    rq_id = 65535
M    rq_source = 
M    last_tid = 0
M    last_mode = 0
M    semaphore = 0
M    act_cs_count = 0
M    csTrack = 0
M    csTrackRwExcl = 0
M    csTrackRwShrd = 0
M    control_flag = 0
M    int_checked_resource(RFC) = 0
M    ext_checked_resource(RFC) = 0
M    int_checked_resource(HTTP) = 0
M    ext_checked_resource(HTTP) = 0
M    report = >                                        <
M    action = 0
M    tab_name = >                              <
M    req.vm = no VM
M    attachedVm = no VM
M  
M  *****************************************************************************
M  *
M  *  LOCATION    SAP-Server sapserver_NW4_09 on host sapserver (wp 0)
M  *  ERROR       ThInit: db_connect
M  *
M  *  TIME        Fri Mar 13 15:39:12 2009
M  *  RELEASE     700
M  *  COMPONENT   Taskhandler
M  *  VERSION     1
M  *  RC          13
M  *  MODULE      thxxhead.c
M  *  LINE        10486
M  *  COUNTER     1
M  *
M  *****************************************************************************
M  
M  PfStatDisconnect: disconnect statistics
M  Entering TH_CALLHOOKS
M  ThCallHooks: call hook >ThrSaveSPAFields< for event BEFORE_DUMP
M  *** ERROR => ThrSaveSPAFields: no valid thr_wpadm [thxxrun1.c   720]
M  *** ERROR => ThCallHooks: event handler ThrSaveSPAFields for event BEFORE_DUMP failed [thxxtool3.c  260]
M  Entering ThSetStatError
M  ThIErrHandle: do not call ThrCoreInfo (no_core_info=0, in_dynp_env=0)
M  Entering ThReadDetachMode
M  call ThrShutDown (1)...
M  
M Fri Mar 13 15:39:13 2009
M  ***LOG Q02=> wp_halt, WPStop (Workproc 0 4156) [dpnttool.c   327]

Thanks for your help.

former_member185031
Active Contributor
0 Kudos

You should check another trace files in work directory and paste the error here from trace files, another option is execute R3trans -d and check the returncode is 0000 or not,then start the database only and check the table space as after client copy most of the time table space is full and system could not able to start.

Hope this helps

Subhash

Former Member
0 Kudos

Hi,

It looks like you have some network problem. Please check firewall/antivirus settings.

Finally you can check gateway service (SMGW) too.

http://help.sap.com/saphelp_nw04/helpdata/en/bb/9f13194b9b11d189750000e8322d00/frameset.htm

BTW, are you starting this server remotely?

Hope this helps.

Manoj Chintawar

Former Member
0 Kudos

Hi

Check all the Database services are up and running,check the status of listner process.

Is it the ABAPJAVA or only ABAP? By seeing the logs i can say you have ABAPJAVA.

Check the Memory parameter try changing the JVM paramater using config tool

btw what is the system configuration you have ?

Let me know if needed more information

Regards

Uday