Problem starting SAP: disp+work.exe Running but Dialog Queue standstill

[Former Member]

Hello,

I have a problem starting my SAP instance. When I go to MMC and start the instance with nspadm user, the instance first starts and goes to status green, but after a short period it goes to yellow, in process list I see 2 processes:
- msg_server.EXE (MessageServer -> running)

- disp+work.EXE (DIspatcher -> Running but Dialog Queue standstill)

The instance was running fine for a month now but then when I was in SAP GUI and the system was compiling one of the transactions it suddenly stopped in the middle of compile (it did not respond, canceling the transaction did not help, when I restarted the instance the problem was there).

I created a system restore from early image and it was working fine for some time, but  then stopped again in the process of compiling some other SAP transaction (not the same one as before). I created another restore and the same story again, this time it stopped while I was trying to activate one of my own abap programms.

I was looking at the log files, but can't figure out what is going on. My system is a developer version of SAP 7.2 installed locally on a Windows 7 Professional Edition, I have enabled the localhost adapter and for a while it looked ok.

Can anyone please help, I am quite new to this...

The messages in the logs are:

-> dev_disp:

#####################################
trc file: "dev_disp", trc level: 1, release: "720"

sysno      00
sid        NSP
systemid   562 (PC with Windows NT)
relno      7200
patchlevel 0
patchno    214
intno      20020600
make       multithreaded, Unicode, 64 bit, optimized
profile    \\Miha-PC\sapmnt\NSP\SYS\profile\NSP_DVEBMGS00_Miha-PC
pid        5044

kernel runs with dp version 134000(ext=119000) (@(#) DPLIB-INT-VERSION-134000-UC)
length of sys_adm_ext is 588 bytes
*** SWITCH TRC-HIDE on ***
***LOG Q00=> DpSapEnvInit, DPStart (00 5044) [dpxxdisp.c   1315]
shared lib "dw_xml.dll" version 214 successfully loaded
shared lib "dw_xtc.dll" version 214 successfully loaded
shared lib "dw_stl.dll" version 214 successfully loaded
shared lib "dw_gui.dll" version 214 successfully loaded
shared lib "dw_mdm.dll" version 214 successfully loaded
shared lib "dw_rndrt.dll" version 214 successfully loaded
shared lib "dw_abp.dll" version 214 successfully loaded
shared lib "dw_sym.dll" version 214 successfully loaded
shared lib "dw_aci.dll" version 214 successfully loaded
rdisp/softcancel_sequence :  -> 0,5,-1
use internal message server connection to port 3900
rdisp/dynamic_wp_check : 1
rdisp/calculateLoadAverage : 1

Mon Jul 29 10:27:58 2013
*** WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 5 seconds
***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c  6423]
MtxInit: 30000 0 0
DpSysAdmExtInit: ABAP is active
DpSysAdmExtInit: VMC (JAVA VM in WP) is not active
DpIPCInit2: write dp-profile-values into sys_adm_ext
DpIPCInit2: start server >Miha-PC_NSP_00                          <
DpShMCreate: sizeof(wp_adm)  31696 (2264)
DpShMCreate: sizeof(tm_adm)  5517056 (27448)
DpShMCreate: sizeof(wp_ca_adm)  64000 (64)
DpShMCreate: sizeof(appc_ca_adm) 64000 (64)
DpCommTableSize: max/headSize/ftSize/tableSize=500/16/1384064/1384080
DpShMCreate: sizeof(comm_adm)  1384080 (2744)
DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0
DpShMCreate: sizeof(slock_adm)  0 (296)
DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0
DpShMCreate: sizeof(file_adm)  0 (80)
DpShMCreate: sizeof(vmc_adm)  0 (2152)
DpShMCreate: sizeof(wall_adm)  (41664/42896/64/192)
DpShMCreate: sizeof(gw_adm) 48
DpShMCreate: sizeof(j2ee_adm) 3952
DpShMCreate: SHM_DP_ADM_KEY  (addr: 0000000007AA0050, size: 7163600)
DpShMCreate: allocated sys_adm at 0000000007AA0060
DpShMCreate: allocated wp_adm_list at 0000000007AA3070
DpShMCreate: allocated wp_adm at 0000000007AA3260
DpShMCreate: allocated tm_adm_list at 0000000007AAAE40
DpShMCreate: allocated tm_adm at 0000000007AAAE90
DpShMCreate: allocated wp_ca_adm at 0000000007FEDDA0
DpShMCreate: allocated appc_ca_adm at 0000000007FFD7B0
DpShMCreate: allocated comm_adm at 000000000800D1C0
DpShMCreate: system runs without slock table
DpShMCreate: system runs without file table
DpShMCreate: allocated vmc_adm_list at 000000000815F060
DpShMCreate: system runs without vmc_adm
DpShMCreate: allocated gw_adm at 000000000815F110
DpShMCreate: allocated j2ee_adm at 000000000815F150
DpShMCreate: allocated ca_info at 00000000081600D0
DpShMCreate: allocated wall_adm at 0000000008160160
DpCommAttachTable: attached comm table (header=000000000800D1C0/ft=000000000800D1D0)
DpSysAdmIntInit: initialize sys_adm
rdisp/test_roll : roll strategy is DP_NORMAL_ROLL
dia token check not active (6 token)
MBUF state OFF
DpCommInitTable: init table for 500 entries

Mon Jul 29 10:27:59 2013
DpRqQInit: keep protect_queue / slots_per_queue 0 / 2001 in sys_adm
rdisp/queue_size_check_value :  -> on,50,30,40,500,50,500,80
EmInit: MmSetImplementation( 2 ).
MM global diagnostic options set: 0
<ES> client 0 initializing ....
<ES> EsILock: use spinlock for locking
<ES> InitFreeList
<ES> block size is 4096 kByte.
<ES> Info: em/initial_size_MB( 8063MB) not multiple of em/blocksize_KB( 4096KB)
<ES> Info: em/initial_size_MB rounded up to 8064MB
Using implementation view
<EsNT> Using memory model view.
<EsNT> Memory Reset disabled as NT default
<ES> 2015 blocks reserved for free list.
ES initialized.
mm.dump: set maximum dump mem to 96 MB
DpVmcSetActive: set vmc state DP_VMC_NOT_ACTIVE
MPI: dynamic quotas disabled.
MPI init: pipes=4000 buffers=1279 reserved=383 quota=10%

Mon Jul 29 10:28:00 2013
rdisp/http_min_wait_dia_wp : 1 -> 1
***LOG CPS=> DpLoopInit, ICU ( 3.4 3.4 4.1) [dpxxdisp.c   1701]

Mon Jul 29 10:28:24 2013
***LOG Q0K=> DpMsAttach, mscon ( Miha-PC) [dpxxdisp.c   12514]
*** WARNING => DpMsAttach: parameter 'rdisp/tolerate_loopback_addr' is set (cf. SAP note 1054467 for details) [dpxxdisp.c   12618]
MBUF state LOADING
DpStartStopMsg: send start message (myname is >Miha-PC_NSP_00                          <)
DpStartStopMsg: start msg sent
CCMS uses Shared Memory Key 73 for monitoring.
CCMS: SemInMgt: Semaphore Management initialized by AlAttachShm_Doublestack.
CCMS: SemInit: Semaphore 38 initialized by AlAttachShm_Doublestack.
CCMS: start to initalize 3.X shared alert area (first segment).
DpMBufHwIdSet: set Hardware-ID
***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c   1296]
MBUF state ACTIVE
DpWpBlksLow: max wp blocks in queue is 800 (80 %)
MBUF component UP
DpMsgProcess: 1 server in MBUF
DpAppcBlksLow: max appc blocks in queue is 500 (50 %)

-> sapstart.log:

#####################################

SAP-R/3-Startup Program

Starting at 2013/07/29 10:27:12
Startup Profile: "\\Miha-PC\sapmnt\NSP\SYS\profile\START_DVEBMGS00_Miha-PC"
Starting Programs
(4868) Execute: C:\usr\sap\NSP\SYS\exe\uc\NTAMD64\sapcpe.EXE pf=\\Miha-PC\sapmnt\NSP\SYS\profile\NSP_DVEBMGS00_Miha-PC
(2640) Execute: C:\usr\sap\NSP\SYS\exe\uc\NTAMD64\strdbs.cmd NSP
(5012) CreateProcess: C:\usr\sap\NSP\DVEBMGS00\exe\msg_server.EXE pf=\\Miha-PC\sapmnt\NSP\SYS\profile\NSP_DVEBMGS00_Miha-PC
(5044) CreateProcess: C:\usr\sap\NSP\DVEBMGS00\exe\disp+work.EXE pf=\\Miha-PC\sapmnt\NSP\SYS\profile\NSP_DVEBMGS00_Miha-PC

-> sapstartsrv.log

######################################

trc file: "sapstartsrv.log", trc level: 0, release: "720"

pid        4264

[Thr 4228] Mon Jul 29 10:25:44 2013
SAP HA Trace: SAP Microsoft Cluster library '720 (non-EXT), patch 214, changelist 1322132' initialized
CCMS agent initialization: return code 0.
CCMS agent start: return code 0.
Initializing SAPControl Webservice
Starting AutoRestart thread
AutoRestart thread started, version check is enabled
SapSSLInit failed => https support disabled
Starting WebService Named Pipe thread
Starting WebService thread
Webservice thread started, listening on port 50013
Webservice named pipe thread started, listening on port \\.\pipe\sapcontrol_00

Miha-PC\nspadm is starting SAP System at 2013/07/29 10:27:12
SAP HA Trace: FindClusterResource: OpenCluster failed: 1060 [sapwinha.cpp, line 213]
SAP HA Trace: SAP_HA_FindSAPInstance returns: SAP_HA_FAIL [sapwinha.cpp, line 920]

-> dev_icm

####################################

trc file: "dev_icm", trc level: 1, release: "720"

sysno      00
sid        NSP
systemid   562 (PC with Windows NT)
relno      7200
patchlevel 0
patchno    212
intno      20020600
make       multithreaded, Unicode, 64 bit, optimized
profile    \\Miha-PC\sapmnt\NSP\SYS\profile\NSP_DVEBMGS00_Miha-PC
pid        2640

[Thr 4936] Mon Jul 29 10:28:00 2013
[Thr 4936] Parameter system/type has value: "ABAP"
[Thr 4936] started security log to file dev_icm_sec
[Thr 4936] ICM running on: Miha-PC.domain.ext
[Thr 4936] MtxInit: 30001 0 2
[Thr 4936] ***LOG IM1=> IcmInit, Startup (ICM&Miha-PC.domain.ext&2640&) [icxxman.c    1931]
[Thr 4936] IcmInit: listening to admin port: 65000
[Thr 4936] DpSysAdmExtCreate: ABAP is active
[Thr 4936] DpSysAdmExtCreate: VMC (JAVA VM in WP) is not active
[Thr 4936] DpIPCInit2: read dp-profile-values from sys_adm_ext
[Thr 4936] DpShMCreate: sizeof(wp_adm)  31696 (2264)
[Thr 4936] DpShMCreate: sizeof(tm_adm)  5517056 (27448)
[Thr 4936] DpShMCreate: sizeof(wp_ca_adm)  64000 (64)
[Thr 4936] DpShMCreate: sizeof(appc_ca_adm) 64000 (64)
[Thr 4936] DpCommTableSize: max/headSize/ftSize/tableSize=500/16/1384064/1384080
[Thr 4936] DpShMCreate: sizeof(comm_adm)  1384080 (2744)
[Thr 4936] DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0
[Thr 4936] DpShMCreate: sizeof(slock_adm)  0 (296)
[Thr 4936] DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0
[Thr 4936] DpShMCreate: sizeof(file_adm)  0 (80)
[Thr 4936] DpShMCreate: sizeof(vmc_adm)  0 (2152)
[Thr 4936] DpShMCreate: sizeof(wall_adm)  (41664/42896/64/192)
[Thr 4936] DpShMCreate: sizeof(gw_adm) 48
[Thr 4936] DpShMCreate: sizeof(j2ee_adm) 3952
[Thr 4936] DpShMCreate: SHM_DP_ADM_KEY  (addr: 0000000002810050, size: 7163600)
[Thr 4936] DpShMCreate: allocated sys_adm at 0000000002810060
[Thr 4936] DpShMCreate: allocated wp_adm_list at 0000000002813070
[Thr 4936] DpShMCreate: allocated wp_adm at 0000000002813260
[Thr 4936] DpShMCreate: allocated tm_adm_list at 000000000281AE40
[Thr 4936] DpShMCreate: allocated tm_adm at 000000000281AE90
[Thr 4936] DpShMCreate: allocated wp_ca_adm at 0000000002D5DDA0
[Thr 4936] DpShMCreate: allocated appc_ca_adm at 0000000002D6D7B0
[Thr 4936] DpShMCreate: allocated comm_adm at 0000000002D7D1C0
[Thr 4936] DpShMCreate: system runs without slock table
[Thr 4936] DpShMCreate: system runs without file table
[Thr 4936] DpShMCreate: allocated vmc_adm_list at 0000000002ECF060
[Thr 4936] DpShMCreate: system runs without vmc_adm
[Thr 4936] DpShMCreate: allocated gw_adm at 0000000002ECF110
[Thr 4936] DpShMCreate: allocated j2ee_adm at 0000000002ECF150
[Thr 4936] DpShMCreate: allocated ca_info at 0000000002ED00D0
[Thr 4936] DpRqQInit: use protect_queue / slots_per_queue 0 / 2001 from sys_adm
[Thr 4936] MPI: dynamic quotas disabled.
[Thr 4936] MPI init: pipes=4000 buffers=1279 reserved=383 quota=10%
[Thr 4936] CCMS: initialize CCMS Monitoring for ABAP instance with J2EE addin.
[Thr 4936] CCMS uses Shared Memory Key 73 for monitoring.
[Thr 4936] CCMS: SemInMgt: Semaphore Management initialized by AlAttachShm_Doublestack.
[Thr 4936] CCMS: SemInit: Semaphore 38 initialized by AlAttachShm_Doublestack.
[Thr 7268] IcmProxyWatchDog: proxy watchdog started
[Thr 4936] IcmCreateWorkerThreads: created worker thread 0
[Thr 4936] IcmCreateWorkerThreads: created worker thread 1
[Thr 4936] IcmCreateWorkerThreads: created worker thread 2
[Thr 4936] IcmCreateWorkerThreads: created worker thread 3
[Thr 4936] IcmCreateWorkerThreads: created worker thread 4
[Thr 4936] IcmCreateWorkerThreads: created worker thread 5
[Thr 4936] IcmCreateWorkerThreads: created worker thread 6
[Thr 4936] IcmCreateWorkerThreads: created worker thread 7
[Thr 4936] IcmCreateWorkerThreads: created worker thread 8
[Thr 4936] IcmCreateWorkerThreads: created worker thread 9
[Thr 7312] IcmMpiWatchDogThread: MPI watchdog started
[Thr 7316] IcmWatchDogThread: watchdog started
[Thr 7320] HttpISubHandlerAdd: Added handler HttpFileAccessHandler(000000000078FD70), slot=0, flags=4098) for /sap/public/icmandir/, active: 1, table 0000000001D6DED0
[Thr 7320] ISC: created 400 MB disk cache.
[Thr 7320] ISC: created 50 MB memory cache.
[Thr 7320] HttpISubHandlerAdd: Added handler HttpCacheHandler(0000000001D6FF20), slot=1, flags=12293) for /, active: 1, table 0000000001D6DED0
[Thr 7320] HttpExtractArchive: files from archive C:\usr\sap\NSP\DVEBMGS00\exe/icmadmin.SAR in directory C:/usr/sap/NSP/DVEBMGS00/data/icmandir are up to date
[Thr 7320] HttpISubHandlerAdd: Added handler HttpAdminHandler(000000000CC494D0), slot=2, flags=36869) for /sap/admin, active: 1, table 0000000001D6DED0
[Thr 7320] HttpISubHandlerAdd: Added handler HttpModHandler(000000000CC495C0), slot=3, flags=12293) for /, active: 1, table 0000000001D6DED0
[Thr 7320] CsiInit(): Initializing the Content Scan Interface
[Thr 7320]            PC with Windows NT (mt,unicode,SAP_CHAR/size_t/void* = 16/64/64)
[Thr 7320] CsiInit(): CSA_LIB = "C:\usr\sap\NSP\DVEBMGS00\exe\sapcsa.dll"
[Thr 7320] HttpISubHandlerAdd: Added handler HttpAuthHandler(000000000CC49640), slot=4, flags=12293) for /, active: 1, table 0000000001D6DED0
[Thr 7320] HttpISubHandlerAdd: Added handler HttpSAPR3Handler(000000000CC5CD00), slot=5, flags=1052677) for /, active: 1, table 0000000001D6DED0
[Thr 7320] Started service PORT=8000,PROT=HTTP,TIMEOUT=60,PROCTIMEOUT=60
[Thr 7320] Started service PORT=0,PROT=SMTP,TIMEOUT=120,PROCTIMEOUT=120

[Thr 7320] Mon Jul 29 10:28:05 2013
[Thr 7320] *** WARNING => IcmNetCheck: NiAddrToHost(10.0.0.1) took 5 seconds [icxxman.c    5634]
[Thr 7320] *** WARNING => IcmNetCheck: 1 possible network problems detected - please check the network/DNS settings [icxxman.c    5690]

[Thr 7280] Mon Jul 29 10:28:10 2013
[Thr 7280] HttpExtractArchive: files from archive C:\usr\sap\NSP\DVEBMGS00\exe/ITS.SAR in directory C:/usr/sap/NSP/DVEBMGS00/data/icmandir are up to date

[Thr 7288] Mon Jul 29 10:29:01 2013
[Thr 7288] *** WARNING => IcmCallAllSchedules: Schedule func 1 already running - avoid recursion [icxxsched.c  481]

[Thr 7272] Mon Jul 29 10:29:11 2013
[Thr 7272] *** WARNING => IcmJ2EEScheduleFunc: Cannot access "/sap/public/icman" (rc=500)- please check node in TA sicf [icxxman.c    2595]

[Thr 7304] Mon Jul 29 10:31:11 2013
[Thr 7304] *** WARNING => IcmJ2EEScheduleFunc: Cannot access "/sap/public/icman" (rc=500)- please check node in TA sicf [icxxman.c    2595]

[willi_eimler · Accepted solution]

Dear Miha,

can you please check if the table space of the abap-loads is full. The symptoms points to a full  and not expandeble database.   

Best regards

Willi Eimler

[Former Member · Accepted solution]

Where can I see that? I was searching with google but could find anything useful (I'm a begginer with SAP...).

[willi_eimler · Accepted solution]

Hi Miha,

did you ever backuped your database. I see you have a MAXDB. Did you ever backuped the log and the data area? If not your log area is full.

See

http://wiki.sdn.sap.com/wiki/display/MaxDB/Log+Area+Full

This can help you.

Best regards

Willi Eimler

[Former Member · Accepted solution]

First, many thanks to everyone who took the time to help me.

Willi Eimler was right at the end, the log area in MaxDB was full. I followed the instructions in the link and it's working now.

So, for anyone else in the same situation, what I did was:

1. I downloaded and installed the "SAP MaxDB Database Manager GUI" from http://www.sdn.sap.com/irj/scn/downloads?rid=/library/uuid/8092b159-c165-2910-958a-ea4e3e5f56cf

2. In Database manager I added a database instance (username "control", password is the same as you entered during the installation):

3. Manager then displayed that my log area is full.

4.  First I had to do a complete database backup, since it does not allow to backup logs if no database backups had been done before.

4. Then I did a log area backup with the backup wizard (Instance/Backup/Backup wizard...):

5. After that my log area was shown empty and after restart my system started working again.

What bothers me is that no logs on the SAP end showed any error on the database connection... How are we supposed to find such errors?

[willi_eimler · Accepted solution]

Hi Miha,

thanx for sharing the solution.

you can use the dbmgui (the tool you used for backup) to analyse errors on your database. Look at the dbmgui->Check->diagnostic files-> database error and database messages

best regards

Willi Eimler

[JPReyes]

This might be simple but... have you checked if your DB logs are full?....  If they are, simply do a log backup

[Former Member]

Hi Miha,

I think virtual memory may be low.Increase the size of paging file and restart the server.Hope this may work.

If not then you may have to proceed with kernal upgrade.

Regards,

Aakash Bhatter.

[Reagan]

Hello

Have you checked the dev_w0 trace file ?

What is there in it ?

Regards

RB

[Former Member]

This is the dew_w0 content:

trc file: "dev_w0", trc level: 1, release: "720"

*

*  ACTIVE TRACE LEVEL           1

*  ACTIVE TRACE COMPONENTS      all, MJ

*

M sysno      00

M sid        NSP

M systemid   562 (PC with Windows NT)

M relno      7200

M patchlevel 0

M patchno    214

M intno      20020600

M make       multithreaded, Unicode, 64 bit, optimized

M profile    \\Miha-PC\sapmnt\NSP\SYS\profile\NSP_DVEBMGS00_Miha-PC

M pid        7248

M

M  kernel runs with dp version 134000(ext=119000) (@(#) DPLIB-INT-VERSION-134000-UC)

M  length of sys_adm_ext is 588 bytes

M  ***LOG Q0Q=> tskh_init, WPStart (Workp. 0 7248) [dpxxdisp.c   1377]

I  MtxInit: 30000 0 0

M  DpSysAdmExtCreate: ABAP is active

M  DpSysAdmExtCreate: VMC (JAVA VM in WP) is not active

M  DpIPCInit2: read dp-profile-values from sys_adm_ext

M  DpShMCreate: sizeof(wp_adm)  31696 (2264)

M  DpShMCreate: sizeof(tm_adm)  5517056 (27448)

M  DpShMCreate: sizeof(wp_ca_adm)  64000 (64)

M  DpShMCreate: sizeof(appc_ca_adm) 64000 (64)

M  DpCommTableSize: max/headSize/ftSize/tableSize=500/16/1384064/1384080

M  DpShMCreate: sizeof(comm_adm)  1384080 (2744)

M  DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0

M  DpShMCreate: sizeof(slock_adm)  0 (296)

M  DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0

M  DpShMCreate: sizeof(file_adm)  0 (80)

M  DpShMCreate: sizeof(vmc_adm)  0 (2152)

M  DpShMCreate: sizeof(wall_adm)  (41664/42896/64/192)

M  DpShMCreate: sizeof(gw_adm) 48

M  DpShMCreate: sizeof(j2ee_adm) 3952

M  DpShMCreate: SHM_DP_ADM_KEY  (addr: 0000000010060050, size: 7163600)

M  DpShMCreate: allocated sys_adm at 0000000010060060

M  DpShMCreate: allocated wp_adm_list at 0000000010063070

M  DpShMCreate: allocated wp_adm at 0000000010063260

M  DpShMCreate: allocated tm_adm_list at 000000001006AE40

M  DpShMCreate: allocated tm_adm at 000000001006AE90

M  DpShMCreate: allocated wp_ca_adm at 00000000105ADDA0

M  DpShMCreate: allocated appc_ca_adm at 00000000105BD7B0

M  DpShMCreate: allocated comm_adm at 00000000105CD1C0

M  DpShMCreate: system runs without slock table

M  DpShMCreate: system runs without file table

M  DpShMCreate: allocated vmc_adm_list at 000000001071F060

M  DpShMCreate: system runs without vmc_adm

M  DpShMCreate: allocated gw_adm at 000000001071F110

M  DpShMCreate: allocated j2ee_adm at 000000001071F150

M  DpShMCreate: allocated ca_info at 00000000107200D0

M  DpShMCreate: allocated wall_adm at 0000000010720160

M  DpCommAttachTable: attached comm table (header=00000000105CD1C0/ft=00000000105CD1D0)

M  DpRqQInit: use protect_queue / slots_per_queue 0 / 2001 from sys_adm

M  rdisp/queue_size_check_value :  -> on,50,30,40,500,50,500,80

X  EmInit: MmSetImplementation( 2 ).

X  MM global diagnostic options set: 0

X  <ES> client 0 initializing ....

X  <ES> EsILock: use spinlock for locking

X  Using implementation view

X  <EsNT> Using memory model view.

M  <EsNT> Memory Reset disabled as NT default

X  ES initialized.

X  mm.dump: set maximum dump mem to 96 MB

M  DpVmcSetActive: set vmc state DP_VMC_NOT_ACTIVE

M  ThStart: taskhandler started

M  rdisp/thsend_mode : -1 -> 0

M  ThInit: initializing DIA work process W0

M 

M Tue Jul 30 09:37:21 2013

M  ThInit: running on host Miha-PC

M 

M Tue Jul 30 09:37:22 2013

M  calling db_connect ...

B  Loading DB library 'C:\usr\sap\NSP\DVEBMGS00\exe\dbsdbslib.dll' ...

B  Library 'C:\usr\sap\NSP\DVEBMGS00\exe\dbsdbslib.dll' loaded

B  Version of 'C:\usr\sap\NSP\DVEBMGS00\exe\dbsdbslib.dll' is "720.00", patchlevel (0.212)

C 

C  DBSDBSLIB : version 720.00, patch 0.212 (Make PL 0.214)

C  MAXDB shared library (dbsdbslib) patchlevels (last 10)

C    (0.212) Call TH callback after cancel (note 1692560)

C    (0.210) Init length of tablename for describe (note 1678130)

C    (0.200) Take care of warnings during database connect (note 1600066)

C    (0.117) Define a primary key on the temp tables for R3szchk (note 1606260)

C    (0.114) Support of MaxDB 7.8 and 7.9 (note 1653058)

C    (0.103) Close all lob locators at end of the transaction (note 1626591)

C    (0.101) Fix for unknown table __TABLE_SIZES_ (R3szchk) (note 1619504)

C    (0.098) Use filesystem counter for R3szchk (note 1606260)

C    (0.092) Secondary connection to HANA (note 1481256)

C    (0.089) UPDSTAT with SAPSYSTEMNAME longer as 3 characters (note 1584921)

C 

C 

C  Loading SQLDBC client runtime ...

C  SQLDBC Module  : C:\sapdb\clients\NSP\pgm\libSQLDBC77.dll

C  SQLDBC SDK     : SQLDBC.H  7.8.2    BUILD 028-121-245-008

C  SQLDBC Runtime : libSQLDBC 7.8.2    BUILD 028-121-245-008

C  SQLDBC client runtime is MaxDB 7.8.2.028 CL 245008

C  SQLDBC supports new DECIMAL interface : 1

C  SQLDBC supports VARIABLE INPUT data   : 1

C  SQLDBC supports VARIABLE OUTPUT data  : 1

C  SQLDBC supports Multiple Streams      : 1

C  SQLDBC supports LOB LOCATOR KEEPALIVE : 1

C  SQLDBC supports LOB LOCATOR COPY      : 1

C  SQLDBC supports BULK SELECT with LOBS : 1

C  SQLDBC supports BATCH STREAM          : 1

C  WARNING : TCP/IP service (sql6) in etc/services missing!

C  INFO : SQLOPT= -I 0 -t 0 -S SAPR3

C  Try to connect (DEFAULT) on connection 0 ...

C  Attach to SAP DB : Kernel    7.8.02   Build 028-121-245-008

C  Database release is SAP DB 7.8.02.028

C  INFO : Database 'NSP' instance is running on 'Miha-PC'

C  DB supports UPSERT SQL syntax : 1

C  DB supports new EXPAND syntax : 1

C  DB supports LOB locators      : 1

C  DB uses MVCC support          : 0

C  DB max. input host variables  : 2000

C  DB max. statement length      : 65535

C  UPSERT is disabled for : WBCROSSGT

C  INFO : SAP DB Packet_Size = 131072

C  INFO : SAP DB Min_Reply_Size = 4096

C  INFO : SAP DB Comm_Size = 126976

C  INFO : DBSL buffer size = 126976

C  INFO : SAP DB MaxLocks = 300000

C  INFO : Connect to DB as 'SAPNSP'

C  Command info enabled

C  Now I'm connected to MaxDB

C  00: Miha-PC-NSP, since=20130730093722, ABAP= <unknown> (0)

B  Connection 0 opened (DBSL handle 0)

C  INFO : SAP RELEASE (DB) = 702

M  ThInit: db_connect o.k.

M  ICT: exclude compression: *.zip,*.rar,*.arj,*.z,*.gz,*.tar,*.lzh,*.cab,*.hqx,*.ace,*.jar,*.ear,*.war,*.css,*.pdf,*.gzip,*.uue,*.bz2,*.iso,*.sda,*.sar,*.gif,*.png,*.swc,*.swf

I  MtxInit: 0 0 0

M  SHM_PRES_BUF   (addr: 0000000016610050, size: 4400000)

M  SHM_ROLL_AREA  (addr: 000007FFDDA80050, size: 268435456)

M  SHM_PAGING_AREA  (addr: 0000000016A50050, size: 134217728)

M  SHM_ROLL_ADM   (addr: 000000001EA60050, size: 2767448)

M  SHM_PAGING_ADM  (addr: 0000000003AD0050, size: 787488)

M  ThCreateNoBuffer  allocated 548152 bytes for 1000 entries at 0000000014710050

M  ThCreateNoBuffer  index size: 3000 elems

M  ThCreateVBAdm  allocated 30976 bytes (50 server) at 0000000002CF0050

X  EmInit: MmSetImplementation( 2 ).

X  MM global diagnostic options set: 0

X  <ES> client 0 initializing ....

X  Using implementation view

X  ES initialized.

X  mm.dump: set maximum dump mem to 96 MB

B  db_con_shm_ini:  WP_ID = 0, WP_CNT = 14, CON_ID = -1

B  dbtbxbuf: Buffer TABL  (addr: 0000000022770160, size: 30000000, end: 000000002440C4E0)

B  dbtbxbuf: Profile: max_objects = 5000, displace = 1, reorg = 1

B  dbtbxbuf: request_unit = 2000, sync_reload = 5, inval_reload = 5, parallel_penalty = 0

B  dbtbxbuf: protect_shm = 0, force_checks = 0

B  dbtbxbuf: tsize_retry = 14446080

B  dbtbxbuf: obj_entry_size = 208, nt_genkey_entry_size = 28

B  ***LOG BB0=> buffer TABL       started with length 30000000   bytes [dbtbxbuf     16909]

B  dbtbxbuf: Buffer TABLP (addr: 0000000024410160, size: 10240000, end: 0000000024DD4160)

B  dbtbxbuf: Profile: max_objects = 500, displace = 1, reorg = 1

B  dbtbxbuf: request_unit = 2000, sync_reload = 5, inval_reload = 5, parallel_penalty = 50

B  dbtbxbuf: protect_shm = 0, force_checks = 0

B  dbtbxbuf: tsize_retry = 5056000

B  dbtbxbuf: obj_entry_size = 208, nt_genkey_entry_size = 28

B  ***LOG BB0=> buffer TABLP      started with length 10240000   bytes [dbtbxbuf     16909]

B  dbtbxbuf: Reading TBX statistics:

B  dbtbxbuf: Opening C:\usr\sap\NSP\DVEBMGS00\data\tbxnew failed (No such file or directory).

B  dbtbxbuf: Renaming C:\usr\sap\NSP\DVEBMGS00\data\tbxnew to C:\usr\sap\NSP\DVEBMGS00\data\tbxstat failed (No such file or directory).

B  dbtbxbuf: 89 object entries precreated

B  dbsync[db_syinit]: shared memory successfully created and initialised, sync_adm_p = 0000000002D80050

B  dbsync[db_syinit]: Buffer synchronisation started with

B    sync_concept      = SEQ_NR

B    sendon            = 1

B    bufreftime        = 120

B    max_gap_wait_time = 60

B    ddlog_del_time    = 60

B    last_counter      = -2147476418

B    oldest_gap        = (2147483647,00000000000000)

B    time_of_last_sync = 20130730093722

B    MySysId           = 'Miha-PC             00'

B  dbexpbuf[EXP_SHB]: Aquired semaphore 35 in db_exp_init(EXP_INIT)

B  Layout of EIBUF buffer shared memory:

B  0: 1 * 4 = 4

B  1: 1 * 424 = 424

B  2: 14 * 40 = 560

B  3: 4001 * 52 = 208052

B  4: 2000 * 256 = 512000

B  5: 4001 * 8 = 32008

B  6: 1 * 200 = 200

B  7: 65 * 8 = 520

B  8: 13439 * 256 = 3440384

B  Tracing = 0, Shm Protection = 0, Force checks = 0, Recovery delay = 500000

B  dbexpbuf: Buffer EIBUF (addr: 0000000024DE0170, size: 4194304, end: 00000000251E0170)

B  ***LOG BB0=> buffer EIBUF      started with length 4096k      bytes [dbexpbuf     2312]

B  dbexpbuf[EXP_SHB]: semaphore 35 released in db_exp_init

B  dbexpbuf[EXP_SHM]: Aquired semaphore 56 in db_exp_init(EXP_INIT)

B  Layout of ESM   buffer shared memory:

B  0: 1 * 4 = 4

B  1: 1 * 424 = 424

B  2: 14 * 40 = 560

B  3: 4001 * 52 = 208052

B  4: 2000 * 256 = 512000

B  5: 4001 * 8 = 32008

B  6: 1 * 200 = 200

B  7: 65 * 8 = 520

B  8: 13439 * 256 = 3440384

B  Tracing = 0, Shm Protection = 0, Force checks = 0, Recovery delay = 500000

B  dbexpbuf: Buffer ESM   (addr: 00000000251F0170, size: 4194304, end: 00000000255F0170)

B  ***LOG BB0=> buffer ESM        started with length 4096k      bytes [dbexpbuf     2312]

B  dbexpbuf[EXP_SHM]: semaphore 56 released in db_exp_init

B  dbexpbuf[EXP_CUA]: Aquired semaphore 30 in db_exp_init(EXP_INIT)

B  Layout of CUA   buffer shared memory:

B  0: 1 * 4 = 4

B  1: 1 * 424 = 424

B  2: 14 * 40 = 560

B  3: 3001 * 52 = 156052

B  4: 1500 * 256 = 384000

B  5: 3001 * 8 = 24008

B  6: 1 * 200 = 200

B  7: 193 * 8 = 1544

B  8: 4892 * 512 = 2504704

B  Tracing = 0, Shm Protection = 0, Force checks = 0, Recovery delay = 500000

B  dbexpbuf: Buffer CUA   (addr: 0000000025600170, size: 3072000, end: 00000000258EE170)

B  ***LOG BB0=> buffer CUA        started with length 3000k      bytes [dbexpbuf     2312]

B  dbexpbuf[EXP_CUA]: semaphore 30 released in db_exp_init

B  dbexpbuf[EXP_OTR]: Aquired semaphore 55 in db_exp_init(EXP_INIT)

B  Layout of OTR   buffer shared memory:

B  0: 1 * 4 = 4

B  1: 1 * 424 = 424

B  2: 14 * 40 = 560

B  3: 4001 * 52 = 208052

B  4: 2000 * 256 = 512000

B  5: 4001 * 8 = 32008

B  6: 1 * 200 = 200

B  7: 81 * 8 = 648

B  8: 13439 * 256 = 3440384

B  Tracing = 0, Shm Protection = 0, Force checks = 0, Recovery delay = 500000

B  dbexpbuf: Buffer OTR   (addr: 00000000258F0170, size: 4194304, end: 0000000025CF0170)

B  ***LOG BB0=> buffer OTR        started with length 4096k      bytes [dbexpbuf     2312]

B  dbexpbuf[EXP_OTR]: semaphore 55 released in db_exp_init

B  ***LOG BB0=> buffer CALE       started with length 500000     bytes [dbcalbuf     2211]

B  dbtran INFO (init_connection '<DEFAULT>' [ADABAS D:720.00]):

B   max_blocking_factor       =  10,  min_blocking_factor         =  10,

B   max_in_blocking_factor    = 127,  min_in_blocking_factor      = 127,

B   max_union_blocking_factor =  10,  min_union_blocking_factor   =  10,

B   prefer_union_all          =   1,  prefer_join                 =   0,

B   prefer_fix_blocking       =   0,  prefer_in_itab_opt          =   1,

B   convert AVG               =   0,  alias table FUPD            =   0,

B   escape_as_literal         =   0,                                  

B   select *                  =0x0f,  character encoding          = STD / <none>:-,

B   use_hints                 = abap->1, dbif->0x1, upto->4294967295

M  SecAudit(rsauinit): Start init of Security Audit Log for first wp.

M  SecAudit(rsauinit): New shared memory created and attached, size = 19488.

M  SecAudit(RsauShmInit): addr of SHM for Audit.... = 0000000002D90050

M  SecAudit(RsauShmInit): addr of RSAUSHM.......... = 0000000002D91050

M  SecAudit(RsauShmInit): addr of RSAUSLOTINFO..... = 0000000002D91660

M  SecAudit(RsauShmInit): addr of RSAUSLOTS........ = 0000000002D91670

M  SecAudit(RsauShmInit): SHM version.............. = 6

M  SecAudit(RsauShmInit): max size of one file..... = 0 KB

M  SecAudit(RsauShmInit): max size of all files.... = 102400 KB

M  SecAudit(RsauShmInit): number of slots available = 90

M  SecAudit(RsauShmInit): number of slots requested = 2

M  SecAudit(RsauShmInit): user selection........... = 0

M  SecAudit(RsauGetCurrentProfile): Init of shared memory completed

M  SecAudit(RsauGetCurrentProfile): Security Audit Log not active

M  SsfSapSecin: automatic application server initialization for SAPSECULIB

N  SsfSapSecin: Looking for PSE in database

N  SsfPseLoad: started...(path=C:\usr\sap\NSP\DVEBMGS00\sec, AS=Miha-PC, instanceid=00)

N  SsfPseLoad: Downloading file C:\usr\sap\NSP\DVEBMGS00\sec\SAPSYS.pse (client:    , key: SYSPSE, len: 2661)

N  SsfPseLoad: ended (1 of 1 sucessfully loaded, 1 checked...

N  MskiCreateLogonTicketCache: Logon Ticket cache created in shared memory.

N  MskiCreateLogonTicketCache: Logon Ticket cache pointer registered in shared memory.

N  SignInitOnce: Security Context Cache created (max. 2500 entries, 1305600 bytes)

N  No SEC_CONTEXT_COPY records found for deletion

[Manas_Vincit]

Hi Miha ,

As Soft cancel Paramter did not help , Could you please try with Upgrade Kernel to latest (with disp+work  Latest ) and check if same issue exists . Semaphore is generally kernel Problem and generally resolve by Kernel Upgrade .

we faced such issue in production and SAP suggested the same , althrough we did not have such permanant issue .

Thanks

Manas Behra

[Former Member]

It looks like your system is running on Windows.  You can see the work process overview (SM50) in the SAP management console as well.  Take a look and see what your work processes are doing.  A screen shot will be helpful, if you don't know what to do about it.

[Former Member]

Hi Miha,

Looking at your issue-description --> "but  then stopped again in the process of compiling some other SAP transaction (not the same one as before)", I suspect there were some error during installation, or at least the ABAP-generation phase is not done properly.

But you need to solve your "Dialog Queue standstill" first, search for the root-cause.

Please restart your SAP system and directly check via transaction SM50 what is the activity of your DIALOG and Background work-process?

If you see that all DIALOG work-process are occupied, then you might add this amount.

Also check your filesystems, if some filesystems are full (eg database), this may also caused for a SAP standstill.

After you solved this issue, to solve your "compiling issue", please run SGEN as a job. Please see: http://help.sap.com/saphelp_470/helpdata/en/b1/52583c65399965e10000000a114084/content.htm

I hope this will help you.

Regards,

Andre

[Former Member]

I can't run SM50 because I can't even connect to the systemwith SAP GUI. Or is there something else you had in mind?

[Former Member]

Hi Miha,

Then try to execute "dpmon" from the command-line as user nspadm, and look for th emenu with "long process table", it will give you the same overview as SM50, but now without logging on SAP GUI.

Regards,

Andre

[Former Member]

Is this it?

Also, from MMC, if it helps:

[Former Member]

Hi Miha,

Yes, but you need to collect a couple of screenshots of dpmon from the restart of you SAP system when everything still green on your MMC till they becoming yellow.

Also I'm curious on those "red-alerts" on your MMC "Current Status", exactly as you did when the MMC process becoming yellow, but you need to drill-down further, for example click on the ""Aborted Jobs". Please repeat this also for the other red-alert (InstanceAsTask and Operating System).

Please copy-n-paste to a Word doc and attach it to your next thread, so you don't have a long thread.

Thanks.

Regards,

Andre

[Manas_Vincit]

Hi Miha,

as looking at screenshot , seems all work process went in Semaphore 10 , so restarting helps in solving this issue . I checked dev_w* logs and paramter set is rdisp/softcancel_sequence :  -> 0,5,-1

as per note Note 1728922 - Race condition in soft cancel

You can set this paramter and check if this will help in resolution .

rdisp/softcancel_sequence = 0,60,-1

Also this type of issue resolve by Updating the kernel and above paramter is just a workaround .

Please let us know if this helped .

Thanks

Manas Behra

[Former Member]

The dpmon screen shot shows that all your work processes are still in start-up mode ("New") and waiting for semaphore 10, which means "GW request".  Looks like some problem with the gateway.  Have you checked log dev_gw?

[Former Member]

There is no file dev_gw inside C:\usr\sap\NSP\DVEBMGS00\work. Should I be looking somewhere else?

[Former Member]

I have tried the rdisp/softcancel_sequence parameter and it does not help. I am attaching the dev_w* files

dev_w0.zip

dev_w1.zip

dev_w2.zip

[Former Member]

2. part

dev_w4.zip

dev_w5.zip

dev_w3.zip

[Former Member]

3. part

dev_w7.zip

dev_w8.zip

dev_w9.zip

[Former Member]

I am attaching the screenshots, it seems the status of the services in dpmon does not change at all...

https://dl.dropboxusercontent.com/u/13052490/problems.docx

[Reagan]

It is not dev_gw. The gateway trace is dev_rd

Regards

RB

[Former Member]

Hi Miha,

Thanks for the screenshots.

I can see that there is a short of memory (lots of paging), so you need to check what is your Physical Memory (RAM) and what did you allocate to SAP during installation. It seems SAP has not enough memory to even startup those workprocesses.

Please check this: http://help.sap.com/saphelp_nw04/helpdata/EN/84/7ed384d81f11d188be0000e83539c3/content.htm

Then you can click on Memory Management under Windows, then see an example of

Parameter Overview for Windows.

Also check your swap-space: http://help.sap.com/saphelp_nw04/helpdata/EN/02/9625e3538111d1891b0000e8322f96/content.htm

I hope this will help you.

Regards,

Andre

[Former Member]

My system has 8GB or RAM and I assigned 32000 MB to the paging file. Also in the past month it was working, even when I was running an additional virtual machine with SAP Portal, so I think RAM should not be an issue

[Former Member]

I am attaching the dev_rd log

dev_rd.zip

[Reagan]

Hello

Have a look at this SAP KBA

1872990  - various error messages related to incorrect resolution of localhost

Not sure whether it helps in your case but you can give it it a shot.

Also check the message server trace (dev_ms)

Regards

RB

[Former Member]

Ok, I agree with Juan Reyes, this might be DB-logs or DB-tablespace full or DB-archive full issue, because everything worked fine before.

[Former Member]

Hi,

Check your DNS settings on your server/network card.

*** WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 5 seconds

***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c  6423]

Can you ping the servername or only the IP address?

If as you say on your local windows pc you probably have to add dns entry somewhere if it is a virtual machine you will have to check this or provide more details on exact setup.

Regards

Johan

[Former Member]

I can ping both, I have added the server name in hosts file before the installation. The installation is local not virtual.

[Former Member]

Hi,

Have you changed any instance profile parameter before taking restart ? if yes, then restore the old backed-up profile & if not there may be chance of kernel inconsistency, so upgrade kernel and you can check. generally this sort out most of the start-up issue.

In case you still get issue even after following above procedure, then provide corresponding logs of WORK directory .

Regards,

Nilutpal.

[Former Member]

I haven't changed any parameters, the last time I changed anything in profile was weeks ago and I have restarted the system several times since then without any issues.

I'm not sure upgrade-ing the kernel is an option for me, since I don't have access to SAP Marketplace download section (I have looked at some tutorials on how to do the upgrade, but keep in mind i'm just a beginner in SAP...)

[AtulKumarJain]

Hi Miha,

Please check  SAP Note No. 544533

http://scn.sap.com/thread/915503

http://scn.sap.com/thread/424815

BR

Atul

[Former Member]

Hi Miha,

             Stop the SAP instance , then restart the Windows server.

            It will help.

Thanks and Regards,

Kunal Gahlot

[Former Member]

I have tried to restart the machine several times, but it did not help...