Dispatcher: Running but dialog Queue stand still, J2EE synchronization binaries, Solman

[Former Member]

Dear Experts,

We have a solution manager system  7.0 EHP1, Win 2008, Oracle 11g . It was running with no problem, suddenly dispatcher becomes yellow with the message:

Running but dialog Queue stand still, J2EE synchronization binaries .

There is no error in syslog, we have not changed anything related to kernel.

Would you kindly advice?

Here is the dev_disp log file

---------------------------------------------------

trc file: "dev_disp", trc level: 1, release: "701"

---------------------------------------------------

sysno 00

sid RSM

systemid 562 (PC with Windows NT)

relno 7010

patchlevel 0

patchno 122

intno 20020600

make: multithreaded, Unicode, 64 bit, optimized

pid 1656

Sat May 03 17:52:22 2014

kernel runs with dp version 244000(ext=110000) (@(#) DPLIB-INT-VERSION-244000-UC)

length of sys_adm_ext is 576 bytes

*** SWITCH TRC-HIDE on ***

***LOG Q00=> DpSapEnvInit, DPStart (00 1656) [dpxxdisp.c   1287]

       shared lib "dw_xml.dll" version 122 successfully loaded

       shared lib "dw_xtc.dll" version 122 successfully loaded

       shared lib "dw_stl.dll" version 122 successfully loaded

       shared lib "dw_gui.dll" version 122 successfully loaded

       shared lib "dw_mdm.dll" version 122 successfully loaded

rdisp/softcancel_sequence :  -> 0,5,-1

use internal message server connection to port 3900

Sat May 03 17:52:31 2014

*** WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 8 seconds

***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c  5534]

MtxInit: 30000 0 0

DpSysAdmExtInit: ABAP is active

DpSysAdmExtInit: VMC (JAVA VM in WP) is active

DpIPCInit2: start server >MAP-SAP-SM1_RSM_00 <

DpShMCreate: sizeof(wp_adm)       29792  (1752)

DpShMCreate: sizeof(tm_adm)       5912704       (29416)

DpShMCreate: sizeof(wp_ca_adm)           24064  (80)

DpShMCreate: sizeof(appc_ca_adm)  8000   (80)

DpCommTableSize: max/headSize/ftSize/tableSize=500/16/552064/552080

DpShMCreate: sizeof(comm_adm)            552080 (1088)

DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=512/48/65600/90416/156064

DpShMCreate: sizeof(slock_adm)           156064 (104)

DpFileTableSize: max/headSize/ftSize/tableSize=3400/16/326464/326480

DpShMCreate: sizeof(file_adm)            326480 (72)

DpShMCreate: sizeof(vmc_adm)             31696  (1864)

DpShMCreate: sizeof(wall_adm)            (41664/36752/64/192)

DpShMCreate: sizeof(gw_adm) 48

DpShMCreate: SHM_DP_ADM_KEY        (addr: 000000000BC30050, size: 7128384)

DpShMCreate: allocated sys_adm at 000000000BC30050

DpShMCreate: allocated wp_adm at 000000000BC32270

DpShMCreate: allocated tm_adm_list at 000000000BC396D0

DpShMCreate: allocated tm_adm at 000000000BC39730

DpShMCreate: allocated wp_ca_adm at 000000000C1DCFB0

DpShMCreate: allocated appc_ca_adm at 000000000C1E2DB0

DpShMCreate: allocated comm_adm at 000000000C1E4CF0

DpShMCreate: allocated slock_adm at 000000000C26B980

DpShMCreate: allocated file_adm at 000000000C291B20

DpShMCreate: allocated vmc_adm_list at 000000000C2E1670

DpShMCreate: allocated gw_adm at 000000000C2E16F0

DpShMCreate: allocated vmc_adm at 000000000C2E1720

DpShMCreate: allocated ca_info at 000000000C2E92F0

DpShMCreate: allocated wall_adm at 000000000C2E9300

MBUF state OFF

DpCommInitTable: init table for 500 entries

DpFileInitTable: init table for 3400 entries

DpSesCreateTable: created session table at 0000000002930050 (len=145632)

DpRqQInit: Parameter rdisp/queue_lock_level = 2

rdisp/queue_size_check_value :  -> on,50,30,40,500,50,500,80

ThTaskStatus: rdisp/reset_online_during_debug 0

EmInit: MmSetImplementation( 2 ).

MM global diagnostic options set: 0

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 4096 kByte.

<ES> Info: em/initial_size_MB( 8191MB) not multiple of em/blocksize_KB( 4096KB)

<ES> Info: em/initial_size_MB rounded up to 8192MB

Using implementation view

<EsNT> Using memory model view.

<EsNT> Memory Reset disabled as NT default

<ES> 2047 blocks reserved for free list.

ES initialized.

1. mm.dump: set maximum dump mem to 96 MB

Es2ResCreate: Changed resource parameters to

       filenamePrefix =

       blockSizeKB    = 1024 KB

       initialSizeMB  = 240 MB

       extendSizeMB   = 120 MB

       maxSizeMB      = 2400 MB

DpVmcInit2: o.k.

Sat May 03 17:52:32 2014

J2EE server info

  start = TRUE

  state = STARTED

  pid = 1516

argv[0] = E:\usr\sap\RSM\DVEBMGS00\exe\jcontrol.EXE

argv[1] = E:\usr\sap\RSM\DVEBMGS00\exe\jcontrol.EXE

argv[2] = pf=E:\usr\sap\RSM\SYS\profile\RSM_DVEBMGS00_MAP-SAP-SM1

argv[3] = -DSAPSTART=1

argv[4] = -DCONNECT_PORT=65000

argv[5] = -DSAPSYSTEM=00

argv[6] = -DSAPSYSTEMNAME=RSM

argv[7] = -DSAPMYNAME=MAP-SAP-SM1_RSM_00

argv[8] = -DSAPPROFILE=E:\usr\sap\RSM\SYS\profile\RSM_DVEBMGS00_MAP-SAP-SM1

argv[9] = -DFRFC_FALLBACK=ON

argv[10] = -DFRFC_FALLBACK_HOST=localhost

start_lazy = 0

start_control = SAP J2EE startup framework

DpJ2eeStart: j2ee state = STARTED

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c   1682]

***LOG Q0K=> DpMsAttach, mscon ( MAP-SAP-SM1) [dpxxdisp.c   12696]

DpStartStopMsg: send start message (myname is >MAP-SAP-SM1_RSM_00 <)

DpStartStopMsg: start msg sent

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

CCMS: Initalizing shared memory of size 60000000 for monitoring segment.

Sat May 03 17:52:34 2014

CCMS: Checking Downtime Configuration of Monitoring Segment.

CCMS: start to initalize 3.X shared alert area (first segment).

DpMsgAdmin: Set release to 7010, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c   1048]

DpMsgAdmin: Set patchno for this platform to 122

Release check o.K.

DpJ2eeLogin: j2ee state = CONNECTED

Sat May 03 19:44:21 2014

DIA water mark reached (30)

[Reagan]

Could you provide the output of this command?

sapcontrol -nr 00 -function GetProcessList

Regards

RB

[Former Member]

Hi RB,

05.05.2014 07:29:56

GetProcessList

OK

name, description, dispstatus, textstatus, starttime, elapsedtime, pid

msg_server.EXE, MessageServer, GREEN, Running, 2014 05 04 11:54:11, 19:35:45, 65

80

disp+work.EXE, Dispatcher, YELLOW, Running but Dialog Queue standstill, J2EE: Sy

nchronizing binaries, 2014 05 04 11:54:11, 19:35:45, 3888

igswd.EXE, IGS Watchdog, GREEN, Running, 2014 05 04 11:54:11, 19:35:45, 5192

Thanks

[Reagan]

and what is the status of the J2EE stack when you check using the jcmon tool ?

[Former Member]

Dear Reagan,

I am not familiar with this tool, in which menu should I check the J2EE status?

BR,

[Reagan]

jcmon pf=E:\usr\sap\RSM\SYS\profile\RSM_DVEBMGS00_MAP-SAP-SM1

select option 20 and see the status of the Dispatcher, SDM and the server nodes

This should be executed as sidadm user

[Former Member]

Hi,

Thanks for your kind attention

in #20 there is no option for dispatcher status, but here is the information it gives about process list:

command => 11

------------------------------------------------------------

SAP System Name   : RSM

SAP System        : 00

MS Host           :

MS Port           :

Process Count     : 0

PID of JControl   : 1512

State of JControl : Synchronizing binaries

State inside MS   : Synchronizing binaries

Admin URL         :

------------------------------------------------------------

|Idx|Name                |Type                |PID     |State               |Err

or|Restart|Debug|Debug|Debug |

|   |                    |                    |        |                    |Cou

nt|Mode   |Prep.|Mode |Port  |

|---|--------------------|--------------------|--------|--------------------|---

--|-------|-----|-----|------|

------------------------------------------------------------

------------------------------------------------------------

SAP System Name   : RSM

SAP System        : 00

MS Host           :

MS Port           :

Process Count     : 0

PID of JControl   : 1512

State of JControl : Synchronizing binaries

State inside MS   : Synchronizing binaries

Admin URL         :

------------------------------------------------------------

|Idx|Name               |PID     |State                |Error|Restart|

|---|-------------------|--------|---------------------|-----|-------|

------------------------------------------------------------

I it is not the one you mentioned, kindly advice,

BR,

[Former Member]

also

when I select option 20 this is the information:

command => 20

------------------------------------------------------------

SAP System Name   : RSM

SAP System        : 00

MS Host           :

MS Port           :

Process Count     : 0

PID of JControl   : 1512

State of JControl : Synchronizing binaries

State inside MS   : Synchronizing binaries

Admin URL         :

------------------------------------------------------------

|Idx|Name               |PID     |State                |Error|Restart|

|---|-------------------|--------|---------------------|-----|-------|

------------------------------------------------------------

BR,

[Sriram2009]

Hi

Could you check this SCN link

http://scn.sap.com/thread/3362718

BR

SS

[former_member185239]

Hi Salameh,

You can follow the below steps

1. reboot the server(sometimes this resolve the issue)

2. upgrade the kernel

With Regards

Ashutosh Chaturvedi

[Former Member]

Hi,

We have done it, rebooting the server and service both. but it didn't work.

Thanks for your reply.

[Sriram2009]

Hi Salameh

1.  Could you check the free disk space in USR & DB folders?

2. Refer the SAP Note Error msg "DIA water mark reached (30)"

1148690 - DIA water mark reached, DIA water mark underrun

BR

SS

[Former Member]

Hi SS,

1. USR and DB are on the same partition with 193GB free space.

2. let me check

3. I have ORA-00600, ORA-00028, ORA-00494 in oracle alert  log file.

Thanks for your reply.

[Sriram2009]

Hi

What is the version of Oracle? could you apply the latest SAP patches

BR

SS

[Former Member]

Hi,

2. It says to:

Remove the profile parameter rdisp/queue_size_check_val from ALL profiles or apply at least patch level 153.

I checked and i don't have this parameter in my profiles and right now i cannot upgrade the kernel.

My oracle 11g is: 11.2.0.1.0

WR

[Sriram2009]

Hi

Check this SAP notes

1918130 - ORA-00600 [ktspstchg-1]

1656659 - GI 11.2.0: Patches / Patch Collections for 11.2.0.3

1597736 - GI 11.2.0: Patches / Patch Collections for 11.2.0.2

BR

SS