java dispatcher down

[former_member246694]

Dear All,

When Im trying to start the Java instance , the following error is coming

pspdsmndb:smnadm 154> jcmon pf=/usr/sap/SMN/SYS/profile/SMN_DVEBMGS02_pspdsolehp

[Thr 1] MtxInit: -2 0 0

============================================================

JControl Monitor Program - Main Menu

============================================================

0 : exit

-

---

10 : Cluster Administration Menu

-

---

20 : Local Administration Menu

-

---

30 : Shared Memory Menu (Solid Rock, experimental)

-

---

command => 20

Can't open shared memory administration (rc = 3)

Also fYI,

Previously we have 2 servers(CI(pspdsolehp) & DB(pspdsmndb)) and

worked on cluster mode .

Now it is working on one node that is DB Node . DB Node host name is

PSPDSMNDB .

All mount point are available in DB Host . ABAP Stack is working fine

But JAVA DISPATCHER is stopped .

Im not an expert on Java stack.Pls guide me .

Thanks n regards,

Anees

Edited by: Anees Qureshy on Aug 27, 2010 2:19 PM

[Former Member]

This seems to be a typical senario in which you do not start your JAVA instance and try to access it through JCMON.

Make sure that your JAVA instance is running before executing jcmon.

[Former Member]

Hi , Please provide more information from work directory dev_disp

Regards

Kannan

[former_member246694]

The following is trace from /usr/sap/SMN/DVEBMGS02/j2ee/cluster/dispatcher/log --> defaultrace.0.trc

#1.5^H#00145E76D4D0000C00000001000A905200048628A528A65A#1273409034561#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monito

r.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_28##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/ActiveThreadsCount>: com.sa

p.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/ActiveThreads

Count' (MANAGERS.SThreadPool.ActiveThreadsCount.Disp, max. 40 characters)#

#1.5^H#00145E76D4D0000C00000002000A905200048628A528D550#1273409034573#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monito

r.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_28##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/WaitingTasksCount>: com.sap

.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/WaitingTasksCo

unt' (MANAGERS.SThreadPool.WaitingInRequestQueueCount.Disp, max. 40 characters)#

#1.5^H#00145E76D4D0000C00000003000A905200048628A528DEB0#1273409034575#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monito

r.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_28##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/WaitingTasksQueueSize>: com

.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/WaitingTas

ksQueueSize' (MANAGERS.SThreadPool.RequestQueueSize.Disp, max. 40 characters)#

#1.5^H#00145E76D4D0000C00000004000A905200048628A528E39B#1273409034576#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monito

r.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_28##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/WaitingTasksQueueOverflow>:

com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/Waitin

gTasksQueueOverflow' (MANAGERS.SThreadPool.Waiting4FreeReqQueueSlotCount.Disp, max. 40 characters)#

#1.5^H#00145E76D4D0001A000000000014E02800048629B0A01A40#1273413521904#com.sap.engine.services.monitor.dispatcher.MonitorDispatcherFrame##com.sap.engin

e.services.monitor.dispatcher.MonitorDispatcherFrame.registerSAPOsColTemplates()#######SAPEngine_System_Thread[impl:6]_24##0#0#Error#1#/System#Java###

Could not create template file for monitoring via SapOsCol engine processes.

[EXCEPTION]

#2#com.sap.engine.services.monitor.dispatcher.MonitorDispatcherFrame@42b542b5#java.lang.Exception: Could not create SAPOsCol template file. /usr/s

ap/tmp/procmon/J2EE_SMN_02_procmon.ini (A file or directory in the path name does not exist.)

at com.sap.engine.services.monitor.dispatcher.MonitorDispatcherFrame.registerSAPOsColTemplates(MonitorDispatcherFrame.java:195)

at com.sap.engine.services.monitor.dispatcher.MonitorDispatcherFrame.start(MonitorDispatcherFrame.java:70)

at com.sap.engine.frame.CommunicationFrameAdaptor.start(CommunicationFrameAdaptor.java:31)

at com.sap.engine.core.service630.container.ServiceRunner.startCommunicationServiceFrame(ServiceRunner.java:228)

at com.sap.engine.core.service630.container.ServiceRunner.run(ServiceRunner.java:158)

at com.sap.engine.frame.core.thread.Task.run(Task.java:64)

at com.sap.engine.core.thread.impl6.SingleThread.execute(SingleThread.java:82)

at com.sap.engine.core.thread.impl6.SingleThread.run(SingleThread.java:154)

Also

#

#1.#00145E768908001800000002000F80FA0004862E5A671781#1273433550159#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monitor.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_17##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/ActiveThreadsCount>: com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/ActiveThreadsCount' (MANAGERS.SThreadPool.ActiveThreadsCount.Disp, max. 40 characters)#

#1.#00145E768908001800000003000F80FA0004862E5A6727F6#1273433550169#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monitor.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_17##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/WaitingTasksCount>: com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/WaitingTasksCount' (MANAGERS.SThreadPool.WaitingInRequestQueueCount.Disp, max. 40 characters)#

#1.#00145E768908001800000004000F80FA0004862E5A672D4A#1273433550171#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monitor.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_17##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/WaitingTasksQueueSize>: com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/WaitingTasksQueueSize' (MANAGERS.SThreadPool.RequestQueueSize.Disp, max. 40 characters)#

#1.#00145E768908001800000005000F80FA0004862E5A67325E#1273433550172#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monitor.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_17##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/WaitingTasksQueueOverflow>: com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/WaitingTasksQueueOverflow' (MANAGERS.SThreadPool.Waiting4FreeReqQueueSlotCount.Disp, max. 40 characters)#

#1.#00145E768908001E00000000000F80FA0004899525500399#1277173575975#com.sap.engine.services.rmi_p4##com.sap.engine.services.rmi_p4#######SAPEngine_System_Thread[impl:6]_10##0#0#Error##Plain###ID 011011: Cluster Manager is shut down.#

#1.#00145E768908000000000012001910F00004899631870DA5#1277178075876#System.err##System.err#######Thread[Thread-1,5,main]##0#0#Error##Plain###com.sap.engine.frame.core.configuration.ConfigurationLockedException: Cannot lock Configuration; it is already locked.

at com.sap.engine.core.configuration.impl.ServerEnvironment.addLock(ServerEnvironment.java:316)

at com.sap.engine.core.configuration.impl.ServerEnvironment.addLock(ServerEnvironment.java:340)

at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.openConfiguration(ConfigurationCache.java:756)

at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:734)

at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:693)

at com.sap.engine.core.cache.impl.spi.storage.DBStorage.<init>(DBStorage.java:64)

at com.sap.engine.core.cache.impl.CacheManagerImpl.init(CacheManagerImpl.java:223)

at com.sap.engine.core.Framework.loadSingleManager(Framework.java:582)

at com.sap.engine.core.Framework.loadManagers(Framework.java:258)

at com.sap.engine.core.Framework.start(Framework.java:190)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:85)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:58)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:60)

at java.lang.reflect.Method.invoke(Method.java:391)

at com.sap.engine.boot.FrameThread.run(FrameThread.java:61)

at java.lang.Thread.run(Thread.java:770)

Caused by: com.sap.engine.frame.core.locking.LockException: Cannot lock [2010062209111587100000pspdsmndb...................24190000, !J2EE_CONFIGURATION_MANAGER, 94d735ee/@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@, X]; it is in use by another owner. The lock collision occurred with user <internal>.

at com.sap.engine.core.locking.impl3.LockingManagerImpl.lockInternal(LockingManagerImpl.java:257)

at com.sap.engine.core.locking.AbstractLockingManagerImpl.lock(AbstractLockingManagerImpl.java:423)

at com.sap.engine.core.locking.AbstractLockingManagerImpl.lock(AbstractLockingManagerImpl.java:443)

at com.sap.engine.core.locking.ServerInternalLockingImpl.lock(ServerInternalLockingImpl.java:42)

at com.sap.engine.core.configuration.impl.ServerEnvironment.addLock(ServerEnvironment.java:312)

... 16 more

#

#1.#00145E768908000B00000001001910F0000489963222C9DA#1277178086074#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monitor.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_17##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/ActiveThreadsCount>: com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/ActiveThreadsCount' (MANAGERS.SThreadPool.ActiveThreadsCount.Disp, max. 40 characters)#

#1.#00145E768908000B00000002001910F0000489963222DD58#1277178086087#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monitor.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_17##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/WaitingTasksCount>: com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/WaitingTasksCount' (MANAGERS.SThreadPool.WaitingInRequestQueueCount.Disp, max. 40 characters)#

#1.#00145E768908000B00000003001910F0000489963222E3DE#1277178086089#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monitor.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_17##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/WaitingTasksQueueSize>: com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/WaitingTasksQueueSize' (MANAGERS.SThreadPool.RequestQueueSize.Disp, max. 40 characters)#

#1.#00145E768908000B00000004001910F0000489963222E8CB#1277178086090#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monitor.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_17##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/WaitingTasksQueueOverflow>: com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/WaitingTasksQueueOverflow' (MANAGERS.SThreadPool.Waiting4FreeReqQueueSlotCount.Disp, max. 40 characters)#

#1.#00145E768908000C000000010010201200048A0115F89ABA#1277637175046#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monitor.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_25##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/ActiveThreadsCount>: com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/ActiveThreadsCount' (MANAGERS.SThreadPool.ActiveThreadsCount.Disp, max. 40 characters)#

#1.#00145E768908000C000000020010201200048A0115F8F58B#1277637175080#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monitor.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_25##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/WaitingTasksCount>: com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/WaitingTasksCount' (MANAGERS.SThreadPool.WaitingInRequestQueueCount.Disp, max. 40 characters)#

#1.#00145E768908000C000000030010201200048A0115F8FB79#1277637175081#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monitor.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_25##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/WaitingTasksQueueSize>: com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/WaitingTasksQueueSize' (MANAGERS.SThreadPool.RequestQueueSize.Disp, max. 40 characters)#

#1.#00145E768908000C000000040010201200048A0115F900C3#1277637175083#com.sap.engine.library.monitor.mapping.ccms.Trace##com.sap.engine.library.monitor.mapping.ccms.Trace#######SAPEngine_System_Thread[impl:6]_25##0#0#Error##Plain###RegisterNode</Kernel/System Threads Pool/WaitingTasksQueueOverflow>: com.sap.engine.library.monitor.mapping.ccms.CcmsConnectorException: 24190000: Invalid configuration group for node'/Kernel/System Threads Pool/WaitingTasksQueueOverflow' (MANAGERS.SThreadPool.Waiting4FreeReqQueueSlotCount.Disp, max. 40 characters)#

#1.#00145E7689080014000000010010201200048B493488BA2E#1279046437091#com.sap.engine.services.rmi_p4##com.sap.engine.services.rmi_p4#######SAPEngine_System_Thread[impl:6]_35##0#0#Error##Plain###ID 011011: Cluster Manager is shut down.#

#1.#00145E768908001F000000000010201200048B49348941D9#1279046437126#com.sap.engine.services.rmi_p4##com.sap.engine.services.rmi_p4#######SAPEngine_System_Thread[impl:6]_12##0#0#Error##Plain###ID 011011: Cluster Manager is shut down.#

#1.#00145E7689080018000000020010201200048B4934894259#1279046437126#com.sap.engine.services.rmi_p4##com.sap.engine.services.rmi_p4#######SAPEngine_System_Thread[impl:6]_4##0#0#Error##Plain###ID 011011: Cluster Manager is shut down.#

pspdsmndb:smnadm 70> pwd

/usr/sap/SMN/DVEBMGS02/j2ee/cluster/dispatcher/log

Regards,

Anees

Edited by: Anees Qureshy on Aug 28, 2010 12:10 PM

Edited by: Anees Qureshy on Aug 28, 2010 12:11 PM