Restart of J2EE Engine

[Former Member]

Hi SDN,

We have installed a new nw04s SP13 sytem.

when I log into portal and select webdynpro Iview the J2EE is getting restarted with following error message :

SAP WebAS Engine is starting...

If this state does not change within a few minutes..

please contact your system administrator.

Check the recommendations in SAP Notes: 943498, 764417

Message: Dispatcher running but no server connected!

Details: No details available

Developer trace file

[Thr 4148] JLaunchIExitJava: exit hook is called (rc = 666)

[Thr 4148] **********************************************************************

ERROR => The Java VM terminated with a non-zero exit code.

Please see SAP Note 943602 , section 'J2EE Engine exit codes'

for additional information and trouble shooting.

**********************************************************************

[Thr 4148] JLaunchCloseProgram: good bye (exitcode = 666)

Sytem details:

NW04s sp13

javaVMVersion=1.4.2_17, 64-Bit Server VM

Can someone suggest me how I can fix this.

Best regards,

Raj

[Former Member · Accepted solution]

Hi

Increase your Heap Memory (See Note 723909).

Paste only the text relevant to the 'ERROR' from the following logs :

dev_jcontrol

dev_server0

dev_bootstrap

Cheers

Shaji

[Former Member · Accepted solution]

Hi Graham and Shaji ,

I have already increased the heap size to 2GB(as recommended for 64 bit platforms), but still the j2ee engine is getting restarted with OutOfMemoryError.Below you can find the dev_server0 and dev_bootstrap trace files.

trc file: "C:\usr\sap\N01\DVEBMGS00\work\dev_server0", trc level: 1, release: "700"

-

---

node name : ID9663650

pid : 3776

system name : N01

system nr. : 00

started at : Tue Apr 01 01:29:48 2008

arguments :

arg[00] : C:\usr\sap\N01\DVEBMGS00\exe\jlaunch.exe

arg[01] : pf=C:\usr\sap\N01\SYS\profile\N01_DVEBMGS00_sipro11

arg[02] : -DSAPINFO=N01_00_server

arg[03] : pf=C:\usr\sap\N01\SYS\profile\N01_DVEBMGS00_sipro11

arg[04] : -DSAPSTART=1

arg[05] : -DCONNECT_PORT=3399

arg[06] : -DSAPSYSTEM=00

arg[07] : -DSAPSYSTEMNAME=N01

arg[08] : -DSAPMYNAME=sipro11_N01_00

arg[09] : -DSAPPROFILE=C:\usr\sap\N01\SYS\profile\N01_DVEBMGS00_sipro11

arg[10] : -DFRFC_FALLBACK=ON

arg[11] : -DFRFC_FALLBACK_HOST=localhost

[Thr 4292] Tue Apr 01 01:29:48 2008

[Thr 4292] *** WARNING => INFO: Unknown property [instance.box.number=N01DVEBMGS00sipro11] [jstartxx.c 841]

[Thr 4292] *** WARNING => INFO: Unknown property [instance.en.host=sipro11] [jstartxx.c 841]

[Thr 4292] *** WARNING => INFO: Unknown property [instance.en.port=3201] [jstartxx.c 841]

[Thr 4292] *** WARNING => INFO: Unknown property [instance.system.id=0] [jstartxx.c 841]

**********************************************************************

JStartupReadInstanceProperties: read instance properties [C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties]

-> ms host : sipro11

-> ms port : 3901

-> OS libs : C:\usr\sap\N01\DVEBMGS00\j2ee\os_libs

-> Admin URL :

-> run mode : normal

-> run action : NONE

-> enabled : yes

**********************************************************************

**********************************************************************

Used property files

-> files [00] : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties

**********************************************************************

**********************************************************************

Instance properties

-> ms host : sipro11

-> ms port : 3901

-> os libs : C:\usr\sap\N01\DVEBMGS00\j2ee\os_libs

-> admin URL :

-> run mode : normal

-> run action : NONE

-> enabled : yes

**********************************************************************

**********************************************************************

Bootstrap nodes

-> [00] bootstrap : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties

-> [01] bootstrap_ID9663600 : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties

-> [02] bootstrap_ID9663650 : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties

**********************************************************************

**********************************************************************

Worker nodes

-> [00] ID9663600 : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties

-> [01] ID9663650 : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties

**********************************************************************

[Thr 4292] JLaunchRequestQueueInit: create named pipe for ipc

[Thr 4292] JLaunchRequestQueueInit: create pipe listener thread

[Thr 3792] JLaunchRequestFunc: Thread 3792 started as listener thread for np messages.

[Thr 364] WaitSyncSemThread: Thread 364 started as semaphore monitor thread.

[Thr 4292] NiInit3: NI already initialized; param 'maxHandles' ignored (1;202)

[Thr 4292] CPIC (version=700.2006.09.13)

[Thr 4292] [Node: server0] java home is set by profile parameter

Java Home: C:\j2sdk1.4.2_17-x64\

[Thr 4292] JStartupICheckFrameworkPackage: can't find framework package C:\usr\sap\N01\DVEBMGS00\exe\jvmx.jar

**********************************************************************

JStartupIReadSection: read node properties [ID9663650]

-> node name : server0

-> node type : server

-> node execute : yes

-> jlaunch parameters :

-> java path : C:\j2sdk1.4.2_17-x64\

-> java parameters : -Djco.jarm=1 -XX:MaxPermSize=256M -XX:PermSize=256M -XX:NewSize=171M -XX:MaxNewSize=171M -XX:DisableExplicitGC -verbose:gc -Xloggc:GC.log -XX:PrintGCDetails -XX:+PrintGCTimeStamps -Djava.awt.headless=true -Dsun.io.useCanonCaches=false -XX:SoftRefLRUPolicyMSPerMB=1 -XX:SurvivorRatio=2 -XX:TargetSurvivorRatio=90 -Djava.security.policy=./java.policy -Djava.security.egd=file:/dev/urandom -Dorg.omg.CORBA.ORBClass=com.sap.engine.system.ORBProxy -Dorg.omg.CORBA.ORBSingletonClass=com.sap.engine.system.ORBSingletonProxy -Djavax.rmi.CORBA.PortableRemoteObjectClass=com.sap.engine.system.PortableRemoteObjectProxy -Dorg.omg.PortableInterceptor.ORBInitializerClass.com.sap.engine.services.ts.jts.ots.PortableInterceptor.JTSInitializer

-> java vm version : 1.4.2_17-b06

-> java vm vendor : Java HotSpot(TM) 64-Bit Server VM (Sun Microsystems Inc.)

-> java vm type : server

-> java vm cpu : amd64

-> heap size : 2048M

-> init heap size : 2048M

-> root path : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\server0

-> class path : .\bin\boot\boot.jar;.\bin\boot\jaas.jar;.\bin\system\bytecode.jar;.

-> OS libs path : C:\usr\sap\N01\DVEBMGS00\j2ee\os_libs

-> main class : com.sap.engine.boot.Start

-> framework class : com.sap.bc.proj.jstartup.JStartupFramework

-> registr. class : com.sap.bc.proj.jstartup.JStartupNatives

-> framework path : C:\usr\sap\N01\DVEBMGS00\exe\jstartup.jar;C:\usr\sap\N01\DVEBMGS00\exe\jvmx.jar

-> shutdown class : com.sap.engine.boot.Start

-> parameters :

-> debuggable : no

-> debug mode : no

-> debug port : 50021

-> shutdown timeout : 120000

**********************************************************************

[Thr 4292] JLaunchISetDebugMode: set debug mode [no]

[Thr 4000] JLaunchIStartFunc: Thread 4000 started as Java VM thread.

[Thr 4000] [JHVM_PrepareVMOptions] use java parameters set by profile parameter

Java Parameters: -Xss2m

**********************************************************************

JHVM_LoadJavaVM: VM Arguments of node [server0]

-> stack : 1048576 Bytes

-> arg[ 0]: exit

-> arg[ 1]: abort

-> arg[ 2]: vfprintf

-> arg[ 3]: -Djco.jarm=1

-> arg[ 4]: -XX:MaxPermSize=256M

-> arg[ 5]: -XX:PermSize=256M

-> arg[ 6]: -XX:NewSize=171M

-> arg[ 7]: -XX:MaxNewSize=171M

-> arg[ 8]: -XX:+DisableExplicitGC

-> arg[ 9]: -verbose:gc

-> arg[ 10]: -Xloggc:GC.log

-> arg[ 11]: -XX:+PrintGCDetails

-> arg[ 12]: -XX:+PrintGCTimeStamps

-> arg[ 13]: -Djava.awt.headless=true

-> arg[ 14]: -Dsun.io.useCanonCaches=false

-> arg[ 15]: -XX:SoftRefLRUPolicyMSPerMB=1

-> arg[ 16]: -XX:SurvivorRatio=2

-> arg[ 17]: -XX:TargetSurvivorRatio=90

-> arg[ 18]: -Djava.security.policy=./java.policy

-> arg[ 19]: -Djava.security.egd=file:/dev/urandom

-> arg[ 20]: -Dorg.omg.CORBA.ORBClass=com.sap.engine.system.ORBProxy

-> arg[ 21]: -Dorg.omg.CORBA.ORBSingletonClass=com.sap.engine.system.ORBSingletonProxy

-> arg[ 22]: -Djavax.rmi.CORBA.PortableRemoteObjectClass=com.sap.engine.system.PortableRemoteObjectProxy

-> arg[ 23]: -Dorg.omg.PortableInterceptor.ORBInitializerClass.com.sap.engine.services.ts.jts.ots.PortableInterceptor.JTSInitializer

-> arg[ 24]: -Dsys.global.dir=C:\usr\sap\N01\SYS\global

-> arg[ 25]: -Dapplication.home=C:\usr\sap\N01\DVEBMGS00\exe

-> arg[ 26]: -Djava.class.path=C:\usr\sap\N01\DVEBMGS00\exe\jstartup.jar;C:\usr\sap\N01\DVEBMGS00\exe\jvmx.jar;.\bin\boot\boot.jar;.\bin\boot\jaas.jar;.\bin\system\bytecode.jar;.

-> arg[ 27]: -Djava.library.path=C:\j2sdk1.4.2_17-x64
jre\bin\server;C:\j2sdk1.4.2_17-x64
jre\bin;C:\j2sdk1.4.2_17-x64
bin;C:\usr\sap\N01\DVEBMGS00\j2ee\os_libs;C:\oracle\N01\102\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Files\Intel\DMIX;C:\usr\sap\N01\SYS\exe\uc\NTAMD64

-> arg[ 28]: -Dmemory.manager=2048M

-> arg[ 29]: -Xmx2048M

-> arg[ 30]: -Xms2048M

-> arg[ 31]: -DLoadBalanceRestricted=no

-> arg[ 32]: -Djstartup.mode=JCONTROL

-> arg[ 33]: -Djstartup.ownProcessId=3776

-> arg[ 34]: -Djstartup.ownHardwareId=G1244646877

-> arg[ 35]: -Djstartup.whoami=server

-> arg[ 36]: -Djstartup.debuggable=no

-> arg[ 37]: -Xss2m

-> arg[ 38]: -DSAPINFO=N01_00_server

-> arg[ 39]: -DSAPSTART=1

-> arg[ 40]: -DCONNECT_PORT=3399

-> arg[ 41]: -DSAPSYSTEM=00

-> arg[ 42]: -DSAPSYSTEMNAME=N01

-> arg[ 43]: -DSAPMYNAME=sipro11_N01_00

-> arg[ 44]: -DSAPPROFILE=C:\usr\sap\N01\SYS\profile\N01_DVEBMGS00_sipro11

-> arg[ 45]: -DFRFC_FALLBACK=ON

-> arg[ 46]: -DFRFC_FALLBACK_HOST=localhost

-> arg[ 47]: -DSAPSTARTUP=1

-> arg[ 48]: -DSAPSYSTEM=00

-> arg[ 49]: -DSAPSYSTEMNAME=N01

-> arg[ 50]: -DSAPMYNAME=sipro11_N01_00

-> arg[ 51]: -DSAPDBHOST=sipro11

-> arg[ 52]: -Dj2ee.dbhost=sipro11

**********************************************************************

Tue Apr 01 01:29:49 2008

CompilerOracle: exclude com/sapportals/portal/pb/layout/taglib/ContainerTag addIviewResources

CompilerOracle: exclude com/sap/engine/services/keystore/impl/security/CodeBasedSecurityConnector getApplicationDomain

CompilerOracle: exclude com/sap/engine/services/rmi_p4/P4StubSkeletonGenerator generateStub

CompilerOracle: exclude com/sapportals/portal/prt/util/StringUtils escapeToJS

CompilerOracle: exclude com/sapportals/portal/prt/core/broker/PortalServiceItem startServices

CompilerOracle: exclude com/sap/engine/services/webservices/server/deploy/WSConfigurationHandler downloadFile

CompilerOracle: exclude com/sapportals/portal/prt/jndisupport/util/AbstractHierarchicalContext lookup

CompilerOracle: exclude com/sapportals/portal/navigation/cache/CacheNavigationNode getAttributeValue

CompilerOracle: exclude com/sapportals/portal/navigation/TopLevelNavigationiView PrintNode

CompilerOracle: exclude com/sapportals/wcm/service/ice/wcm/ICEPropertiesCoder encode

CompilerOracle: exclude com/sap/lcr/pers/delta/importing/ObjectLoader loadObjects

CompilerOracle: exclude com/sap/engine/services/webservices/jaxrpc/encoding/InstanceBuilder readElement

CompilerOracle: exclude com/sap/engine/services/webservices/jaxrpc/encoding/InstanceBuilder readSequence

CompilerOracle: exclude com/sap/engine/services/webservices/jaxrpc/encoding/TypeMappingImpl initializeRelations

CompilerOracle: exclude com/sap/engine/services/webservices/jaxrpc/encoding/GeneratedComplexType _loadInto

[Thr 4000] JHVM_LoadJavaVM: Java VM created OK.

**********************************************************************

JHVM_BuildArgumentList: main method arguments of node [server0]

**********************************************************************

[Thr 2720] Tue Apr 01 01:29:50 2008

[Thr 2720] JHVM_RegisterNatives: registering methods in com.sap.bc.krn.perf.PerfTimes

[Thr 2720] JHVM_RegisterNatives: registering methods in com.sap.bc.proj.jstartup.JStartupFramework

[Thr 2720] JLaunchISetClusterId: set cluster id 9663650

[Thr 2720] Tue Apr 01 01:29:51 2008

[Thr 2720] JLaunchISetState: change state from [Initial (0)] to [Waiting for start (1)]

[Thr 2720] JLaunchISetState: change state from [Waiting for start (1)] to [Starting (2)]

[Thr 6044] Tue Apr 01 01:30:14 2008

[Thr 6044] JHVM_RegisterNatives: registering methods in com.sap.mw.rfc.driver.CpicDriver

[Thr 6044] JHVM_RegisterNatives: registering methods in com.sap.i18n.cp.ConverterJNI

[Thr 6044] JHVM_RegisterNatives: registering methods in com.sap.mw.rfc.engine.Compress

[Thr 3008] Tue Apr 01 01:30:19 2008

[Thr 3008] JHVM_RegisterNatives: registering methods in com.sap.security.core.server.vsi.service.jni.VirusScanInterface

[Thr 2720] Tue Apr 01 01:30:26 2008

[Thr 2720] JLaunchISetState: change state from [Starting (2)] to [Starting applications (10)]

Tue Apr 01 01:30:46 2008

Excluding compile: com.sap.engine.services.webservices.jaxrpc.encoding.TypeMappingImpl::initializeRelations

Tue Apr 01 01:32:24 2008

Excluding compile: com.sapportals.portal.prt.jndisupport.util.AbstractHierarchicalContext::lookup

[Thr 408] Tue Apr 01 01:32:50 2008

[Thr 408] JHVM_RegisterNatives: registering methods in com.sap.bc.proj.jstartup.sadm.ShmCache

Tue Apr 01 01:33:13 2008

Excluding compile: com.sap.engine.services.webservices.jaxrpc.encoding.InstanceBuilder::readElement

Excluding compile: com.sap.engine.services.webservices.jaxrpc.encoding.GeneratedComplexType::_loadInto

Tue Apr 01 01:33:14 2008

Excluding compile: com.sap.engine.services.webservices.jaxrpc.encoding.InstanceBuilder::readSequence

[Thr 3092] Tue Apr 01 01:34:54 2008

[Thr 3092] JLaunchISetState: change state from [Starting applications (10)] to [Running (3)

Tue Apr 01 01:59:18 2008

[Unloading class sun.reflect.GeneratedSerializationConstructorAccessor129]

[Unloading class sun.reflect.GeneratedSerializationConstructorAccessor294]

.........

.......

........

........

.................

tue Apr 01 01:59:20 2008

[Unloading class sun.reflect.GeneratedMethodAccessor6]

[Unloading class sun.reflect.GeneratedSerializationConstructorAccessor7]

[Unloading class sun.reflect.GeneratedSerializationConstructorAccessor16]

[Unloading class sun.reflect.GeneratedMethodAccessor3]

[Unloading class sun.reflect.GeneratedSerializationConstructorAccessor481]

Tue Apr 01 01:59:26 2008

Full thread dump Java HotSpot(TM) 64-Bit Server VM (1.4.2_17-b06 mixed mode):

"Scheduler_com.tssap.dtr.server.deltav.runtimeconfig.impl.ConfigParamsCheckerTask#49_workerThread#0" daemon prio=2 tid=0x0000000021445000 nid=0xe98 runnable [0x0000000000000000..0x0000000000000000]

"Scheduler_com.tssap.dtr.server.deltav.runtimeconfig.impl.ConfigParamsCheckerTask#49_controlThread" daemon prio=5 tid=0x0000000020f41aa0 nid=0xa60 waiting on condition [0x000000003491f000..0x000000003491fb80]

at java.lang.Thread.sleep(Native Method)

at com.tssap.dtr.pvc.util.scheduler.Invocation$Controller.run(Invocation.java:175)

at java.lang.Thread.run(Thread.java:534)

"Thread-120" daemon prio=5 tid=0x0000000022cb2a00 nid=0xfe8 in Object.wait() [0x000000003471f000..0x000000003471fb80]

at java.lang.Object.wait(Native Method)

- waiting on <0x00000000a17d61f0> (a java.lang.ref.ReferenceQueue$Lock)

at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)

- locked <0x00000000a17d61f0> (a java.lang.ref.ReferenceQueue$Lock)

at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)

at com.sap.engine.cache.util.ReferenceQueueRunnable.run(ReferenceQueueRunnable.java:43)

at java.lang.Thread.run(Thread.java:534)

"Thread-119" daemon prio=5 tid=0x0000000022cb0b40 nid=0x15f0 in Object.wait() [0x000000003451f000..0x000000003451fb80]

at java.lang.Object.wait(Native Method)

- waiting on <0x00000000a17d62a8> (a java.lang.ref.ReferenceQueue$Lock)

at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)

- locked <0x00000000a17d62a8> (a java.lang.ref.ReferenceQueue$Lock)

at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)

at com.sap.engine.cache.util.ReferenceQueueRunnable.run(ReferenceQueueRunnable.java:43)

at java.lang.Thread.run(Thread.java:534)

"Thread-118" daemon prio=5 tid=0x0000000022cb24e0 nid=0x1524 in Object.wait() [0x000000003431f000..0x000000003431fb80]

at java.lang.Object.wait(Native Method)

- waiting on <0x00000000a17d6360> (a java.lang.ref.ReferenceQueue$Lock)

at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)

- locked <0x00000000a17d6360> (a java.lang.ref.ReferenceQueue$Lock)

at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)

at com.sap.engine.cache.util.ReferenceQueueRunnable.run(ReferenceQueueRunnable.java:43)

at java.lang.Thread.run(Thread.java:534)

[......

................

................

................

.................

............ ]

"SAPEngine_Application_Thread[impl:3]_2" prio=5 tid=0x0000000007dee340 nid=0x838 in Object.wait() [0x00000000097df000..0x00000000097dfb80]

at java.lang.Object.wait(Native Method)

- waiting on <0x000000008aaf5470> (a com.sap.engine.lib.util.WaitQueue)

at java.lang.Object.wait(Object.java:429)

at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)

- locked <0x000000008aaf5470> (a com.sap.engine.lib.util.WaitQueue)

at com.sap.engine.core.thread.impl3.SingleThread.run(SingleThread.java:147)

"SAPEngine_Application_Thread[impl:3]_1" prio=5 tid=0x0000000007dee0b0 nid=0x1130 in Object.wait() [0x00000000095df000..0x00000000095dfb80]

at java.lang.Object.wait(Native Method)

- waiting on <0x000000008aaf5470> (a com.sap.engine.lib.util.WaitQueue)

at java.lang.Object.wait(Object.java:429)

at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)

- locked <0x000000008aaf5470> (a com.sap.engine.lib.util.WaitQueue)

at com.sap.engine.core.thread.impl3.SingleThread.run(SingleThread.java:147)

"SAPEngine_Application_Thread[impl:3]_0" prio=5 tid=0x000000000151a500 nid=0x1028 in Object.wait() [0x000000000753f000..0x000000000753fb80]

at java.lang.Object.wait(Native Method)

- waiting on <0x000000008aaf5470> (a com.sap.engine.lib.util.WaitQueue)

at java.lang.Object.wait(Object.java:429)

at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)

- locked <0x000000008aaf5470> (a com.sap.engine.lib.util.WaitQueue)

at com.sap.engine.core.thread.impl3.SingleThread.run(SingleThread.java:147)

"Thread-1" prio=5 tid=0x0000000001519d50 nid=0xaa0 in Object.wait() [0x000000000773f000..0x000000000773fb80]

at java.lang.Object.wait(Native Method)

- waiting on <0x000000008aaf7558> (a com.sap.engine.core.Framework)

at java.lang.Object.wait(Object.java:429)

at com.sap.engine.core.Framework.start(Framework.java:207)

- locked <0x000000008aaf7558> (a com.sap.engine.core.Framework)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:324)

at com.sap.engine.boot.FrameThread.run(FrameThread.java:61)

at java.lang.Thread.run(Thread.java:534)

"Signal Dispatcher" daemon prio=10 tid=0x0000000001519080 nid=0xb04 waiting on condition [0x0000000000000000..0x0000000000000000]

"Finalizer" daemon prio=9 tid=0x0000000001518df0 nid=0xbd0 runnable [0x000000000633f000..0x000000000633fb80]

at java.io.WinNTFileSystem.getBooleanAttributes(Native Method)

at java.io.File.exists(File.java:680)

at com.sap.engine.core.service630.container.FileInputStreamWrapper.close(FileInputStreamWrapper.java:20)

at java.io.FileInputStream.finalize(FileInputStream.java:294)

at java.lang.ref.Finalizer.invokeFinalizeMethod(Native Method)

at java.lang.ref.Finalizer.runFinalizer(Finalizer.java:83)

at java.lang.ref.Finalizer.access$100(Finalizer.java:14)

at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:160)

"Reference Handler" daemon prio=10 tid=0x0000000001518b60 nid=0x13a4 in Object.wait() [0x000000000613f000..0x000000000613fb80]

at java.lang.Object.wait(Native Method)

- waiting on <0x000000008aaf3d08> (a java.lang.ref.Reference$Lock)

at java.lang.Object.wait(Object.java:429)

at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:115)

- locked <0x000000008aaf3d08> (a java.lang.ref.Reference$Lock)

"main" prio=5 tid=0x00000000015188d0 nid=0xfa0 in Object.wait() [0x000000000221f000..0x000000000221fc68]

at java.lang.Object.wait(Native Method)

- waiting on <0x000000008aaf7de0> (a com.sap.engine.boot.StartFrame)

at java.lang.Object.wait(Object.java:429)

at com.sap.engine.boot.StartFrame.work(StartFrame.java:121)

- locked <0x000000008aaf7de0> (a com.sap.engine.boot.StartFrame)

at com.sap.engine.boot.Start.main(Start.java:34)

"VM Thread" prio=5 tid=0x00000000015c8920 nid=0x9cc runnable

"Suspend Checker Thread" prio=10 tid=0x00000000015c8a20 nid=0x17b4 runnable

[Thr 2508] Tue Apr 01 01:59:27 2008

[Thr 2508] JLaunchIExitJava: exit hook is called (rc = 666)

[Thr 2508] **********************************************************************

• ERROR => The Java VM terminated with a non-zero exit code.

• Please see SAP Note 943602 , section 'J2EE Engine exit codes'

• for additional information and trouble shooting.

**********************************************************************

[Thr 2508] JLaunchCloseProgram: good bye (exitcode = 666)

dev_bootstrap trace file:

-

---

trc file: "C:\usr\sap\N01\DVEBMGS00\work\dev_bootstrap", trc level: 1, release: "700"

-

---

node name : bootstrap

pid : 2772

system name : N01

system nr. : 00

started at : Tue Apr 01 01:29:38 2008

arguments :

arg[00] : C:\usr\sap\N01\DVEBMGS00\exe\jlaunch.exe

arg[01] : pf=C:\usr\sap\N01\SYS\profile\N01_DVEBMGS00_sipro11

arg[02] : -DSAPINFO=N01_00_bootstrap

arg[03] : pf=C:\usr\sap\N01\SYS\profile\N01_DVEBMGS00_sipro11

arg[04] : -DSAPSTART=1

arg[05] : -DCONNECT_PORT=3399

arg[06] : -DSAPSYSTEM=00

arg[07] : -DSAPSYSTEMNAME=N01

arg[08] : -DSAPMYNAME=sipro11_N01_00

arg[09] : -DSAPPROFILE=C:\usr\sap\N01\SYS\profile\N01_DVEBMGS00_sipro11

arg[10] : -DFRFC_FALLBACK=ON

arg[11] : -DFRFC_FALLBACK_HOST=localhost

[Thr 6008] Tue Apr 01 01:29:38 2008

[Thr 6008] *** WARNING => INFO: Unknown property [instance.box.number=N01DVEBMGS00sipro11] [jstartxx.c 841]

[Thr 6008] *** WARNING => INFO: Unknown property [instance.en.host=sipro11] [jstartxx.c 841]

[Thr 6008] *** WARNING => INFO: Unknown property [instance.en.port=3201] [jstartxx.c 841]

[Thr 6008] *** WARNING => INFO: Unknown property [instance.system.id=0] [jstartxx.c 841]

**********************************************************************

JStartupReadInstanceProperties: read instance properties [C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties]

-> ms host : sipro11

-> ms port : 3901

-> OS libs : C:\usr\sap\N01\DVEBMGS00\j2ee\os_libs

-> Admin URL :

-> run mode : normal

-> run action : NONE

-> enabled : yes

**********************************************************************

**********************************************************************

Used property files

-> files [00] : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties

**********************************************************************

**********************************************************************

Instance properties

-> ms host : sipro11

-> ms port : 3901

-> os libs : C:\usr\sap\N01\DVEBMGS00\j2ee\os_libs

-> admin URL :

-> run mode : normal

-> run action : NONE

-> enabled : yes

**********************************************************************

**********************************************************************

Bootstrap nodes

-> [00] bootstrap : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties

-> [01] bootstrap_ID9663600 : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties

-> [02] bootstrap_ID9663650 : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties

**********************************************************************

**********************************************************************

Worker nodes

-> [00] ID9663600 : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties

-> [01] ID9663650 : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster\instance.properties

**********************************************************************

[Thr 6008] JLaunchRequestQueueInit: create named pipe for ipc

[Thr 6008] JLaunchRequestQueueInit: create pipe listener thread

[Thr 4640] WaitSyncSemThread: Thread 4640 started as semaphore monitor thread.

[Thr 5816] JLaunchRequestFunc: Thread 5816 started as listener thread for np messages.

[Thr 6008] NiInit3: NI already initialized; param 'maxHandles' ignored (1;202)

[Thr 6008] CPIC (version=700.2006.09.13)

[Thr 6008] [Node: bootstrap] java home is set by profile parameter

Java Home: C:\j2sdk1.4.2_17-x64\

[Thr 6008] JStartupICheckFrameworkPackage: can't find framework package C:\usr\sap\N01\DVEBMGS00\exe\jvmx.jar

**********************************************************************

JStartupIReadSection: read node properties [bootstrap]

-> node name : bootstrap

-> node type : bootstrap

-> node execute : yes

-> java path : C:\j2sdk1.4.2_17-x64\

-> java parameters : -Djco.jarm=1

-> java vm version : 1.4.2_17-b06

-> java vm vendor : Java HotSpot(TM) 64-Bit Server VM (Sun Microsystems Inc.)

-> java vm type : server

-> java vm cpu : amd64

-> heap size : 256M

-> root path : C:\usr\sap\N01\DVEBMGS00\j2ee\cluster

-> class path : .\bootstrap\launcher.jar

-> OS libs path : C:\usr\sap\N01\DVEBMGS00\j2ee\os_libs

-> main class : com.sap.engine.offline.OfflineToolStart

-> framework class : com.sap.bc.proj.jstartup.JStartupFramework

-> registr. class : com.sap.bc.proj.jstartup.JStartupNatives

-> framework path : C:\usr\sap\N01\DVEBMGS00\exe\jstartup.jar;C:\usr\sap\N01\DVEBMGS00\exe\jvmx.jar

-> parameters : com.sap.engine.bootstrap.Bootstrap ./bootstrap ID0096636

-> debuggable : yes

-> debug mode : no

-> debug port : 60000

-> shutdown timeout : 120000

**********************************************************************

[Thr 3860] JLaunchIStartFunc: Thread 3860 started as Java VM thread.

[Thr 3860] [JHVM_PrepareVMOptions] use java parameters set by profile parameter

Java Parameters: -Xss2m

**********************************************************************

JHVM_LoadJavaVM: VM Arguments of node [bootstrap]

-> stack : 1048576 Bytes

-> arg[ 0]: exit

-> arg[ 1]: abort

-> arg[ 2]: vfprintf

-> arg[ 3]: -Djco.jarm=1

-> arg[ 4]: -Dsys.global.dir=C:\usr\sap\N01\SYS\global

-> arg[ 5]: -Dapplication.home=C:\usr\sap\N01\DVEBMGS00\exe

-> arg[ 6]: -Djava.class.path=C:\usr\sap\N01\DVEBMGS00\exe\jstartup.jar;C:\usr\sap\N01\DVEBMGS00\exe\jvmx.jar;.\bootstrap\launcher.jar

-> arg[ 7]: -Djava.library.path=C:\j2sdk1.4.2_17-x64
jre\bin\server;C:\j2sdk1.4.2_17-x64
jre\bin;C:\j2sdk1.4.2_17-x64
bin;C:\usr\sap\N01\DVEBMGS00\j2ee\os_libs;C:\oracle\N01\102\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Files\Intel\DMIX;C:\usr\sap\N01\SYS\exe\uc\NTAMD64

-> arg[ 8]: -Dmemory.manager=256M

-> arg[ 9]: -Xmx256M

-> arg[ 10]: -DLoadBalanceRestricted=no

-> arg[ 11]: -Djstartup.mode=BOOTSTRAP

-> arg[ 12]: -Djstartup.ownProcessId=2772

-> arg[ 13]: -Djstartup.ownHardwareId=G1244646877

-> arg[ 14]: -Djstartup.whoami=bootstrap

-> arg[ 15]: -Djstartup.debuggable=yes

-> arg[ 16]: -Xss2m

-> arg[ 17]: -DSAPINFO=N01_00_bootstrap

-> arg[ 18]: -DSAPSTART=1

-> arg[ 19]: -DCONNECT_PORT=3399

-> arg[ 20]: -DSAPSYSTEM=00

-> arg[ 21]: -DSAPSYSTEMNAME=N01

-> arg[ 22]: -DSAPMYNAME=sipro11_N01_00

-> arg[ 23]: -DSAPPROFILE=C:\usr\sap\N01\SYS\profile\N01_DVEBMGS00_sipro11

-> arg[ 24]: -DFRFC_FALLBACK=ON

-> arg[ 25]: -DFRFC_FALLBACK_HOST=localhost

-> arg[ 26]: -DSAPSTARTUP=1

-> arg[ 27]: -DSAPSYSTEM=00

-> arg[ 28]: -DSAPSYSTEMNAME=N01

-> arg[ 29]: -DSAPMYNAME=sipro11_N01_00

-> arg[ 30]: -DSAPDBHOST=sipro11

-> arg[ 31]: -Dj2ee.dbhost=sipro11

**********************************************************************

CompilerOracle: exclude com/sapportals/portal/pb/layout/taglib/ContainerTag addIviewResources

CompilerOracle: exclude com/sap/engine/services/keystore/impl/security/CodeBasedSecurityConnector getApplicationDomain

CompilerOracle: exclude com/sap/engine/services/rmi_p4/P4StubSkeletonGenerator generateStub

CompilerOracle: exclude com/sapportals/portal/prt/util/StringUtils escapeToJS

CompilerOracle: exclude com/sapportals/portal/prt/core/broker/PortalServiceItem startServices

CompilerOracle: exclude com/sap/engine/services/webservices/server/deploy/WSConfigurationHandler downloadFile

CompilerOracle: exclude com/sapportals/portal/prt/jndisupport/util/AbstractHierarchicalContext lookup

CompilerOracle: exclude com/sapportals/portal/navigation/cache/CacheNavigationNode getAttributeValue

CompilerOracle: exclude com/sapportals/portal/navigation/TopLevelNavigationiView PrintNode

CompilerOracle: exclude com/sapportals/wcm/service/ice/wcm/ICEPropertiesCoder encode

CompilerOracle: exclude com/sap/lcr/pers/delta/importing/ObjectLoader loadObjects

CompilerOracle: exclude com/sap/engine/services/webservices/jaxrpc/encoding/InstanceBuilder readElement

CompilerOracle: exclude com/sap/engine/services/webservices/jaxrpc/encoding/InstanceBuilder readSequence

CompilerOracle: exclude com/sap/engine/services/webservices/jaxrpc/encoding/TypeMappingImpl initializeRelations

CompilerOracle: exclude com/sap/engine/services/webservices/jaxrpc/encoding/GeneratedComplexType _loadInto

[Thr 3860] JHVM_LoadJavaVM: Java VM created OK.

**********************************************************************

JHVM_BuildArgumentList: main method arguments of node [bootstrap]

-> arg[ 0]: com.sap.engine.bootstrap.Bootstrap

-> arg[ 1]: ./bootstrap

-> arg[ 2]: ID0096636

**********************************************************************

[Thr 3860] Tue Apr 01 01:29:39 2008

[Thr 3860] JHVM_RegisterNatives: registering methods in com.sap.bc.krn.perf.PerfTimes

[Thr 5292] Tue Apr 01 01:29:40 2008

[Thr 5292] JLaunchIExitJava: exit hook is called (rc = 0)

[Thr 5292] JLaunchCloseProgram: good bye (exitcode = 0)

Thanks and Regards

Rajendra

[Former Member · Accepted solution]

Your memory seems OKish, perhaps newsize at 171 could be increased.... I would go for more like 300-400.

Permsize could be increased but to check if this is the problem I would use -XX:+PrintHeapAtGC and -Xloggc:GCLogFile which should output a logfile under the server0 directory that shows how much of each memory area is full at each GC.

It does seem to be happening quickly though.... the thread dump does not show any monitor type entries but the locks look suspicious.... when you shut down, do you shut down the SCS as well? there may be a screwy lock in there... you could also use a thread dump analysis tool to check the thread dump shown as the threads may be getting tangled due to something

[Former Member · Accepted solution]

For Instance ID9663650 & Server ID9663650XX, set the parameters as mentioned below using configtool.bat or consoleconfig.bat

-Xms2048M

-Xmx2048M

-XX:PermSize=512M

-XX:MaxPermSize=512M

-XX:NewSize=320M

-XX:MaxNewSize=320M

[Former Member · Accepted solution]

Hi Graham and Shaji

Problem solved!!!

After increase of Newsize and Permsize values J2EE engine is working fine..

Thank you very much...

[former_member302028 · Accepted solution]

Shaji,

These settings also solved my problem. I purchased the SDN Subscription (AS ABAP and AS Java) and am running it on Windows 2003 Server Enterprise Edition X64 box. I "play" with my SDN subscription at nights and have been stuck for several weeks. My server would occassionally just restart when accessing things like :50000/nwa etc.

I just made the changes using the configtool.bat and restarted my server. All the Portal pages, /nwa etc. that perviously crashed my server now work wonderfully.

I am so grateful I stumbled upon your post.

[former_member302557 · Accepted solution]

Shaji Jacob,

The problem is solved. Thanks.

Srinivasan K

[former_member195712 · Accepted solution]

Shaji Jacob,

The problem is solved. Thanks.

Vladimir

[Former Member]

Hi rajendra medak , could you tell me what you do to increase those memories ?

I have this problem too.

Edited by: Michel Dambros Figueiredo on May 20, 2008 1:34 AM

[Former Member]

i had also same problem

by applying these changes

it gets solved

[Former Member]

Check dev_jcontrol to ensure the bootstrap was passed and the issue is only with the server.

Check std_server0.out and dev_server0 for errors. The forst of these files should tell you the last service to start and possible the error it had.

Sometimes there is nothing helpful in here and I find dev_ms in the SCS work directory is often missed and useful as it iundicates network errors as does the os logs.

also directly under the cluster/server0 directory the rfc trace file is a nice ABAP style plain text of any jco problems to an ABAP system if using that as a UME