SAP BI server01 doesn't come up properly

[Former Member]

Dear All

We have a newly upgrated BI server and the server01 in that doesn't startup properly the Database and ABAP are both up and running but the JAVA stack is not comming up.

The OS is windows 2003 and the database is oracle 10.2.0.4

Please let me know what are those logs that I need to check to findout the error causing this and please let me know if you folks know any answer ...

Thanks so much and best regards,

Shanaka.

[Former Member]

---

Bootstrap MODE:

<INSTANCE GLOBALS>

determined by parameter [ID0136784].

-

---

Exception occurred:

com.sap.engine.bootstrap.SynchronizationException: Database initialization failed! Check database properties!

at com.sap.engine.bootstrap.Bootstrap.initDatabaseConnection(Bootstrap.java:476)

at com.sap.engine.bootstrap.Bootstrap.<init>(Bootstrap.java:146)

at com.sap.engine.bootstrap.Bootstrap.main(Bootstrap.java:971)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:324)

at com.sap.engine.offline.OfflineToolStart.main(OfflineToolStart.java:81)

-

---

==[ Caused by: ]==----

---

com.sap.engine.frame.core.configuration.ConfigurationException: Error while connecting to DB.

at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnectionPool.createConnection(DBConnectionPool.java:365)

at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnectionPool.<init>(DBConnectionPool.java:130)

at com.sap.engine.core.configuration.impl.persistence.rdbms.PersistenceHandler.<init>(PersistenceHandler.java:38)

at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.<init>(ConfigurationCache.java:149)

at com.sap.engine.core.configuration.bootstrap.ConfigurationManagerBootstrapImpl.init(ConfigurationManagerBootstrapImpl.java:236)

at com.sap.engine.core.configuration.bootstrap.ConfigurationManagerBootstrapImpl.<init>(ConfigurationManagerBootstrapImpl.java:49)

at com.sap.engine.bootstrap.Synchronizer.<init>(Synchronizer.java:74)

at com.sap.engine.bootstrap.Bootstrap.initDatabaseConnection(Bootstrap.java:473)

at com.sap.engine.bootstrap.Bootstrap.<init>(Bootstrap.java:146)

at com.sap.engine.bootstrap.Bootstrap.main(Bootstrap.java:971)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:324)

at com.sap.engine.offline.OfflineToolStart.main(OfflineToolStart.java:81)

Caused by: java.sql.SQLException: ORA-01017: invalid username/password; logon denied

at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:112)

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:331)

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:283)

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:278)

at oracle.jdbc.driver.T4CTTIoauthenticate.receiveOauth(T4CTTIoauthenticate.java:790)

at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:362)

at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:420)

at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:165)

at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:35)

at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:801)

at com.sap.sql.jdbc.NativeConnectionFactory.createNativeConnection(NativeConnectionFactory.java:215)

at com.sap.sql.connect.OpenSQLDataSourceImpl.createPooledConnection(OpenSQLDataSourceImpl.java:608)

at com.sap.sql.connect.OpenSQLDataSourceImpl.getPooledConnection(OpenSQLDataSourceImpl.java:285)

at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnectionPool.createConnection(DBConnectionPool.java:307)

... 14 more

[Bootstrap module]> Problem occurred while performing synchronization.

This is the out put I found in my "jvm_bootstrao.out" file in work directory. When i check from the data base it says that the oracle user "ORACLE_OCM" password SAP use to connect to DB was expired , I'm trying to resolve that password issue first and try to bring up the server. According to logs that may be the reason for this. I'll update if this issue resolve after solving the password issue of that user .

Thanks,

Shanaka.

[Former Member]

Hi,

Can you please paste the contents of std_server0.out.Thanks.

[Former Member]

Hiiii,

Thanks alot for the reply . The jvm_server0.out is zero in size it doesn't contains any data ....

Thanks,

[Former Member]

Hi ,

Sorry previously i checked jvm_server0.out file only please find std_server0.out file details below

-

---

stdout/stderr redirect

-

---

node name : server0

pid : 5768

system name : BPJ

system nr. : 01

started at : Tue Aug 23 12:14:00 2011

19806.026: [GC 19806.026: [ParNew: 174962K->349K(261888K), 0.0081833 secs] 581612K->406999K(2009856K), 0.0082561 secs]

19806.745: [GC 19806.745: [ParNew: 174941K->341K(261888K), 0.0082131 secs] 581591K->406991K(2009856K), 0.0083051 secs]

21435.791: [GC 21435.791: [ParNew: 174916K->6810K(261888K), 0.0113129 secs] 583109K->415004K(2009856K), 0.0114126 secs]

SAP J2EE Engine Version 7.01 PatchLevel 65566. is shutting down! PatchLevel 65566. August 24, 2009 14:16 GMT

Stopping services.

22427.070: [GC 22427.070: [ParNew: 181402K->11009K(261888K), 0.0149655 secs] 589596K->419202K(2009856K), 0.0150595 secs]

Service com.sap.portal.prt.sapj2ee stopped. (0 ms)

Service com.adobe~PDFManipulation stopped. (15 ms)

Service com.adobe~DocumentServicesLicenseSupportService stopped. (0 ms)

22434.170: [GC 22434.170: [ParNew: 185601K->13232K(261888K), 0.0181449 secs] 593794K->421425K(2009856K), 0.0182377 secs]

Service servlet_jsp stopped. (4532 ms)

Service webdynpro stopped. (0 ms)

Service rfcengine stopped. (0 ms)

Service com.adobe~DocumentServicesDestProtoService stopped. (0 ms)

Service pmi stopped. (32 ms)

Service tc_secvsi~service stopped. (0 ms)

Service tc_secdestinations~service stopped. (0 ms)

Service sld stopped. (0 ms)

Service tc_secwssec~service stopped. (0 ms)

Service com.adobe~TrustManagerService stopped. (0 ms)

Service com.adobe~DocumentServicesConfiguration stopped. (0 ms)

Service caf_euer~service stopped. (0 ms)

Service tc_eujwf_uiwizsvc stopped. (0 ms)

Service caf_eugp~model stopped. (31 ms)

Service tc_secsecurestorage~service stopped. (0 ms)

Service javamail stopped. (0 ms)

Service caf_umrelgroups~imp stopped. (0 ms)

Service caf_ummetadata~imp stopped. (0 ms)

Service applocking stopped. (0 ms)

Service com.adobe~FontManagerService stopped. (0 ms)

Service com.adobe~DataManagerService stopped. (0 ms)

Service com.adobe~LicenseService stopped. (0 ms)

Service com.adobe~XMLFormService stopped. (0 ms)

Service com.adobe~DocumentServicesBinaries2 stopped. (0 ms)

Service iiop stopped. (156 ms)

Service ts stopped. (0 ms)

Service caf_eugp_mailcf stopped. (0 ms)

Service licensing stopped. (0 ms)

Service failover stopped. (0 ms)

Service tc_disdic~srv stopped. (0 ms)

Service developmentserver stopped. (0 ms)

Service prtbridge stopped. (0 ms)

Service tc_eCATTPingservice stopped. (0 ms)

Service telnet stopped. (0 ms)

Service shell stopped. (0 ms)

Service dsr stopped. (16 ms)

Service jms_provider stopped. (0 ms)

Service classload stopped. (0 ms)

Service tc_lmctc_confsservice_sda stopped. (0 ms)

Service com.sap.nw.kmc.readonlymbean stopped. (0 ms)

Service com.sap.nw.kmc.readonly stopped. (0 ms)

Service com.sap.portal.pcd.gl stopped. (0 ms)

Service adminadapter stopped. (0 ms)

Service apptracing stopped. (62 ms)

Service monitor stopped. (297 ms)

Service basicadmin stopped. (16 ms)

Service tc.monitoring.logviewer stopped. (15 ms)

Service CUL stopped. (0 ms)

Service jmx stopped. (0 ms)

Service ssl stopped. (0 ms)

Service tc_seccertrevoc~service stopped. (0 ms)

Service keystore stopped. (16 ms)

Service ejb stopped. (62 ms)

Service security stopped. (0 ms)

Service com.sap.security.core.ume.service stopped. (0 ms)

Service UT stopped. (0 ms)

Service dbpool stopped. (16 ms)

22437.647: [GC 22437.647: [ParNew: 187824K->8343K(261888K), 0.0156348 secs] 596017K->416536K(2009856K), 0.0157253 secs]

Service webservices stopped. (125 ms)

Service configuration stopped. (0 ms)

Service connector stopped. (46 ms)

Service jmsconnector stopped. (0 ms)

Service appclient stopped. (0 ms)

Service naming stopped. (0 ms)

Service userstore stopped. (0 ms)

Service memory stopped. (0 ms)

Service MigrationService stopped. (0 ms)

Service file stopped. (0 ms)

Service DQE stopped. (0 ms)

Service bi_mmrdeployer stopped. (0 ms)

Service com.sap.portal.runtime.config.kmreadonly stopped. (0 ms)

Service deploy stopped. (16 ms)

Service locking stopped. (0 ms)

Service caf_euodi~mnuacc stopped. (0 ms)

Service classpath_resolver stopped. (0 ms)

Service p4 stopped. (0 ms)

Service cross stopped. (0 ms)

Service http stopped. (0 ms)

Service caf_runtimeconnectivity~impl stopped. (0 ms)

Service timeout stopped. (0 ms)

Service trex.service stopped. (0 ms)

Service caf_eucc~api stopped. (0 ms)

Service log_configurator stopped. (0 ms)

Service jmx_notification stopped. (0 ms)

Service runtimeinfo stopped. (0 ms)

Thanks,

Shanaka.

[vincentlim826]

Hi,

I suggest to check your J2EE first

- check full version of the JDK/SDK?

Enter the 'java -version' command in the command line. This

must be executed under the same user that the server uses, to

have an identical environment.

- What is the J2EE Engine full version? The full version is contained in the file

/usr/sap/<SID>/<instanceID>/j2ee/cluster/server0/version.txt.

- SAP Notes with regard to J2EE:

723909 - Java VM settings for J2EE 6.40/7.0

716604 - Access to Sun J2SE and recommended J2SE options

718901 - How to Change the JDK of the J2EE Engine

You can try to locate the error from following Logs and see the configuration

1) /usr/sap/<SID>/<instanceID>/work/*

2) /usr/sap/<SID>/<instanceID>/j2ee/cluster/dispatcher/log/*

3) /usr/sap/<SID>/<instanceID>/j2ee/cluster/server<n>/log/*

4) /usr/sap/<SID>/<instanceID>/j2ee/cluster/instance.properties

5) /usr/sap/<SID>/<instanceID>/j2ee/cluster/instance.properties.vmprop

6) dev_ms file from /usr/sap/<SID>/SCS<in>/work folder

Regards,

Vincent

[Former Member]

Hi Vincent,

Thanks alot for the reply just now only i returned after a long night :D.... Please find below those version information of my j2ee and JDK

J2EE:

1. Specifies the version of the system

Cluster-Version: 7.01 PatchLevel 65566.

Build-On:Monday, August 24, 2009 14:16 GMT

Perforce-Server:

Project-Dir:JKernel/NW701_05_REL

JKernel Change-List:65566

Build machine:SAPInternal

Build java version:1.3.1_18-b01 Sun Microsystems Inc.

SP-Number: 05

Source-Dir: D:\make\engine\NW701_05_REL\builds\JKernel\NW701_05_REL\archive\dbg

JDK:

java version "1.4.2_17"

Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2_17-b06)

Java HotSpot(TM) 64-Bit Server VM (build 1.4.2_17-b06, mixed mode)

Hope both are gaving correct versions.

[Former Member]

Hi,

Check the trace files, below;

dev_bootstrap, dev_jcontrol under "/usr/sap/<SID>/JC<sysnr>/work"
defaultTrace files under "/usr/sap/<SID>/JC<sysnr>j2ee/cluster/server0/log"

Best regards,

Orkun Gedik

[Former Member]

Hi Orkun Gedik,

Thanks alot for the reply and details provided. I checked the log under "E:\usr\sap\BPJ\JC01\work". It contained sapstartsrv.log file and below mentioned is the content please tell me the issue is with the credential of the user who is connecting to the DB from application side.

-

---

trc file: "sapstartsrv.log", trc level: 0, release: "701"

-

---

pid 5772

Tue Aug 23 21:33:17 2011

SAP HA Trace: Build in SAP Microsoft Cluster library '701, patch 55, changelist 1087178' initialized

Initializing SAPControl Webservice

SapSSLInit failed => https support disabled

Starting WebService Named Pipe thread

Starting WebService thread

Webservice named pipe thread started, listening on port
.\pipe\sapcontrol_01

Webservice thread started, listening on port 50113

EAGLE\bipadm is stopping SAP System at 2011/08/25 11:51:17

SAP HA Trace: FindClusterResource: OpenCluster failed: 1753 [sapwinha.cpp, line 212]

SAP HA Trace: SAP_HA_FindSAPInstance returns: SAP_HA_FAIL [sapwinha.cpp, line 907]

EAGLE\bipadm is starting SAP System at 2011/08/25 11:52:06

SAP HA Trace: FindClusterResource: OpenCluster failed: 1753 [sapwinha.cpp, line 212]

SAP HA Trace: SAP_HA_FindSAPInstance returns: SAP_HA_FAIL [sapwinha.cpp, line 907]

EAGLE\bipadm is stopping SAP System at 2011/08/25 14:00:27

SAP HA Trace: FindClusterResource: OpenCluster failed: 1753 [sapwinha.cpp, line 212]

SAP HA Trace: SAP_HA_FindSAPInstance returns: SAP_HA_FAIL [sapwinha.cpp, line 907]

EAGLE\bipadm is starting SAP System at 2011/08/25 14:00:57

SAP HA Trace: FindClusterResource: OpenCluster failed: 1753 [sapwinha.cpp, line 212]

SAP HA Trace: SAP_HA_FindSAPInstance returns: SAP_HA_FAIL [sapwinha.cpp, line 907]

-

---

C-STACK -

---

SAP (R) - R/3(TM) Callstack, Version 1.0

Copyright (C) SAP AG. All rights reserved.

-

---

Application exception occurred:

Exception : c0000005 (Access Violation)

App : sapstartsrv.exe (pid=5772)

When : 8/25/2011 19:46:33.355

-

---

Computer Name : LKESBIPRD001

User Name : SAPServiceBPJ

-

---

Number of Processors: 8

Processor Type: EM64T Family 6 Model 23 Stepping 6

Windows Version : 5.2 Current Build: 3790

-

---

--> (FAULT) Stack Back Trace <--

FramePtr ReturnAd Param#1 Function Name

000000000294fdf0 000000014002f6c8 0000000002eb0080 sapstartsrv!SAPControl__AnalyseLogFiles2 [ntservweb.cpp (11844)]

000000000294fe30 00000001400652f1 0000000002eb0080 sapstartsrv!SAPControl__AnalyseLogFiles [ntservweb.cpp (12178)]

000000000294feb0 00000001400678e2 0000000002eb0080 sapstartsrv!soap_serve_SAPControl__AnalyseLogFiles [soapserver.cpp (1143)]

000000000294fee0 000000014004a039 0000000002eb0080 sapstartsrv!soap_serve [soapserver.cpp (31)]

000000000294ff10 00000000781337d7 00000000049e4d60 sapstartsrv!WebServiceWorker [ntservsserver.cpp (318)]

000000000294ff40 0000000078133894 00000000781e95b0 MSVCR80!endthreadex

000000000294ff70 0000000077d6b71a 0000000077d6b6e0 MSVCR80!endthreadex

000000000294ffa0 0000000000000000 0000000000000000 kernel32!BaseThreadStart

-

---

[Former Member]

As asked earlier can you please paste the logs for the java engine starting up.Thanks.