Cluster resource 'SAP SID 10 Instance' in clustered service or application 'SAP SID' failed.

[Former Member]

Hello

After successfully upgrading our SAP ERP 6.0 to EHP6 ,the SAP cluster resource has failed to come online after a restart.With the following error

Cluster resource 'SAP SID 10 Instance' in clustered service or application 'SAP SID failed.

Please assist

[Former Member]

Hi Roy,

Let us use the process of elimination. Lets start if your kernel is a problem.

- can you bring up only the SAP Service(not the instance). If it fails via cluster, try start it using windows services(services.msc). if the service itself fails, it is most likely something to do with kernel. Check the windows logs for the time you tried to start the kernel. Maybe you do not have some pre-requisite dll etc. Doubleclick on the sapstartserv.exe and see what you get. if you get an error, definitely a kernel problem. Can you try this and let me know.

regards

Yogesh

[Former Member]

The SAP Service can be started from services.msc without any issues.It from the cluster resource manager where it is failing.As for the sapstartserv.exe ,the file can be executed without any issues as well.

Regardss

[Former Member]

Did you get this working yet, sorry I was away in training.

If not, can you sent the windows cluster logs. Also at the time of error, do you get any entries in the windows System logs.

Also send the sapstartsrv.log file from the (A)SCS work directory.

[Former Member]

Hello

We are still facing the same problem,please assist.

Regards

[Sriram2009]

Hi Roy

Better you can raise SAP OSS ticket

Regards

Sriram

[Former Member]

Hi Roy,

Apart from checking at the SAP side solution, you may also look at the microsoft clustering (MSCS) possible solution by checking cluster log. In windows 2003 the cluster log was located in %system%\Cluster. However, in windows 2008 the cluster log location is different as explain in the following link

http://blogs.technet.com/b/askcore/archive/2010/04/13/understanding-the-cluster-debug-log-in-2008.as...

Hope this give more information to find the root cause of your issue.

Regards,

Casmito

[Former Member]

From the windows Event logs we're getting the following error:

General
Failover Cluster Manager failed while managing one or more cluster. The error was 'An error occurred while attempting to bring the resource 'SAP CDV 10 Instance' online.'. For more information see the Failover Cluster Manager Diagnostic channel.

Details

Details
+ System

  - Provider

   [ Name]  Microsoft-Windows-FailoverClustering-Manager
   [ Guid]  {11B3C6B7-E06F-4191-BBB9-7099FFF55614}

   EventID 4683

   Version 0

   Level 2

   Task 1

   Opcode 0

   Keywords 0x8000000000000000

  - TimeCreated

   [ SystemTime]  2013-10-03T07:57:01.608259500Z

   EventRecordID 16

   Correlation

  - Execution

   [ ProcessID]  6608
   [ ThreadID]  3932

  Channel Microsoft-Windows-FailoverClustering-Manager/Admin

   Computer HFDT1SCD02.HOUSINGFINANCE.CO.KE

  - Security

   [ UserID]  S-1-5-21-1315169348-2214025904-2135191971-23677

- EventData

  Parameter1 An error occurred while attempting to bring the resource 'SAP CDV 10 Instance' online.

Regrads

[Sriram2009]

Hi Roy

Kindly refer the Microsoft KB http://support.microsoft.com/kb/2615358

Thanks

Sriram

[Former Member]

Hi Roy,

You would need to get cluster log for more detail what is going on.

Regards,

Casmito

[Former Member]

Please check out note 1050343 for additional changes you need to make for Windows clusters.

[Former Member]

Hi

We had already performed recommendation from the sapnote 1050343 and we also reinstalled the ERS instance.Everything went on well until we restarted SAP from MMC ,the cluster resource 'SAP SID 10' then failed and has not come up since.We have also used the following sapnote in performing the post-upgrade steps:

Note 1012486 - Important Information on upgrading SAP Systems in HA-Setups

Another thing we observed is that we do not  have the directory %windir%\SapCluster on a Sybase cluster so we updated the files in %windir%system2 instead.

Regards

[Sriram2009]

Hi Roy

1. During the failover time, cluster resources disks (Only disk resources) are moving from one to another node?  SAP group - SIDGRP? DBGRP ?

2. Could you share us how you are install the cluster environment?

3. Is this any Firewall on ?

4. Check the Cluster event in the Failover cluster MMC.

Thanks

Sriram

[Former Member]

Hie Sriam

1.The disks can failover from one node to the other successfully

2.

The diagram above shows our current setup on Windows 2008 R2 server the two nodes that we have

3.We have turned off the firewall on the server as this is a prerequisite for the installation

4.The error message " Cluster resource 'SAP SID 10 Instance' in clustered service or application 'SAP SID' failed." is from the Event logs of the Failover Manager.

5.The SAP cluster resource has failed and if we try bringing it online it will only come-up for some seconds then it fails back again see diagram below:

6.Before the upgrade to EHP6 we could restart the SAP cluster resource without any issues and we could restart SAP from MMC without any issues as well this only started after the upgrade.The upgrade completed successfully without any issues and we performed post-upgrade activities in the SAPnotes ,mentioned earlier.It only after a restart was performed after the upgrade that this issue started.

Maybe thereis something or steps we are missing .

Regards

[Sriram2009]

Hi Roy

Kindly refer the link and SAP Note

http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/60df7108-b8f9-2f10-c195-a7b1abda3...

Note 112266 - SAP and MS Cluster Server: Frequent questions and tips

Thanks

Sriram

[Former Member]

Sriram

Your links are also informative,however we have also gone through these during the preparatory phases of the upgrade,during the upgrade phase the SUM actually ask you to set the maintenance mode and remove it at the end of the execution phase.

Regards

[Sriram2009]

Hi Roy

Kindly refer the SAP Note 1345206 - Handling and preventing sapstartsrv.exe corruptions

Note 1011190 - MSCS:Splitting the Central Instance After Upgrade to 7.0/7.1

Thanks

Sriram

[Former Member]

Sriram

We had also tried replacing sapstartsrv.exe ,download a newer version of the program and replaced the current but still it did not work, facing the same error.

Note 1011190 for Splitting the central Instance will not apply to our version cause we have netweaver 7.31 and this was a fresh installing and no need to split because this has already been performed during the initial installation

Regards

[Reagan]

Hello

Check the Windows event viewer logs.

Check this thread

http://scn.sap.com/thread/3391484

Check the work process trace files.

Regards

RB

[Former Member]

Our server is windows server 2008 R2 and we are using Sybase ASE 15.7 .The link seems to point to server 2012 as well as the sapnote Below is the out from the dev_ms from the work directory of ASC10 instance.
---------------------------------------------------
trc file: "dev_ms", trc level: 1, release: "720"
---------------------------------------------------

[Thr 67260] Wed Oct 09 14:53:11 2013
[Thr 67260] ms/http_max_clients = 500 -> 500
[Thr 67260] MsSSetTrcLog: trc logging active, max size = 52428800 bytes
systemid   562 (PC with Windows NT)
relno      7200
patchlevel 0
patchno    441
intno      20020600
make       multithreaded, Unicode, 64 bit, optimized
pid        33808

[Thr 67260] ***LOG Q01=> MsSInit, MSStart (Msg Server 1 33808) [msxxserv.c   2288]
[Thr 67260] MsInitAclInfo: acl file D:\usr\sap\CDV\SYS\global\ms_acl_info.DAT not found, unrestricted access
[Thr 67260] MsGetOwnIpAddr: my host addresses are :
[Thr 67260]   1 : [128.2.1.17] hfdt1scd01.housingfinance.co.ke (HOSTNAME)
[Thr 67260]   2 : [127.0.0.1] HFDT1SCD01.HOUSINGFINANCE.CO.KE (LOCALHOST)
[Thr 67260]   3 : [128.2.1.54] hfdt1scdgrp.housingfinance.co.ke (NILIST)
[Thr 67260]   4 : [128.2.1.55] saphfdt1cdgrp.housingfinance.co.ke (NILIST)
[Thr 67260]   5 : [128.2.1.56] dbhfdt1cdgrp.housingfinance.co.ke (NILIST)
[Thr 67260]   6 : [10.1.1.7] HFDT1SCD01.HOUSINGFINANCE.CO.KE (NILIST)
[Thr 67260]   7 : [169.254.1.208] HFDT1SCD01.HOUSINGFINANCE.CO.KE (NILIST)
[Thr 67260] MsHttpInit: full qualified hostname = hfdt1scd01.housingfinance.co.ke
[Thr 67260] HTTP logging is switch off
[Thr 67260] set HTTP state to LISTEN
[Thr 67260] *** HTTP port 8110 state LISTEN ***
[Thr 67260] MsHttpOwnDomain: own domain[1] = housingfinance.co.ke
[Thr 67260] *** I listen to port sapmsCDV (3610) ***
[Thr 67260] *** HTTP port 8110 state LISTEN ***
[Thr 67260] CUSTOMER KEY: >X1715766673<
[Thr 67260] build version=720.2013.07.11

Regards

[Former Member]

Hi,

Please past more logs .

Please check if the below blog helps you.

http://scn.sap.com/message/14300318

Thanks

Rishi abrol

[Former Member]

Hi

We have gone through the link and tried the solution but it hasn't worked for us.

Regards

[Former Member]

Hello,

Kindly hit R3trans -d and paste the trans.log file

Thanks

Ramesh Nair

[Former Member]

r3trans -d
This is r3trans version 6.24 (release 720 - 08.07.13 - 20:13:05 ).
unicode enabled version
R3trans=>sapparam(1c): No Profile used.
R3trans=>sapparam: SAPSYSTEMNAME neither in Profile nor in Commandline
r3trans finished (0000).

Regards