Solved: Stack Upgrade - JAVA Dialog Instance

Hi,

I am performing support pack stack upgrade for Netweaver Portal 7.31 SP-5 to SP-17 .Before starting the upgrade, i had kept only Central Instance up and shutdown the dialog instance.

Initial phases of upgrade on SUM completed successfully, Just before execution i get the error:

"Could not check if the instance number 2 on host <dialog-instance host> is started."

This means Upgrade process is looking for Dialog instance also. So my question is:

Do i need to keep dialog instance up during SP-upgrade, If not then how to overcome this issue?
Do i need to uninstall the Dialog instance and re-install after the completion of upgrade?
If i keep the dialog instance down, how are the java local files in /usr/sap/SID upgraded with latest support pack?

Thanks

Vik

SAP Managed Tags:
NW AS Java Administrator (NWA)

You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.

Comment

Accepted Solutions (1)

Hi Vikas,

You should not stop any instances during the initial phases of SUM.

SUM need to started on Primary node and Central instance need to be in Primary node.

Just before the Execution/downtime phase sum will refer to check guide and follow the steps to stop the dialog instance.

Thanks and Regards

Pavan.

You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.

Comment

HI Pavan,

SUM is started on Pirmary node which is the Central Instance. I have already passed step where system starts downtime phase.Now I am on first task of Execution phase where upgrade process tries to "stops system". The problem is upgrade process is unable to detect the dialog instance running on system nr 02 and gives the error:

Could not start SAP instance with number 2. Could not send the command to start the instance with number 2 on host . Error starting instance 2 on host with timeout of 7200 seconds

Any idea what is missing?

Thanks

Vik

Is the SCS up and running? If not start it and then repeat the phase in SUM. If the SUM fails to start the instance then supply the logs from the OS level. Try to manually start the instance.

Hi Vikas, Sorry for delay.

Please could you attach the logs from SUM I can provide you some solution.

In mean time could you run the below command

sapcontrol -nr <XX> -host <HOSTNAME> -user <sidadm> <password> -prot NI_HTTPS -function GetInstanceProperties

If you get any error (attach the error)

run second command

sapcontrol -nr <XX> -host <hostname> -user <sidadm> <password> -prot NI_HTTPS debug -function GetInstanceProperties

Attach the screen.

Thanks and Regards

Pavan

Hi Pavan,

Output of command you send is:

sapcontrol -nr 2 -host <Hostname> -prot NI_HTTPS -function GetInstanceProperties

01.03.2016 11:36:03

GetInstanceProperties

property, propertytype, value

Process List, NodeWebmethod, GetProcessList

Access Points, NodeWebmethod, GetAccessPointList

Current Status, NodeWebmethod, GetAlertTree

Open Alerts, NodeWebmethod, GetAlertTree

Syslog, NodeWebmethod, ABAPReadSyslog

Queue Statistic, NodeWebmethod, GetQueueStatistic

J2EE Process Table, NodeWebmethod, J2EEGetProcessList2,J2EEGetProcessList

J2EE Components, NodeWebmethod, J2EEGetComponentList

J2EE Caches, NodeWebmethod, J2EEGetCacheStatistic2,J2EEGetCacheStatistic

J2EE Threads, NodeWebmethod, J2EEGetThreadList2,J2EEGetThreadList

J2EE Sessions, NodeWebmethod, J2EEGetWebSessionList2,J2EEGetWebSessionList,J2EEGetSessionList

J2EE EJB Sessions, NodeWebmethod, J2EEGetEJBSessionList

J2EE Remote Objects, NodeWebmethod, J2EEGetRemoteObjectList

J2EE Aliases, NodeWebmethod, J2EEGetApplicationAliasList

J2EE Shared Table Info, NodeWebmethod, J2EEGetSharedTableInfo

J2EE GC History, NodeWebmethod, J2EEGetVMGCHistory2,J2EEGetVMGCHistory

J2EE Heap Memory, NodeWebmethod, J2EEGetVMHeapInfo

ICM, NodeURL, HTTP://<hostname>:50200/sap/admin/public/index.html

ICM Threads, NodeWebmethod, ICMGetThreadList

ICM Connections, NodeWebmethod, ICMGetConnectionList

ICM Cache, NodeWebmethod, ICMGetCacheEntries

ICM Proxy Connections, NodeWebmethod, ICMGetProxyConnectionList

J2EE DB Connection, Attribute, Database=ORACLE,DBHost=sape-uat-dj-v,DBName=TP1

Protected Webmethods, Attribute,

StartPriority, Attribute, 3

SAPSYSTEM, Attribute, 02

SAPSYSTEMNAME, Attribute, TP1

SAPLOCALHOST, Attribute, <hostname>

INSTANCE_NAME, Attribute, J02

IGS, NodeURL, http://<hostname>:40280

Webmethods, Attribute, Start,InstanceStart,StartBypassHA,Bootstrap,Stop,StopBypassHA,InstanceStop,Shutdown,ParameterValue,GetProcessList,GetStartProfile,GetTraceFile,GetAlertTree,GetAlerts,RestartService,StopService,GetEnvironment,ListDeveloperTraces,ReadDeveloperTrace,RestartInstance,SendSignal,GetVersionInfo,GetQueueStatistic,GetInstanceProperties,OSExecute,ReadLogFile,AnalyseLogFiles,ListLogFiles,GetAccessPointList,GetSystemInstanceList,StartSystem,StopSystem,RestartSystem,AccessCheck,GetProcessParameter,SetProcessParameter,ShmDetach,GetNetworkId,GetSecNetworkId,RequestLogonFile,CreateSnapshot,ReadSnapshot,ListSnapshots,DeleteSnapshots,GetCallstack,ABAPReadSyslog,ABAPReadRawSyslog,ABAPGetWPTable,ABAPAcknowledgeAlerts,ABAPGetSystemWPTable,J2EEGetProcessList,J2EEGetProcessList2,J2EEControlProcess,J2EEGetThreadList,J2EEGetThreadList2,J2EEGetThreadCallStack,J2EEGetThreadTaskStack,J2EEGetSessionList,J2EEGetWebSessionList,J2EEGetWebSessionList2,J2EEGetCacheStatistic,J2EEGetCacheStatistic2,J2EEGetApplicationAliasList,J2EEGetVMGCHistory,J2EEGetVMGCHistory2,J2EEGetVMHeapInfo,J2EEGetEJBSessionList,J2EEGetRemoteObjectList,J2EEGetClusterMsgList,J2EEGetSharedTableInfo,J2EEGetComponentList,J2EEControlComponents,ICMGetThreadList,ICMGetConnectionList,ICMGetCacheEntries,ICMGetProxyConnectionList,WebDispGetServerList,EnqGetLockTable,EnqRemoveLocks,EnqGetStatistic,HACheckConfig,HACheckFailoverConfig,HAGetFailoverConfig,HAFailoverToNode

******************************************************************************************************************************************************************************************************************

Output of RESTART-SYSTEM-JAVAONLY_14.LOG

Mar 1, 2016 11:24:49 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_2_528.OUT

Mar 1, 2016 11:24:49 AM [Info ]: Process ID 11 has been started.

Mar 1, 2016 11:24:49 AM [Info ]: Waiting for process ID 11, name sapcontrol to finish.

Mar 1, 2016 11:24:49 AM [Info ]: Process ID 11, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:24:49 AM [Info ]: Instance 2 on host <hostname> has status STOPPED

Mar 1, 2016 11:24:49 AM [Info ]: Instance 2 on host <hostname> already stopped.

Mar 1, 2016 11:24:49 AM [Info ]: The instance with number 2 on host <hostname> was stopped after 0 seconds.

Mar 1, 2016 11:24:49 AM [Info ]: Stopping instance number 1 on host sape-uat-dj-v with timeout of 7200 seconds.

Mar 1, 2016 11:24:49 AM [Info ]: Process ID 12, name sapcontrol has been started.

Mar 1, 2016 11:24:49 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function GetProcessList

Mar 1, 2016 11:24:49 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_1_87.OUT

Mar 1, 2016 11:24:49 AM [Info ]: Process ID 12 has been started.

Mar 1, 2016 11:24:49 AM [Info ]: Waiting for process ID 12, name sapcontrol to finish.

Mar 1, 2016 11:24:49 AM [Info ]: Process ID 12, name sapcontrol has been finished, exit code 3.

Mar 1, 2016 11:24:49 AM [Info ]: Stopping instance number 1 on host sape-uat-dj-v with timeout of 7200 seconds.

Mar 1, 2016 11:24:49 AM [Info ]: Process ID 13, name sapcontrol has been started.

Mar 1, 2016 11:24:49 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function Stop 0

Mar 1, 2016 11:24:49 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_STOP_1_11.OUT

Mar 1, 2016 11:24:49 AM [Info ]: Process ID 13 has been started.

Mar 1, 2016 11:24:49 AM [Info ]: Waiting for process ID 13, name sapcontrol to finish.

Mar 1, 2016 11:24:49 AM [Info ]: Process ID 13, name sapcontrol has been finished, exit code 0.

Mar 1, 2016 11:24:49 AM [Info ]: Sent the stop command to instance number 1 on host sape-uat-dj-v with timeout of 7200 seconds.

Mar 1, 2016 11:24:49 AM [Info ]: Process ID 14, name sapcontrol has been started.

Mar 1, 2016 11:24:49 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function WaitforStopped 7200 5

Mar 1, 2016 11:24:49 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_WAITFORSTOPPED_1_11.OUT

Mar 1, 2016 11:24:49 AM [Info ]: Process ID 14 has been started.

Mar 1, 2016 11:24:49 AM [Info ]: Waiting for process ID 14, name sapcontrol to finish.

Mar 1, 2016 11:24:54 AM [Info ]: Process ID 14, name sapcontrol has been finished, exit code 0.

Mar 1, 2016 11:24:54 AM [Info ]: The instance with number 1 on host sape-uat-dj-v was stopped after 5 seconds.

Mar 1, 2016 11:24:54 AM [Info ]: Stop service for instance 1 on host sape-uat-dj-v...

Mar 1, 2016 11:24:54 AM [Info ]: Process ID 15, name sapcontrol has been started.

Mar 1, 2016 11:24:54 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function GetProcessList

Mar 1, 2016 11:24:54 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_1_88.OUT

Mar 1, 2016 11:24:54 AM [Info ]: Process ID 15 has been started.

Mar 1, 2016 11:24:54 AM [Info ]: Waiting for process ID 15, name sapcontrol to finish.

Mar 1, 2016 11:24:54 AM [Info ]: Process ID 15, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:24:54 AM [Info ]: The sapcontrol service on host sape-uat-dj-v and instance 1 is started.

Mar 1, 2016 11:24:54 AM [Info ]: Process ID 16, name sapcontrol has been started.

Mar 1, 2016 11:24:54 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function StopService

Mar 1, 2016 11:24:54 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_STOPSERVICE_1_11.OUT

Mar 1, 2016 11:24:54 AM [Info ]: Process ID 16 has been started.

Mar 1, 2016 11:24:54 AM [Info ]: Waiting for process ID 16, name sapcontrol to finish.

Mar 1, 2016 11:24:54 AM [Info ]: Process ID 16, name sapcontrol has been finished, exit code 0.

Mar 1, 2016 11:24:54 AM [Info ]: Wait for service for instance 1 on host sape-uat-dj-v to stop...

Mar 1, 2016 11:24:56 AM [Info ]: Process ID 17, name sapcontrol has been started.

Mar 1, 2016 11:24:56 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function GetProcessList

Mar 1, 2016 11:24:56 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_1_89.OUT

Mar 1, 2016 11:24:56 AM [Info ]: Process ID 17 has been started.

Mar 1, 2016 11:24:56 AM [Info ]: Waiting for process ID 17, name sapcontrol to finish.

Mar 1, 2016 11:24:56 AM [Info ]: Process ID 17, name sapcontrol has been finished, exit code 1.

Mar 1, 2016 11:24:56 AM [Info ]: The sapcontrol service on host sape-uat-dj-v and instance 1 is not started.

Mar 1, 2016 11:24:56 AM [Info ]: Service for instance 1 on host sape-uat-dj-v has been stopped.

Mar 1, 2016 11:24:56 AM [Info ]: Restart service for instance 1 on host sape-uat-dj-v...

Mar 1, 2016 11:24:56 AM [Info ]: Process ID 18, name sapcontrol has been started.

Mar 1, 2016 11:24:56 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function GetProcessList

Mar 1, 2016 11:24:56 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_1_90.OUT

Mar 1, 2016 11:24:57 AM [Info ]: Process ID 18 has been started.

Mar 1, 2016 11:24:57 AM [Info ]: Waiting for process ID 18, name sapcontrol to finish.

Mar 1, 2016 11:24:57 AM [Info ]: Process ID 18, name sapcontrol has been finished, exit code 1.

Mar 1, 2016 11:24:57 AM [Info ]: The sapcontrol service on host sape-uat-dj-v and instance 1 is not started.

Mar 1, 2016 11:24:57 AM [Info ]: Start service for instance 1 on host sape-uat-dj-v ...

Mar 1, 2016 11:24:57 AM [Info ]: Process ID 19, name sapstartsrv has been started.

Mar 1, 2016 11:24:57 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapstartsrv pf=/usr/sap/TP1/SYS/profile/TP1_SCS01_sape-uat-dj-v -D

Mar 1, 2016 11:24:57 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/log/SUM/INSTALL_SERVICE_01_01.OUT

Mar 1, 2016 11:24:57 AM [Info ]: Process ID 19 has been started.

Mar 1, 2016 11:24:57 AM [Info ]: Waiting for process ID 19, name sapstartsrv to finish.

Mar 1, 2016 11:24:57 AM [Info ]: Process ID 19, name sapstartsrv has been finished, exit code 0.

Mar 1, 2016 11:24:57 AM [Info ]: Wait for service for instance 1 on host sape-uat-dj-v to start...

Mar 1, 2016 11:24:59 AM [Info ]: Process ID 20, name sapcontrol has been started.

Mar 1, 2016 11:24:59 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function GetProcessList

Mar 1, 2016 11:24:59 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_1_91.OUT

Mar 1, 2016 11:24:59 AM [Info ]: Process ID 20 has been started.

Mar 1, 2016 11:24:59 AM [Info ]: Waiting for process ID 20, name sapcontrol to finish.

Mar 1, 2016 11:24:59 AM [Info ]: Process ID 20, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:24:59 AM [Info ]: The sapcontrol service on host sape-uat-dj-v and instance 1 is started.

Mar 1, 2016 11:24:59 AM [Info ]: Service for instance 1 on host sape-uat-dj-v has been started.

Mar 1, 2016 11:24:59 AM [Info ]: Sleeping for 2 secods before checking whether the service is started.

Mar 1, 2016 11:25:02 AM [Info ]: Wait for service for instance 1 on host sape-uat-dj-v to start...

Mar 1, 2016 11:25:04 AM [Info ]: Process ID 21, name sapcontrol has been started.

Mar 1, 2016 11:25:04 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function GetProcessList

Mar 1, 2016 11:25:04 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_1_92.OUT

Mar 1, 2016 11:25:04 AM [Info ]: Process ID 21 has been started.

Mar 1, 2016 11:25:04 AM [Info ]: Waiting for process ID 21, name sapcontrol to finish.

Mar 1, 2016 11:25:04 AM [Info ]: Process ID 21, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:25:04 AM [Info ]: The sapcontrol service on host sape-uat-dj-v and instance 1 is started.

Mar 1, 2016 11:25:04 AM [Info ]: Service for instance 1 on host sape-uat-dj-v has been restarted.

Mar 1, 2016 11:25:04 AM [Info ]: Start service for instance 1 on host sape-uat-dj-v ...

Mar 1, 2016 11:25:04 AM [Info ]: Process ID 22, name sapstartsrv has been started.

Mar 1, 2016 11:25:04 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapstartsrv pf=/usr/sap/TP1/SYS/profile/TP1_SCS01_sape-uat-dj-v -D

Mar 1, 2016 11:25:04 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/log/SUM/INSTALL_SERVICE_01_02.OUT

Mar 1, 2016 11:25:04 AM [Info ]: Process ID 22 has been started.

Mar 1, 2016 11:25:04 AM [Info ]: Waiting for process ID 22, name sapstartsrv to finish.

Mar 1, 2016 11:25:04 AM [Info ]: Process ID 22, name sapstartsrv has been finished, exit code 0.

Mar 1, 2016 11:25:04 AM [Info ]: Wait for service for instance 1 on host sape-uat-dj-v to start...

Mar 1, 2016 11:25:06 AM [Info ]: Process ID 23, name sapcontrol has been started.

Mar 1, 2016 11:25:06 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function GetProcessList

Mar 1, 2016 11:25:06 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_1_93.OUT

Mar 1, 2016 11:25:06 AM [Info ]: Process ID 23 has been started.

Mar 1, 2016 11:25:06 AM [Info ]: Waiting for process ID 23, name sapcontrol to finish.

Mar 1, 2016 11:25:06 AM [Info ]: Process ID 23, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:25:06 AM [Info ]: The sapcontrol service on host sape-uat-dj-v and instance 1 is started.

Mar 1, 2016 11:25:06 AM [Info ]: Service for instance 1 on host sape-uat-dj-v has been started.

Mar 1, 2016 11:25:06 AM [Info ]: Starting instance number 1 on host sape-uat-dj-v with timeout of 7200 seconds.

Mar 1, 2016 11:25:06 AM [Info ]: Process ID 24, name sapcontrol has been started.

Mar 1, 2016 11:25:06 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function GetProcessList

Mar 1, 2016 11:25:06 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_1_94.OUT

Mar 1, 2016 11:25:06 AM [Info ]: Process ID 24 has been started.

Mar 1, 2016 11:25:06 AM [Info ]: Waiting for process ID 24, name sapcontrol to finish.

Mar 1, 2016 11:25:06 AM [Info ]: Process ID 24, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:25:06 AM [Info ]: Starting instance number 1 on host sape-uat-dj-v with timeout of 7200 seconds.

Mar 1, 2016 11:25:06 AM [Info ]: Triggering an instance start by sapcontrol...

Mar 1, 2016 11:25:06 AM [Info ]: Process ID 25, name sapcontrol has been started.

Mar 1, 2016 11:25:06 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function Start

Mar 1, 2016 11:25:06 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_START_1_11.OUT

Mar 1, 2016 11:25:06 AM [Info ]: Process ID 25 has been started.

Mar 1, 2016 11:25:06 AM [Info ]: Waiting for process ID 25, name sapcontrol to finish.

Mar 1, 2016 11:25:07 AM [Info ]: Process ID 25, name sapcontrol has been finished, exit code 0.

Mar 1, 2016 11:25:07 AM [Info ]: An instance start was triggered.

Mar 1, 2016 11:25:07 AM [Info ]: Sent the start command to instance number 1 on host sape-uat-dj-v with timeout of 7200 seconds.

Mar 1, 2016 11:25:07 AM [Info ]: Process ID 26, name sapcontrol has been started.

Mar 1, 2016 11:25:07 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 1 -host sape-uat-dj-v -prot NI_HTTP -function WaitforStarted 7200 5

Mar 1, 2016 11:25:07 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_WAITFORSTARTED_1_11.OUT

Mar 1, 2016 11:25:07 AM [Info ]: Process ID 26 has been started.

Mar 1, 2016 11:25:07 AM [Info ]: Waiting for process ID 26, name sapcontrol to finish.

Mar 1, 2016 11:25:22 AM [Info ]: Process ID 26, name sapcontrol has been finished, exit code 0.

Mar 1, 2016 11:25:22 AM [Info ]: The instance with number 1 on host sape-uat-dj-v was started after 16 seconds.

Mar 1, 2016 11:25:22 AM [Info ]: Restart service for instance 0 on host sape-uat-dj-v...

Mar 1, 2016 11:25:22 AM [Info ]: Process ID 27, name sapcontrol has been started.

Mar 1, 2016 11:25:22 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 0 -host sape-uat-dj-v -prot NI_HTTPS -function GetProcessList

Mar 1, 2016 11:25:22 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_0_86.OUT

Mar 1, 2016 11:25:22 AM [Info ]: Process ID 27 has been started.

Mar 1, 2016 11:25:22 AM [Info ]: Waiting for process ID 27, name sapcontrol to finish.

Mar 1, 2016 11:25:22 AM [Info ]: Process ID 27, name sapcontrol has been finished, exit code 1.

Mar 1, 2016 11:25:22 AM [Info ]: The sapcontrol service on host sape-uat-dj-v and instance 0 is not started.

Mar 1, 2016 11:25:22 AM [Info ]: Start service for instance 0 on host sape-uat-dj-v ...

Mar 1, 2016 11:25:22 AM [Info ]: Process ID 28, name sapstartsrv has been started.

Mar 1, 2016 11:25:22 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapstartsrv pf=/usr/sap/TP1/SYS/profile/TP1_J00_sape-uat-dj-v -D

Mar 1, 2016 11:25:22 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/log/SUM/INSTALL_SERVICE_00_01.OUT

Mar 1, 2016 11:25:22 AM [Info ]: Process ID 28 has been started.

Mar 1, 2016 11:25:22 AM [Info ]: Waiting for process ID 28, name sapstartsrv to finish.

Mar 1, 2016 11:25:23 AM [Info ]: Process ID 28, name sapstartsrv has been finished, exit code 0.

Mar 1, 2016 11:25:23 AM [Info ]: Wait for service for instance 0 on host sape-uat-dj-v to start...

Mar 1, 2016 11:25:25 AM [Info ]: Process ID 29, name sapcontrol has been started.

Mar 1, 2016 11:25:25 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 0 -host sape-uat-dj-v -prot NI_HTTPS -function GetProcessList

Mar 1, 2016 11:25:25 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_0_87.OUT

Mar 1, 2016 11:25:25 AM [Info ]: Process ID 29 has been started.

Mar 1, 2016 11:25:25 AM [Info ]: Waiting for process ID 29, name sapcontrol to finish.

Mar 1, 2016 11:25:25 AM [Info ]: Process ID 29, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:25:25 AM [Info ]: The sapcontrol service on host sape-uat-dj-v and instance 0 is started.

Mar 1, 2016 11:25:25 AM [Info ]: Service for instance 0 on host sape-uat-dj-v has been started.

Mar 1, 2016 11:25:25 AM [Info ]: Sleeping for 2 secods before checking whether the service is started.

Mar 1, 2016 11:25:28 AM [Info ]: Wait for service for instance 0 on host sape-uat-dj-v to start...

Mar 1, 2016 11:25:30 AM [Info ]: Process ID 30, name sapcontrol has been started.

Mar 1, 2016 11:25:30 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 0 -host sape-uat-dj-v -prot NI_HTTPS -function GetProcessList

Mar 1, 2016 11:25:30 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_0_88.OUT

Mar 1, 2016 11:25:30 AM [Info ]: Process ID 30 has been started.

Mar 1, 2016 11:25:30 AM [Info ]: Waiting for process ID 30, name sapcontrol to finish.

Mar 1, 2016 11:25:30 AM [Info ]: Process ID 30, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:25:30 AM [Info ]: The sapcontrol service on host sape-uat-dj-v and instance 0 is started.

Mar 1, 2016 11:25:30 AM [Info ]: Service for instance 0 on host sape-uat-dj-v has been restarted.

Mar 1, 2016 11:25:30 AM [Info ]: Restart service for instance 2 on host <hostname>...

Mar 1, 2016 11:25:30 AM [Info ]: Process ID 31, name sapcontrol has been started.

Mar 1, 2016 11:25:30 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host <hostname> -prot NI_HTTPS -function GetProcessList

Mar 1, 2016 11:25:30 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_2_529.OUT

Mar 1, 2016 11:25:30 AM [Info ]: Process ID 31 has been started.

Mar 1, 2016 11:25:30 AM [Info ]: Waiting for process ID 31, name sapcontrol to finish.

Mar 1, 2016 11:25:30 AM [Info ]: Process ID 31, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:25:30 AM [Info ]: The sapcontrol service on host <hostname> and instance 2 is started.

Mar 1, 2016 11:25:30 AM [Info ]: Process ID 32, name sapcontrol has been started.

Mar 1, 2016 11:25:30 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host <hostname> -prot NI_HTTPS -function RestartService

Mar 1, 2016 11:25:30 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_RESTARTSERVICE_2_07.OUT

Mar 1, 2016 11:25:30 AM [Info ]: Process ID 32 has been started.

Mar 1, 2016 11:25:30 AM [Info ]: Waiting for process ID 32, name sapcontrol to finish.

Mar 1, 2016 11:25:30 AM [Info ]: Process ID 32, name sapcontrol has been finished, exit code 0.

Mar 1, 2016 11:25:30 AM [Info ]: Sleeping for 2 secods before checking whether the service is started.

Mar 1, 2016 11:25:33 AM [Info ]: Wait for service for instance 2 on host <hostname> to start...

Mar 1, 2016 11:25:35 AM [Info ]: Process ID 33, name sapcontrol has been started.

Mar 1, 2016 11:25:35 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host <hostname> -prot NI_HTTPS -function GetProcessList

Mar 1, 2016 11:25:35 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_2_530.OUT

Mar 1, 2016 11:25:35 AM [Info ]: Process ID 33 has been started.

Mar 1, 2016 11:25:35 AM [Info ]: Waiting for process ID 33, name sapcontrol to finish.

Mar 1, 2016 11:25:35 AM [Info ]: Process ID 33, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:25:35 AM [Info ]: The sapcontrol service on host <hostname> and instance 2 is started.

Mar 1, 2016 11:25:35 AM [Info ]: Service for instance 2 on host <hostname> has been restarted.

Mar 1, 2016 11:25:35 AM [Info ]: Start service for instance 0 on host sape-uat-dj-v ...

Mar 1, 2016 11:25:35 AM [Info ]: Process ID 34, name sapstartsrv has been started.

Mar 1, 2016 11:25:35 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapstartsrv pf=/usr/sap/TP1/SYS/profile/TP1_J00_sape-uat-dj-v -D

Mar 1, 2016 11:25:35 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/log/SUM/INSTALL_SERVICE_00_02.OUT

Mar 1, 2016 11:25:35 AM [Info ]: Process ID 34 has been started.

Mar 1, 2016 11:25:35 AM [Info ]: Waiting for process ID 34, name sapstartsrv to finish.

Mar 1, 2016 11:25:35 AM [Info ]: Process ID 34, name sapstartsrv has been finished, exit code 0.

Mar 1, 2016 11:25:35 AM [Info ]: Wait for service for instance 0 on host sape-uat-dj-v to start...

Mar 1, 2016 11:25:37 AM [Info ]: Process ID 35, name sapcontrol has been started.

Mar 1, 2016 11:25:37 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 0 -host sape-uat-dj-v -prot NI_HTTPS -function GetProcessList

Mar 1, 2016 11:25:37 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_0_89.OUT

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 35 has been started.

Mar 1, 2016 11:25:38 AM [Info ]: Waiting for process ID 35, name sapcontrol to finish.

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 35, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:25:38 AM [Info ]: The sapcontrol service on host sape-uat-dj-v and instance 0 is started.

Mar 1, 2016 11:25:38 AM [Info ]: Service for instance 0 on host sape-uat-dj-v has been started.

Mar 1, 2016 11:25:38 AM [Info ]: Starting instance number 0 on host sape-uat-dj-v with timeout of 7200 seconds.

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 36, name sapcontrol has been started.

Mar 1, 2016 11:25:38 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 0 -host sape-uat-dj-v -prot NI_HTTPS -function GetProcessList

Mar 1, 2016 11:25:38 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_0_90.OUT

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 36 has been started.

Mar 1, 2016 11:25:38 AM [Info ]: Waiting for process ID 36, name sapcontrol to finish.

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 36, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:25:38 AM [Info ]: Starting instance number 0 on host sape-uat-dj-v with timeout of 7200 seconds.

Mar 1, 2016 11:25:38 AM [Info ]: Triggering an instance start by sapcontrol...

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 37, name sapcontrol has been started.

Mar 1, 2016 11:25:38 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 0 -host sape-uat-dj-v -prot NI_HTTPS -function Start

Mar 1, 2016 11:25:38 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_START_0_07.OUT

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 37 has been started.

Mar 1, 2016 11:25:38 AM [Info ]: Waiting for process ID 37, name sapcontrol to finish.

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 37, name sapcontrol has been finished, exit code 0.

Mar 1, 2016 11:25:38 AM [Info ]: An instance start was triggered.

Mar 1, 2016 11:25:38 AM [Info ]: Sent the start command to instance number 0 on host sape-uat-dj-v with timeout of 7200 seconds.

Mar 1, 2016 11:25:38 AM [Info ]: Starting instance number 2 on host <hostname> with timeout of 7200 seconds.

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 38, name sapcontrol has been started.

Mar 1, 2016 11:25:38 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host <hostname> -prot NI_HTTPS -function GetProcessList

Mar 1, 2016 11:25:38 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_2_531.OUT

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 38 has been started.

Mar 1, 2016 11:25:38 AM [Info ]: Waiting for process ID 38, name sapcontrol to finish.

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 38, name sapcontrol has been finished, exit code 4.

Mar 1, 2016 11:25:38 AM [Info ]: Starting instance number 2 on host <hostname> with timeout of 7200 seconds.

Mar 1, 2016 11:25:38 AM [Info ]: Triggering an instance start by sapcontrol...

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 39, name sapcontrol has been started.

Mar 1, 2016 11:25:38 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host <hostname> -prot NI_HTTPS -function Start

Mar 1, 2016 11:25:38 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_START_2_12.OUT

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 39 has been started.

Mar 1, 2016 11:25:38 AM [Info ]: Waiting for process ID 39, name sapcontrol to finish.

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 39, name sapcontrol has been finished, exit code 0.

Mar 1, 2016 11:25:38 AM [Info ]: An instance start was triggered.

Mar 1, 2016 11:25:38 AM [Info ]: Sent the start command to instance number 2 on host <hostname> with timeout of 7200 seconds.

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 40, name sapcontrol has been started.

Mar 1, 2016 11:25:38 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 0 -host sape-uat-dj-v -prot NI_HTTPS -function WaitforStarted 144000 5

Mar 1, 2016 11:25:38 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_WAITFORSTARTED_0_02.OUT

Mar 1, 2016 11:25:38 AM [Info ]: Process ID 40 has been started.

Mar 1, 2016 11:25:38 AM [Info ]: Waiting for process ID 40, name sapcontrol to finish.

Mar 1, 2016 11:28:28 AM [Info ]: Process ID 40, name sapcontrol has been finished, exit code 0.

Mar 1, 2016 11:28:29 AM [Info ]: Process ID 41, name sapcontrol has been started.

Mar 1, 2016 11:28:29 AM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host <hostname> -prot NI_HTTPS -function WaitforStarted 144000 5

Mar 1, 2016 11:28:29 AM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_WAITFORSTARTED_2_02.OUT

Mar 1, 2016 11:28:29 AM [Info ]: Process ID 41 has been started.

Mar 1, 2016 11:28:29 AM [Info ]: Waiting for process ID 41, name sapcontrol to finish.

Mar 1, 2016 11:28:39 AM [Info ]: Process ID 41, name sapcontrol has been finished, exit code 2.

Mar 1, 2016 11:28:39 AM [Error ]: Return code condition success evaluated to false for process sapcontrol for action wait for started.

Mar 1, 2016 11:28:39 AM [Error ]: The following problem has occurred during step execution: com.sap.sdt.util.diag.DiagException: Could not check status of SAP instance with number 2.

Could not check if the instance number 2 on host <hostname> is started.

Sapcontrol client could not perform action wait for started on instance 2

Return code condition success evaluated to false for process sapcontrol for action wait for started.

*************************************************************************************************************

Thanks

Vikas

Hi Vikas,

After seeing the RESTART-SYSTEM-JAVAONLY_14.LOG it seems that instance number 0 & 2 was not started. Please could you attach the SAPCONTROL_WAITFORSTARTED_0_02.OUT & SAPCONTROL_WAITFORSTARTED_2_02.OUT files.

Did you manage to stop and start the instance 0 & 2 manually, also check the commands from SAPCONTROL_START_2_12.OUT & SAPCONTROL_START_0_07.OUT & run those by your self and update the status.

Thanks

Pavan

HI Pavan,

My both CI and Dialog instance are up before starting the SUM process, But the moment the process errors out, i see the dialog instance is down. That means the SUM process is actually connecting to dialog instance and shutting down.

Please see the results below for various commands:

**************************************************************************************************************

tp1adm> sapcontrol -nr 00 -prot NI_HTTPS -function GetProcessList

02.03.2016 17:08:52

GetProcessList

name, description, dispstatus, textstatus, starttime, elapsedtime, pid

jstart, J2EE Server, GREEN, All processes running, 2016 03 02 16:58:28, 0:10:24, 51122

igswd_mt, IGS Watchdog, GREEN, Running, 2016 03 02 16:58:28, 0:10:24, 51123

**************************************************************************************************************

tp1adm> sapcontrol -nr 2 -host sapeap-uat-m3 -prot NI_HTTPS -function GetSystemInstanceList

02.03.2016 17:05:31

GetSystemInstanceList

hostname, instanceNr, httpPort, httpsPort, startPriority, features, dispstatus

sape-uat-dj-v, 0, 50013, 50014, 3, J2EE|ICMAN|IGS, GREEN

sapedb-uat-m1, 10, 51013, 0, 3, WEBDISP, GREEN

sape-uat-dj-v, 1, 50113, 0, 1, GATEWAY|MESSAGESERVER|ENQUE, GREEN

sapeap-uat-m3, 2, 50213, 50214, 3, J2EE|ICMAN|IGS, YELLOW

**************************************************************************************************************

Output of SAPCONTROL_WAITFORSTARTED_0_06.OUT is enclosed:

*************************************************************************************************************

tp1adm> cat /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_WAITFORSTARTED_0_06.OUT

02.03.2016 17:00:47

WaitforStarted

tp1adm> cat /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_WAITFORSTARTED_2_06.OUT

02.03.2016 17:00:57

WaitforStarted

FAIL: process jstart J2EE Server not running

*************************************************************************************************************

SAPCONTROL_WAITFORSTARTED_2_06.OUT

****************************************************************************************************************

tp1adm> cat /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_WAITFORSTARTED_0_06.OUT

02.03.2016 17:00:47

WaitforStarted

Thanks

vikas

Did you check the logs from the work directory to understand why the instance failed to start?

Hi Reagan,

In Dialog instance work directory, I see error like:

Log: dev_jstart

F ********************************************************************************

F Process snapshot started with pid 26656

F ********************************************************************************

F [Thr 139738767996768] *** LOG => Process snapshot started (pid 26656).

F [Thr 139738767996768] *** LOG => Process snapshot running (pid 26656).

F [Thr 139738767996768] *** LOG => SAP Start Service (pid 26449) connected.

F [Thr 139738767996768] *** LOG => SAP Start Service (pid 26449) disconnected.

F [Thr 139738767996768] Wed Mar 2 16:58:18 2016

F [Thr 139738767996768] *** LOG => Signal 17 SIGCHLD.

F [Thr 139738767996768] *** LOG => Process snapshot stopped (pid 26656).

F [Thr 139738767996768] *** LOG => Instance state is "Synchronizing binaries" (STOPPING @ 0, INACTIVE).

F [Thr 139738767996768] *** LOG => Run level 2 completed.

F [Thr 139738767996768] *** LOG => Instance state is "Some processes failed" (STOPPED @ 0, INACTIVE).

I [Thr 139738767996768] MPI: dynamic quotas disabled.

I [Thr 139738767996768] MPI init: pipes=4000 buffers=1279 reserved=383 quota=10%

F ********************************************************************************

F *** ERROR => Node 'bootstrap' failed with exit code 558.

F ***

F *** Please see section 'Failures in the 'synchronizing binaries' phase'

F *** in SAP Note 1316652 for additional information and trouble shooting advice.

F ********************************************************************************

Log dev_bootstrap

F [Thr 140301051475712] Wed Mar 2 16:58:08 2016

F [Thr 140301051475712] *** LOG => State changed from 2 (Starting framework) to 5 (Stopping).

F [Thr 140301051475712] *** LOG state real time: 1.011 CPU time: 0.090 sys, 2.480 usr

F [Thr 140301051475712] *** LOG total real time: 2.156 CPU time: 0.640 sys, 4.260 usr

F [Thr 140301051475712]

F [Thr 140301024282368] Wed Mar 2 16:58:08 2016

F [Thr 140301024282368] *** LOG => SfCJavaVm: exit hook is called. (rc = 558)

F Wed Mar 2 16:58:08 2016

F ********************************************************************************

F *** ERROR => Java node 'Instance_bootstrap' terminated with exit code 558.

F ***

F *** Please see section 'Java program exit codes'

F *** in SAP Note 1316652 for additional information and trouble shooting advice.

F ********************************************************************************

F [Thr 140301258303328] *** LOG => exiting (exitcode 558, retcode 1).

M [Thr 140301258303328] CCMS: CCMS Monitoring Cleanup finished successfully.

##############################################################################

My original problem is, I am upgrading SP stack in Central Instance, Why can't i leave the dialog instance shut and continue patching. Once completed, then start the dialog instance. Why does SUM process need to Stop/Start the Dialog instance.

Thanks

Vikas

Is the Central Services up and running?

Hi Reagan,

Yes Central System is up and running, Also i can manually start/stop dialog instance too. It is problem with only SUM, that is unable to control it.

thanks

Vik

Hi Vikas,

After seeing the logs and messages about starting and stopping the instance manually.

So it means some permission issues with sapcontrol. Please could you oss note 1563660 for sapuxuserchk.

Thanks

Pav

If the SCS is up and running the I suspect the issue could be related to the sapstartsrv.

First check if the kernel patches for SCS and J00 instance are same.

As <SID>adm run the below command

sapcontrol -nr 00 -function GetVersionInfo

You need to run the command twice by replacing 00 with the instance number of SCS and secondly with the instance number of PAS

Check the ownership and permissions of the sapuxuserchk file. Follow note

927637 - Web service authentication in sapstartsrv as of Release 7.00

Try restarting the sapstartsrv process and repeat the phase in SUM and if that doesn't help follow the recommendations given in this KBA

1563660 - sapcontrol, user authorization issues (SUM)

Cheers

Hi Reagan,

I followed instructions you send especially made the changes as per Note 927637 and 1563660 and got the following output:

tp1adm> sapcontrol -nr 00 -function AccessCheck Start

03.03.2016 11:02:31

AccessCheck

tp1adm> sapcontrol -nr 01 -function AccessCheck Start

03.03.2016 11:02:40

AccessCheck

tp1adm> sapcontrol -nr 02 -function AccessCheck Start

03.03.2016 11:02:18

AccessCheck

tp1adm> sapcontrol -nr 00 -function GetStartProfile | grep protectedwebmethods

service/protectedwebmethods = NONE

tp1adm> sapcontrol -nr 01 -function GetStartProfile | grep protectedwebmethods

service/protectedwebmethods = NONE

tp1adm> sapcontrol -nr 02 -function GetStartProfile | grep protectedwebmethods

service/protectedwebmethods = NONE

Also the output of sapcontrol -nr 00 -function GetVersionInfo is enclosed:

tp1adm> sapcontrol -nr 00 -function GetVersionInfo

03.03.2016 09:46:32

GetVersionInfo

Filename, VersionInfo, Time

/usr/sap/TP1/J00/exe/sapstartsrv, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:41

/usr/sap/TP1/J00/exe/disp+work, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:09

/usr/sap/TP1/J00/exe/gwrd, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:37:33

/usr/sap/TP1/J00/exe/msg_server, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:39:11

/usr/sap/TP1/J00/exe/dboraslib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:09

/usr/sap/TP1/J00/exe/dbmssslib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:09

/usr/sap/TP1/J00/exe/dbdb2slib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:09

/usr/sap/TP1/J00/exe/dbdb4slib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:09

/usr/sap/TP1/J00/exe/dbdb6slib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:09

/usr/sap/TP1/J00/exe/dbsybslib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:09

/usr/sap/TP1/J00/exe/enserver, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:39:09

/usr/sap/TP1/J00/exe/icman, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:33

/usr/sap/TP1/J00/exe/sapwebdisp, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:41

/usr/sap/TP1/J00/exe/jcontrol, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:33

/usr/sap/TP1/J00/exe/jlaunch, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:36

/usr/sap/TP1/J00/exe/jstart, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:36

Central Services:

tp1adm> sapcontrol -nr 01 -function GetVersionInfo

03.03.2016 09:50:48

GetVersionInfo

Filename, VersionInfo, Time

/usr/sap/TP1/SCS01/exe/sapstartsrv, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:41

/usr/sap/TP1/SCS01/exe/disp+work, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:59

/usr/sap/TP1/SCS01/exe/gwrd, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:37:33

/usr/sap/TP1/SCS01/exe/msg_server, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:38

/usr/sap/TP1/SCS01/exe/dbadaslib.so, 700, patch 291, changelist 1230074, optu (Feb 27 2011, 20:05:46), linuxx86_64, 2013 03 05 14:33:09

/usr/sap/TP1/SCS01/exe/dboraslib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:59

/usr/sap/TP1/SCS01/exe/dbmssslib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:59

/usr/sap/TP1/SCS01/exe/dbdb2slib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:59

/usr/sap/TP1/SCS01/exe/dbdb4slib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:59

/usr/sap/TP1/SCS01/exe/dbdb6slib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:59

/usr/sap/TP1/SCS01/exe/dbsybslib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:39:59

/usr/sap/TP1/SCS01/exe/enserver, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:32

/usr/sap/TP1/SCS01/exe/icman, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:40:00

/usr/sap/TP1/SCS01/exe/sapwebdisp, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:41

/usr/sap/TP1/SCS01/exe/jcontrol, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:40:00

/usr/sap/TP1/SCS01/exe/jlaunch, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:40:01

/usr/sap/TP1/SCS01/exe/jstart, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:40:01

Dialog Instance:

tp1adm> sapcontrol -nr 02 -function GetVersionInfo

03.03.2016 09:51:04

GetVersionInfo

Filename, VersionInfo, Time

/usr/sap/TP1/J02/exe/sapstartsrv, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:41

/usr/sap/TP1/J02/exe/disp+work, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 22:43:47

/usr/sap/TP1/J02/exe/gwrd, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 21:37:33

/usr/sap/TP1/J02/exe/msg_server, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 22:43:54

/usr/sap/TP1/J02/exe/dboraslib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 22:43:47

/usr/sap/TP1/J02/exe/dbmssslib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 22:43:47

/usr/sap/TP1/J02/exe/dbdb2slib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 22:43:47

/usr/sap/TP1/J02/exe/dbdb4slib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 22:43:47

/usr/sap/TP1/J02/exe/dbdb6slib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 22:43:47

/usr/sap/TP1/J02/exe/dbsybslib.so, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:06:57), linuxx86_64, 2016 02 29 22:43:47

/usr/sap/TP1/J02/exe/enserver, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 22:43:48

/usr/sap/TP1/J02/exe/icman, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:33

/usr/sap/TP1/J02/exe/sapwebdisp, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:41

/usr/sap/TP1/J02/exe/jcontrol, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:33

/usr/sap/TP1/J02/exe/jlaunch, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:36

/usr/sap/TP1/J02/exe/jstart, 722, patch 4, changelist 1580194, optu (EXT) (May 13 2015, 20:56:20), linuxx86_64, 2016 02 29 21:37:36

After this i tried to re-run the Upgrade, but still no luck. It failed again.

Thanks

Vik

I would set the value of the service/protectedwebmethods parameter to the values suggested in the note and restart the service. If none of these help then try with a different version of the sapstartsrv.

HI Pavan,

The permission for sapuxuserchk are set as per :

chown root:sapsys sapuxuserchk

chmod 4750 sapuxuserchk

Thanks

Vikas

HI Reagan,

Thank you so much for helping out to fix this issue. As per your advice, I changed the parameter to service/protectedwebmethods = DEFAULT :

tp1adm> sapcontrol -nr 00 -function GetStartProfile | grep protectedwebmethods

service/protectedwebmethods = DEFAULT

tp1adm> sapcontrol -nr 01 -function GetStartProfile | grep protectedwebmethods

service/protectedwebmethods = DEFAULT

tp1adm> sapcontrol -nr 02 -function GetStartProfile | grep protectedwebmethods

service/protectedwebmethods = DEFAULT

Then upgraded the Kernel to 722_EXT_REL Patch 25 (latest), this i believe will upgrade the sapstartsrv also.

Started both CI and Dialog Instance, Restarted the SUM process again. This time different error:

SUM process stopped the CI gracefully, but unable to stop the Dialog instance. The error returned is:

Could not stop SAP instance with number 2. Could not stop SAP instance with number 2. Could not send the command to stop the instance with number 2 on host sapeap-uat-m3. Error stopping instance 2 on host sapeap-uat-m3 with timeout of 7200 seconds. Sapcontrol client could not perform action stop on instance 2 Return code condition success evaluated to false for process sapcontrol for action stop.

Anything else i am missing?

Thanks

Vikas

Hi Vikas,

Changes the userid to SIDADM instead of root user for sapuxuserchk.

Thanks

Pavan.

Hi Pavan,

The ownership of sapuxuserchk was <sid>adm before and still i got error, I followed the note 1563660 and change it to root.

Thanks

Vikas

Hi Vikas,

Have you tired the step 6 & 7 from OSS Note 1563660. I've noticed that you have modified the parameter value to SDEFAULT.

Go through with the commands mentioned in that note.

Regards

Pavan,

Hi Pavan

Thanks for helping out.

The steps 6 & 7 you mentioned in note are only to activate the profile value SDEFAULT, I don't need that, since after setting the value i restarted the complete instance along with "sapstartsrv" in each instance.

Thanks

vikas

Answers (4)

Vikas,

You need to keep the Application Servers up and running during the EHP/SPS update process.

Regarding the issue, are you able to stop and start the instance manually?

Let's try this.

1 - Set the parameter service/protectedwebmethods as mentioned in the SAP notes I have given.

2 - Delete all SAP stream files and files owned by the <SID>adm user under /tmp filesystem

3 - Restart the SAP instances

4 - Repeat the phase in SUM

If this doesn't help then try the recommendation given in this SAP KBA

1664214 - Upgrade is not able to start or stop an instance because of an "HTTP error 401 Unauthorize.... Also consider deleting the stream files or files owned by the <SID>adm user.

If none of these helps then raise an OSS message under BC-UPG-TLS-TLJ

Good luck and let me know.

You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.

Comment

Hi Reagan,

yes, i can stop start the Dialog instance without any issue (never had problem).

I set the parameter service/protectedwebmethods with all options (NONE, DEFAULT, SDEFAULT) but nothing seem to work.

Also i already tried steps you mentioned from 1 to 4 multiple times, NO success.

The note # 1664214 also points mainly to change parameter value to NONE, which i already tried.

I tried create OSS message, they could not find anything. They think it is database issue and passed it to DB team.

Thanks

Vikas

Hi Vikas,

Kindly run the command manually at OS level

/usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host sapeap-uat-m3 -prot NI_HTTPS -function Stop 0

and paste the output.

With Regards

Ashutosh Chaturvedi

You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.

Comment

Hi Ashutosh,

Output is enclosed:

tp1adm> /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host sapeap-uat-m3 -prot NI_HTTPS -function Stop 0

07.03.2016 13:20:19

Stop

Hi Vikas,

Could you please check the below note.

2065233 - SUM: Correcting a memory conflict issue during the RESTART-SYSTEM-FINAL step

Regards

Bala

Hi Vikas,

Can you please share the details and landscape information?

We will start it from beginning.

With Regards

Ashutosh Chaturvedi

Hi Ashutosh,

Thanks for coming to help. Please find below landscape information.

SAP Enterprise Portal 7.31 SP-5

Host 1 Linux Oracle 11204 running Central Instance and Central Services

Host 2 LInux running single Dialog Instance

Both instance are running fine.

Upgrading to Java stack SP-17 using SUM tool SP-13. I am in "execution Phase" and now the SUM tool is unable to start/stop the Dialog instance. If the Dialog instance is up, SUM cannot stop it and vice versa.

I tried with recommendations in Note # 1563660 and as per that tried parameter:

service/protectedwebmethods = SDEFAULT

service/protectedwebmethods = DEFAULT

service/protectedwebmethods = NONE

chown root:sapsys <path>/sapuxuserchk

chmod u+s,o-rwx <path>/sapuxuserchk

None of the solutions seem to work.

Is there anyway other than deleting the Dialog instance, so that SUM does not look for Dialog instance. I would like to keep it down during whole upgrade process and only start it once the Upgrade is completed.

Thanks

Vik

Bala,

The note suggests to do "cleanipc" of process. But that does not seem to be issue. Since even after restarting the host, i get same issue.

Thanks

Vikas

Dear Vikas,

Follow the below steps

_ stop all the sap system & SUM tool

- kill all the sapstartsrv services related to instance on both the host .

-Remove all the profiles related to dialog instance from profile directory.

-now goto global directory and look for the sapcontrol folder. Delete all the files present in the folder .

- Now login to each each Linux box and goto /tmp file

And remove all the .sapstream file. This are hidden file.

Fire the command ls -ltra .

- start the CI system only.

Start the Sum and let us know outcome.

With Regards

Ashutosh Chaturvedi

Hi Ashutosh,

Tried the steps you send. Then run the SUM and now i see the error:

Service for instance 2 on host sapeap-uat-m3 is not started after 240 seconds.

Thanks

Vik

Hi Vikas,

Kindly attach last five log file which got updated.

With Regards

Ashutosh Chaturvedi

Hi Ashutosh,

output of RESTART-SYSTEM-JAVAONLY_33.LOG is

Mar 8, 2016 12:17:30 PM [Info ]: Waiting for process ID 147, name sapcontrol to finish.

Mar 8, 2016 12:17:30 PM [Info ]: Process ID 147, name sapcontrol has been finished, exit code 1.

Mar 8, 2016 12:17:30 PM [Info ]: The sapcontrol service on host sapeap-uat-m3 and instance 2 is not started.

Mar 8, 2016 12:17:32 PM [Info ]: Process ID 148, name sapcontrol has been started.

Mar 8, 2016 12:17:32 PM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host sapeap-uat-m3 -prot NI_HTTPS -function GetProcessList

Mar 8, 2016 12:17:32 PM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_2_824.OUT

Mar 8, 2016 12:17:32 PM [Info ]: Process ID 148 has been started.

Mar 8, 2016 12:17:32 PM [Info ]: Waiting for process ID 148, name sapcontrol to finish.

Mar 8, 2016 12:17:32 PM [Info ]: Process ID 148, name sapcontrol has been finished, exit code 1.

Mar 8, 2016 12:17:32 PM [Info ]: The sapcontrol service on host sapeap-uat-m3 and instance 2 is not started.

Mar 8, 2016 12:17:34 PM [Info ]: Process ID 149, name sapcontrol has been started.

Mar 8, 2016 12:17:34 PM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host sapeap-uat-m3 -prot NI_HTTPS -function GetProcessList

Mar 8, 2016 12:17:34 PM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_2_825.OUT

Mar 8, 2016 12:17:34 PM [Info ]: Process ID 149 has been started.

Mar 8, 2016 12:17:34 PM [Info ]: Waiting for process ID 149, name sapcontrol to finish.

Mar 8, 2016 12:17:34 PM [Info ]: Process ID 149, name sapcontrol has been finished, exit code 1.

Mar 8, 2016 12:17:34 PM [Info ]: The sapcontrol service on host sapeap-uat-m3 and instance 2 is not started.

Mar 8, 2016 12:17:36 PM [Info ]: Process ID 150, name sapcontrol has been started.

Mar 8, 2016 12:17:36 PM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host sapeap-uat-m3 -prot NI_HTTPS -function GetProcessList

Mar 8, 2016 12:17:36 PM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_2_826.OUT

Mar 8, 2016 12:17:36 PM [Info ]: Process ID 150 has been started.

Mar 8, 2016 12:17:36 PM [Info ]: Waiting for process ID 150, name sapcontrol to finish.

Mar 8, 2016 12:17:36 PM [Info ]: Process ID 150, name sapcontrol has been finished, exit code 1.

Mar 8, 2016 12:17:36 PM [Info ]: The sapcontrol service on host sapeap-uat-m3 and instance 2 is not started.

Mar 8, 2016 12:17:38 PM [Info ]: Process ID 151, name sapcontrol has been started.

Mar 8, 2016 12:17:38 PM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host sapeap-uat-m3 -prot NI_HTTPS -function GetProcessList

Mar 8, 2016 12:17:38 PM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_2_827.OUT

Mar 8, 2016 12:17:39 PM [Info ]: Process ID 151 has been started.

Mar 8, 2016 12:17:39 PM [Info ]: Waiting for process ID 151, name sapcontrol to finish.

Mar 8, 2016 12:17:39 PM [Info ]: Process ID 151, name sapcontrol has been finished, exit code 1.

Mar 8, 2016 12:17:39 PM [Info ]: The sapcontrol service on host sapeap-uat-m3 and instance 2 is not started.

Mar 8, 2016 12:17:41 PM [Info ]: Process ID 152, name sapcontrol has been started.

Mar 8, 2016 12:17:41 PM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host sapeap-uat-m3 -prot NI_HTTPS -function GetProcessList

Mar 8, 2016 12:17:41 PM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_GETPROCESSLIST_2_828.OUT

Mar 8, 2016 12:17:41 PM [Info ]: Process ID 152 has been started.

Mar 8, 2016 12:17:41 PM [Info ]: Waiting for process ID 152, name sapcontrol to finish.

Mar 8, 2016 12:17:41 PM [Info ]: Process ID 152, name sapcontrol has been finished, exit code 1.

Mar 8, 2016 12:17:41 PM [Info ]: The sapcontrol service on host sapeap-uat-m3 and instance 2 is not started.

Mar 8, 2016 12:17:41 PM [Error ]: The following problem has occurred during step execution: com.sap.sdt.j2ee.tools.controlservice.ServiceControllerException: Service for instance 2 on host sapeap-uat-m3 is not started after 240 seconds.

Output of SAPCONTROL_GETPROCESSLIST_2_828.OUT is

GetProcessList

FAIL: NIECONN_REFUSED (Connection refused), NiRawConnect failed in plugin_fopen()

Thanks

Vik

Hi Vikas,

Kindly follow the below steps

1. Open the config tool

2 . Goto file menu , click on the safe mode.

3. A window will come , from the second dropdown option ,select the dialog instance number and from the first dropdown option select yes.

4. Restart the SAP system and keep the dialog instance up.

Retry the SUM tool again.

With Regards

Ashutosh Chaturvedi

Hi Ashutosh,

Quick one, Do i need to keep Dialog instance up after turning on Safe mode? I thought the purpose of turning on SAfe mode is so that upgrade runs only on CI.

Please confirm.

Thanks

Vik

Hi Ashutosh,

No success, Turned the Dialog instance in Configtool to Safe mode and run the SUM again. Error again:

Could not check status of SAP instance with number 2. Could not check if the instance number 2 on host sapeap-uat-m3 is started. Sapcontrol client could not perform action wait for started on instance 2 Return code condition success evaluated to false for process sapcontrol for action wait for started.

Outpput of RESTART-SYSTEM-JAVAONLY_34.LOG is:

Mar 8, 2016 2:37:23 PM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host sapeap-uat-m3 -prot NI_HTTPS -function Start

Mar 8, 2016 2:37:23 PM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_START_2_23.OUT

Mar 8, 2016 2:37:23 PM [Info ]: Process ID 189 has been started.

Mar 8, 2016 2:37:23 PM [Info ]: Waiting for process ID 189, name sapcontrol to finish.

Mar 8, 2016 2:37:23 PM [Info ]: Process ID 189, name sapcontrol has been finished, exit code 0.

Mar 8, 2016 2:37:23 PM [Info ]: An instance start was triggered.

Mar 8, 2016 2:37:23 PM [Info ]: Sent the start command to instance number 2 on host sapeap-uat-m3 with timeout of 7200 seconds.

Mar 8, 2016 2:37:23 PM [Info ]: Process ID 190, name sapcontrol has been started.

Mar 8, 2016 2:37:23 PM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 0 -host sape-uat-dj-v -prot NI_HTTPS -function WaitforStarted 144000 5

Mar 8, 2016 2:37:23 PM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_WAITFORSTARTED_0_11.OUT

Mar 8, 2016 2:37:23 PM [Info ]: Process ID 190 has been started.

Mar 8, 2016 2:37:23 PM [Info ]: Waiting for process ID 190, name sapcontrol to finish.

Mar 8, 2016 2:40:08 PM [Info ]: Process ID 190, name sapcontrol has been finished, exit code 0.

Mar 8, 2016 2:40:08 PM [Info ]: Process ID 191, name sapcontrol has been started.

Mar 8, 2016 2:40:08 PM [Info ]: Command line: /usr/sap/TP1/J00/exe/sapcontrol -nr 2 -host sapeap-uat-m3 -prot NI_HTTPS -function WaitforStarted 144000 5

Mar 8, 2016 2:40:08 PM [Info ]: Standard out: /usr/sap/SUM/SUM/sdt/tmp/SAPCONTROL_WAITFORSTARTED_2_11.OUT

Mar 8, 2016 2:40:08 PM [Info ]: Process ID 191 has been started.

Mar 8, 2016 2:40:08 PM [Info ]: Waiting for process ID 191, name sapcontrol to finish.

Mar 8, 2016 2:40:18 PM [Info ]: Process ID 191, name sapcontrol has been finished, exit code 2.

Mar 8, 2016 2:40:18 PM [Error ]: Return code condition success evaluated to false for process sapcontrol for action wait for started.

Mar 8, 2016 2:40:18 PM [Error ]: The following problem has occurred during step execution: com.sap.sdt.util.diag.DiagException: Could not check status of SAP instance with number 2.

Could not check if the instance number 2 on host sapeap-uat-m3 is started.

Sapcontrol client could not perform action wait for started on instance 2

Return code condition success evaluated to false for process sapcontrol for action wait for started.

Output of SAPCONTROL_WAITFORSTARTED_2_11.OUT is:

08.03.2016 14:40:18

WaitforStarted

FAIL: process jstart J2EE Server not running

Thanks

Vik

Hi Vikas ,

Please start the dialog instance and retry the step in SUM.

With Regards

Ashutosh Chaturvedi

Hi Vikas,

Paste the dev_jstart.log file of the dialog instance.

With Regards

Ashutosh Chaturvedi

Hi Ashutosh,

Thanks for helping out. Also missed to inform one thing, when i ran the SUM, although i got the error, but still the tool stop the Dialog instance.

attached is dev_jstart.log

trc file: "dev_jstart.new", trc level: 1, release: "722"

---------------------------------------------------

sysno 02

sid TP1

systemid 390 (AMD/Intel x86_64 with Linux)

relno 7220

patchlevel 0

patchno 25

intno 20020600

make multithreaded, Unicode, 64 bit, optimized

profile /usr/sap/TP1/SYS/profile/TP1_J02_sapeap-uat-m3

pid 9832

* ACTIVE TRACE LEVEL 1

* ACTIVE TRACE COMPONENTS All, egi

Tue Mar 8 14:37:24 2016

* trace logging activated, max size = 52428800 bytes, 2 versions

arguments :

arg[ 0] : jc.sapTP1_J02

arg[ 1] : pf=/usr/sap/TP1/SYS/profile/TP1_J02_sapeap-uat-m3

F Tue Mar 8 14:37:24 2016

F ********************************************************************************

F Java environment properties (/usr/sap/TP1/J02/work/jstart.jvm)

F root directory : /usr/sap/TP1/J02/exe/sapjvm_6

F vendor : SAP AG

F version : 1.6.0_37

F cpu : amd64

F java vm type : server

F java vm version : 6.1.046 21.1-b02

F jvm library name : libjvm.so

F library path : /usr/sap/TP1/J02/exe/sapjvm_6/jre/lib/amd64/server:/usr/sap/TP1/J02/exe/sapjvm_6/jre/lib/amd64

F executable path : /usr/sap/TP1/J02/exe/sapjvm_6/bin

F ********************************************************************************

F SAP extensions : available

F ********************************************************************************

I [Thr 140549763602272] MtxInit: 30002 0 2

F [Thr 140549763602272] *** LOG => connected to Enqueue Server.

F [Thr 140549763602272] *** LOG => connected to Message Server.

F [Thr 140549763602272] *** LOG => Starting run level 1.

F ********************************************************************************

F Java process [deployment] properties:

F section name : deployment

F config file : /usr/sap/TP1/J02/exe/startup.properties

F node name : Deploy_offline

F home directory : /usr/sap/TP1/J02/j2ee/cluster

F shutdown timeout : 136000 ms

F exit timeout : 7000 ms

F debuggable : false

F debugger active : false

F ********************************************************************************

F [Thr 140549763602272] *** LOG => Instance state is "Deploying offline components" (STARTING @ 0, INACTIVE).

F [Thr 140549763602272] *** LOG => Starting nodes: runlevel 1.

F ********************************************************************************

F Starting process: /usr/sap/TP1/J02/exe/jstart

F arg[ 1] = -nodeId=0

F arg[ 2] = pf=/usr/sap/TP1/SYS/profile/TP1_J02_sapeap-uat-m3

F arg[ 3] = -hostvm

F arg[ 4] = -nodeName=deployment

F arg[ 5] = -file=/usr/sap/TP1/J02/exe/startup.properties

F arg[ 6] = -jvmFile=/usr/sap/TP1/J02/work/jstart.jvm

F arg[ 7] = -traceFile=/usr/sap/TP1/J02/work/dev_deployment

F arg[ 8] = -javaOutFile=/usr/sap/TP1/J02/work/jvm_deployment.out

F exePath : PATH=/usr/sap/TP1/J02/exe/sapjvm_6/bin:/usr/sap/TP1/J02/exe:/usr/lib64/qt-3.3/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/usr/sap/TP1/SYS/exe/uc/linuxx86_64:/usr/sap

/TP1/SYS/exe/run:/home/tp1adm:.

F libPath : LD_LIBRARY_PATH=/usr/sap/TP1/J02/exe/sapjvm_6/jre/lib/amd64/server:/usr/sap/TP1/J02/exe/sapjvm_6/jre/lib/amd64:/usr/sap/TP1/J02/j2ee/os_libs:/usr/sap/TP1/J02/exe:/usr/sap/TP1/SYS/exe/run:/usr/sap/TP1/SYS/exe/uc/linuxx86_64:/

oracle/client/11x_64/instantclient

F stdout : /usr/sap/TP1/J02/work/std_deployment.out

F stderr : /usr/sap/TP1/J02/work/std_deployment.out

F console : no

F debugger: no

F nice : no

F ********************************************************************************

F Process Deploy_offline started with pid 9841

F ********************************************************************************

F [Thr 140549763602272] *** LOG => Process deployment started (pid 9841).

F [Thr 140549763602272] Tue Mar 8 14:37:26 2016

F [Thr 140549763602272] *** LOG => Process deployment stopping (pid 9841).

F [Thr 140549763602272] *** LOG => Signal 17 SIGCHLD.

F [Thr 140549763602272] *** LOG => Process deployment stopped (pid 9841).

F [Thr 140549763602272] *** LOG => Instance state is "Deploying offline components" (STOPPING @ 0, INACTIVE).

F [Thr 140549763602272] *** LOG => Run level 1 completed.

F [Thr 140549763602272] *** LOG => Starting run level 2.

F ********************************************************************************

F Java process [bootstrap] properties:

F section name : bootstrap

F config file : /usr/sap/TP1/J02/exe/startup.properties

F node name : Instance_bootstrap

F home directory : /usr/sap/TP1/J02/j2ee/cluster

F shutdown timeout : 136000 ms

F exit timeout : 7000 ms

F debuggable : false

F debugger active : false

F ********************************************************************************

F [Thr 140549763602272] *** LOG => Instance state is "Synchronizing binaries" (STARTING @ 0, INACTIVE).

F [Thr 140549763602272] *** LOG => Starting nodes: runlevel 2.

F ********************************************************************************

F Starting process: /usr/sap/TP1/J02/exe/jstart

F arg[ 1] = -nodeId=0

F arg[ 2] = pf=/usr/sap/TP1/SYS/profile/TP1_J02_sapeap-uat-m3

F arg[ 3] = -hostvm

F arg[ 4] = -nodeName=bootstrap

F arg[ 5] = -file=/usr/sap/TP1/J02/exe/startup.properties

F arg[ 6] = -jvmFile=/usr/sap/TP1/J02/work/jstart.jvm

F arg[ 7] = -traceFile=/usr/sap/TP1/J02/work/dev_bootstrap

F arg[ 8] = -javaOutFile=/usr/sap/TP1/J02/work/jvm_bootstrap.out

/TP1/SYS/exe/run:/home/tp1adm:.

oracle/client/11x_64/instantclient

F stdout : /usr/sap/TP1/J02/work/std_bootstrap.out

F stderr : /usr/sap/TP1/J02/work/std_bootstrap.out

F console : no

F debugger: no

F nice : no

F ********************************************************************************

F Process Instance_bootstrap started with pid 9876

F ********************************************************************************

F [Thr 140549763602272] *** LOG => Process bootstrap started (pid 9876).

F [Thr 140549763602272] Tue Mar 8 14:37:29 2016

F [Thr 140549763602272] *** LOG => Process bootstrap stopping (pid 9876).

F [Thr 140549763602272] *** LOG => Signal 17 SIGCHLD.

F [Thr 140549763602272] *** LOG => Process bootstrap stopped (pid 9876).

F [Thr 140549763602272] *** WARNING => Node bootstrap failed: result 1, exit code 558. [sfxxnode.hpp 1024]

F ********************************************************************************

F Native process [snapshot] properties:

F section name : snapshot

F config file : /usr/sap/TP1/J02/exe/startup.properties

F node name : snapshot

F home directory : /usr/sap/TP1/J02/work

F shutdown timeout : 122000 ms

F sf support : false

F ********************************************************************************

F Starting process: /usr/sap/TP1/J02/exe/sapcontrol

F arg[ 1] = -prot

F arg[ 2] = PIPE

F arg[ 3] = -nr

F arg[ 4] = 02

F arg[ 5] = -function

F arg[ 6] = CreateSnapshot

F arg[ 7] = Servercrash

F arg[ 8] = postmortem?node=bootstrap&exitcode=558

F arg[ 9] = 1

F arg[10] = 10000

F arg[11] = ""

F arg[12] = ""

F arg[13] = DEFAULT

F exePath : PATH=/usr/sap/TP1/J02/exe:/usr/lib64/qt-3.3/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/usr/sap/TP1/SYS/exe/uc/linuxx86_64:/usr/sap/TP1/SYS/exe/run:/home/tp1adm:.

F libPath : LD_LIBRARY_PATH=/usr/sap/TP1/J02/exe:/usr/sap/TP1/SYS/exe/run:/usr/sap/TP1/SYS/exe/uc/linuxx86_64:/oracle/client/11x_64/instantclient

F stdout : /usr/sap/TP1/J02/work/std_snapshot.out

F stderr : /usr/sap/TP1/J02/work/std_snapshot.out

F console : no

F debugger: no

F nice : no

F ********************************************************************************

F Process snapshot started with pid 9902

F ********************************************************************************

F [Thr 140549763602272] *** LOG => Process snapshot started (pid 9902).

F [Thr 140549763602272] *** LOG => Process snapshot running (pid 9902).

F [Thr 140549763602272] *** LOG => SAP Start Service (pid 9697) connected.

F [Thr 140549763602272] *** LOG => SAP Start Service (pid 9697) disconnected.

F [Thr 140549763602272] Tue Mar 8 14:37:40 2016

F [Thr 140549763602272] *** LOG => Signal 17 SIGCHLD.

F [Thr 140549763602272] *** LOG => Process snapshot stopped (pid 9902).

F [Thr 140549763602272] *** LOG => Instance state is "Synchronizing binaries" (STOPPING @ 0, INACTIVE).

F [Thr 140549763602272] *** LOG => Run level 2 completed.

F [Thr 140549763602272] *** LOG => Instance state is "Some processes failed" (STOPPED @ 0, INACTIVE).

I [Thr 140549763602272] MPI: dynamic quotas disabled.

I [Thr 140549763602272] MPI init: pipes=4000 buffers=1279 reserved=383 quota=10%

F ********************************************************************************

F *** ERROR => Node 'bootstrap' failed with exit code 558.

F ***

F *** Please see section 'Failures in the 'synchronizing binaries' phase'

F *** in SAP Note 1316652 for additional information and trouble shooting advice.

F ********************************************************************************

F [Thr 140549763602272] *** LOG => exiting (exitcode 22002, retcode 1).

Thanks

vik

Hi Vikas,

Please could you run this command and attach the result

sapcontrol -nr 2 -host sapeap -uat -m3 -prot NI_HTTPS -debug -function GetProcessList

I guess its an certificate issue.

Thanks

Pav.

Hi Pavan,

Thanks for helping out. Please find below output of sapcontrol command:

tp1adm> sapcontrol -nr 2 -host sapeap -uat -m3 -prot NI_HTTPS -debug -function GetProcessList

Wed Mar 9 09:40:57 2016

NiIInit: allocated nitab (2048 at 7f0bfb874010)

NiIHSBufInit: initialize hostname buffer (IPv4)

NiHLInit: alloc host buf (100 entries)

NiSrvLInit: alloc serv bufs (100 entries)

***LOG Q0I=> NiPGetServByName: 'sapctrls02' not found: getaddrinfo [niuxi.c 1814]

NiSrvLGetServNo: service name 'sapctrls02' not found by operating system

<<- SapSSLSetTraceFile()==SAP_O_K

->> SapSSLInit(read_profile=0, &init_params=7ffc61c8f630, &return_reserved=(nil))

=================================================

= SSL Initialization platform tag=(linuxx86_64_gcc43)

= (722_REL,Sep 20 2015,mt,ascii-uc,SAP_UC/size_t/void* = 16/64/64)

SapISSLComposeFilename(ssl_lib): using default "libsapcrypto.so"

DlLoadLib() success: dlopen("libsapcrypto.so"), hdl 0

DlLoadFunc (SSL_API_startup) from libsapcrypto.so

DlLoadFunc (SSL_API_cleanup) from libsapcrypto.so

DlLoadFunc (SSL_API_get_last_error) from libsapcrypto.so

DlLoadFunc (SSL_check_last_io) from libsapcrypto.so

DlLoadFunc (SSL_new) from libsapcrypto.so

DlLoadFunc (SSL_duplicate) from libsapcrypto.so

DlLoadFunc (SSL_set_session_by_ssl) from libsapcrypto.so

DlLoadFunc (SSL_clear) from libsapcrypto.so

DlLoadFunc (SSL_set_fd) from libsapcrypto.so

DlLoadFunc (SSL_accept) from libsapcrypto.so

DlLoadFunc (SSL_connect) from libsapcrypto.so

DlLoadFunc (SSL_set_verify_mode) from libsapcrypto.so

DlLoadFunc (SSL_set_options) from libsapcrypto.so

DlLoadFunc (SSL_get_state) from libsapcrypto.so

DlLoadFunc (SSL_read) from libsapcrypto.so

DlLoadFunc (SSL_write) from libsapcrypto.so

DlLoadFunc (SSL_peek) from libsapcrypto.so

DlLoadFunc (SSL_pending) from libsapcrypto.so

DlLoadFunc (SSL_set_shutdown_mode) from libsapcrypto.so

DlLoadFunc (SSL_shutdown) from libsapcrypto.so

DlLoadFunc (SSL_free) from libsapcrypto.so

DlLoadFunc (SSL_renegotiate) from libsapcrypto.so

DlLoadFunc (SSL_do_handshake) from libsapcrypto.so

DlLoadFunc (SSL_is_session_resumed) from libsapcrypto.so

DlLoadFunc (SSL_get_session) from libsapcrypto.so

DlLoadFunc (SSL_get_state_description_long) from libsapcrypto.so

DlLoadFunc (SSL_get_certificate_request_ca_dnames) from libsapcrypto.so

DlLoadFunc (SSL_CTX_new) from libsapcrypto.so

DlLoadFunc (SSL_CTX_set_default_pse_by_name) from libsapcrypto.so

DlLoadFunc (SSL_CTX_set_default_verify_mode) from libsapcrypto.so

DlLoadFunc (SSL_CTX_set_options) from libsapcrypto.so

DlLoadFunc (SSL_CTX_set_session_cache_mode) from libsapcrypto.so

DlLoadFunc (SSL_CTX_set_session_cache_max_items) from libsapcrypto.so

DlLoadFunc (SSL_CTX_get_session_cache_number) from libsapcrypto.so

DlLoadFunc (SSL_CTX_get_default_cipher_suites) from libsapcrypto.so

DlLoadFunc (SSL_CTX_set_default_cipher_suites) from libsapcrypto.so

DlLoadFunc (SSL_CTX_flush_session_cache) from libsapcrypto.so

DlLoadFunc (SSL_CTX_free) from libsapcrypto.so

DlLoadFunc (SSL_CTX_set_protocol_version_flags) from libsapcrypto.so

DlLoadFunc (SSL_CTX_get_protocol_version_flags) from libsapcrypto.so

DlLoadFunc (SSL_get_protocol_version_numbers) from libsapcrypto.so

DlLoadFunc (SSL_get_peer_certificates) from libsapcrypto.so

DlLoadFunc (SSL_CIPHER_SUITE_get_name_info) from libsapcrypto.so

DlLoadFunc (SSL_CIPHER_SUITE_get_info) from libsapcrypto.so

DlLoadFunc (SSL_CIPHER_SUITE_get_sym_key_size) from libsapcrypto.so

DlLoadFunc (SSL_get_cipher_suite_used) from libsapcrypto.so

DlLoadFunc (SSL_get_cipher_suite_used_id) from libsapcrypto.so

DlLoadFunc (SSL_get_cipher_suites) from libsapcrypto.so

DlLoadFunc (SSL_get_cipher_suites_peer) from libsapcrypto.so

DlLoadFunc (SSL_SESSION_set_timeout) from libsapcrypto.so

DlLoadFunc (SSL_SESSION_get_session_id) from libsapcrypto.so

DlLoadFunc (aux_sprint_error) from libsapcrypto.so

DlLoadFunc (th_last_error) from libsapcrypto.so

DlLoadFunc (th_get_last_error_text) from libsapcrypto.so

DlLoadFunc (aux_free) from libsapcrypto.so

DlLoadFunc (aux_free_error) from libsapcrypto.so

DlLoadFunc (aux_get_Certificate_n_from_Certificates) from libsapcrypto.so

DlLoadFunc (aux_get_tbs_DERcode_of_Certificate) from libsapcrypto.so

DlLoadFunc (e_Certificate) from libsapcrypto.so

DlLoadFunc (aux_get_serialnumber_of_Certificate) from libsapcrypto.so

DlLoadFunc (aux_get_subject_of_Certificate) from libsapcrypto.so

DlLoadFunc (aux_get_issuer_of_Certificate) from libsapcrypto.so

DlLoadFunc (aux_cmp_DName) from libsapcrypto.so

DlLoadFunc (aux_sprint_DName) from libsapcrypto.so

DlLoadFunc (aux_free_String) from libsapcrypto.so

DlLoadFunc (aux_free_OctetString) from libsapcrypto.so

DlLoadFunc (aux_putenv) from libsapcrypto.so

DlLoadFunc (sapcr_init) from libsapcrypto.so

DlLoadFunc (sapcr_done) from libsapcrypto.so

DlLoadFunc (sapcr_get_version) from libsapcrypto.so

DlLoadFunc (sapcr_get_secudir) from libsapcrypto.so

DlLoadFunc (sapcr_set_secudir) from libsapcrypto.so

DlLoadFunc (sapcr_config) from libsapcrypto.so

DlLoadFunc (sapsecu_create_CertEntryList) from libsapcrypto.so

DlLoadFunc (sapsecu_free_CertEntryList) from libsapcrypto.so

DlLoadFunc (sapsecu_sprint_CertEntryList) from libsapcrypto.so

DlLoadFunc (sap_create_memory_PSE) from libsapcrypto.so

DlLoadFunc (sap_delete_memory_PSE) from libsapcrypto.so

DlLoadFunc (sap_load_memory_PSE) from libsapcrypto.so

DlLoadFunc (sapcr_set_property_int) from libsapcrypto.so

DlLoadFunc (sapcr_get_property_int) from libsapcrypto.so

= disabled FIPS 140-2 crypto kernel

= found CommonCryptoLib (SAPCRYPTOLIB) Version 8.4.41 pl40 (Aug 18 2015) MT-safe

= current UserID: "tp1adm", env-var USER="tp1adm"

******** Warning ********

*** You should define environment variable SECUDIR !

*************************

= SECUDIR location determined through "HOME" --

= using SECUDIR=/home/tp1adm/sec

SapISSLComposeFilename(anon_pse): Filename = "#_MemPSE_#598239313473280538512339"

= AnonClient SSL_CTX 127b760 pvflags = 192 (TLSv1.0,SSLv3)

= The ANONYMOUS Client SSL_CTX

= provides this ordered list of 11 ciphersuites:

= 1. TLS_RSA_WITH_AES128_GCM_SHA256

= 2. TLS_RSA_WITH_AES256_GCM_SHA384

= 3. TLS_RSA_WITH_AES128_CBC_SHA

= 4. TLS_RSA_WITH_AES256_CBC_SHA

= 5. TLS_RSA_WITH_RC4_128_SHA

= 6. TLS_RSA_WITH_RC4_128_MD5

= 7. TLS_RSA_WITH_3DES_EDE_CBC_SHA

= 8. TLS_RSA_WITH_DES_CBC_SHA

= 9. TLS_RSA_EXPORT_WITH_DES40_CBC_SHA

= 10. TLS_RSA_EXPORT_WITH_RC2_CBC_40_MD5

= 11. TLS_RSA_EXPORT_WITH_RC4_40_MD5

= Success -- SapCryptoLib SSL ready!

=================================================

<<- SapSSLInit(read_profile=0)==SAP_O_K

NiInit3: NI already initializes (init=1;cur=2048)

***LOG Q0I=> NiPGetHostByName: 'sapeap' not found: getaddrinfo [niuxi.c 1759]

NiHLGetNodeAddr: hostname 'sapeap' not found by operating system

09.03.2016 09:40:57

GetProcessList

FAIL: NIEHOST_UNKNOWN (No such file or directory), NiRawConnect failed in plugin_fopen()

Thanks

Vik

Hi Vikas,

There is no certificate issue.

is there is a gap between the hostname sapeap -uat -m3

With Regards

Ashutosh

HI Pavan,

Please ignore the output i send minute ago, i used wrong hostname, Please see below the corrected output:

tp1adm> sapcontrol -nr 2 -host sapeap-uat-m3 -prot NI_HTTPS -debug -function GetProcessList

Wed Mar 9 09:46:10 2016

NiIInit: allocated nitab (2048 at 7f6ab2fa9010)

NiIHSBufInit: initialize hostname buffer (IPv4)

NiHLInit: alloc host buf (100 entries)

NiSrvLInit: alloc serv bufs (100 entries)

***LOG Q0I=> NiPGetServByName: 'sapctrls02' not found: getaddrinfo [niuxi.c 1814]

NiSrvLGetServNo: service name 'sapctrls02' not found by operating system

<<- SapSSLSetTraceFile()==SAP_O_K

->> SapSSLInit(read_profile=0, &init_params=7ffc94d974d0, &return_reserved=(nil))