No logon / Cant´t establish connection to message server on...

[jakobweimer]

Hi all,

after I had some Trouble starting my Netweaver server, I am now facing a new Problem.

From the beginning: I had a running netweaver vm which is connected to a HANA database also in a vm (both on SLES).

A week ago, I stopped netweaver but it´t didn´t clean up all the ressources.

So I had to restart the whole vm because I wasn´t able to restart it again.

Now I know that the Problem was the file "/sapmnt/SID/Profile/SID_DVEBMGS00_SAP1I01LNX01" which was empty after the restart of the vm.

Luckily I had a copy of that file and was able to restore it.

My new problem now is, that I am not able to login via SAPGUI with any users except SAP* because of a missing lisence (which i already reinstalled).

The other problem with maybe the same cause is a runtime error and a message in transaction SICK "can´t establish Connection to message Server on SAP101LNX01 (sapmsLNX)".

Do you have any suggestions how to solve this problems?

Best regards,

Jakob

Message was edited by: Jason Lax File attachments removed.

[Former Member · Accepted solution]

Are you sure that you are tried to start ASCS instance? Check it state with

> sapcontrol -nr 01 -function GetProcessList

Also please attach dev_enqserv trace file.

[Former Member · Accepted solution]

Please attach /home/lnxadm/startsap_ASCS01.log file to message. Please provide also dev_enqserv log file.

SAP1I01LNX01:lnxadm 52> sapcontrol -nr 01 -function GetProcessList

21.03.2014 11:40:31
GetProcessList
OK
name, description, dispstatus, textstatus, starttime, elapsedtime, pid

Is this full output? Can you attach screenshot?

[jakobweimer · Accepted solution]

Yes it´s the whole output.

sapstart_ASCS01.log :

Trace of system startup/check of SAP System LNX on Fr 21. Mär 12:24:17 CET 2014

Called command: /usr/sap/LNX/SYS/exe/uc/linuxx86_64/startsap start

-------------------------------------------

12:24:18

Starting Startup Agent sapstartsrv

-------------------------------------------

12:24:18

Instance Service on host SAP1I01LNX01 started

-------------------------------------------

12:24:18

starting SAP Instance ASCS01

-------------------------------------------

12:24:18

Startup-Log is written to /home/lnxadm/startsap_ASCS01.log

-------------------------------------------

12:24:18

/usr/sap/LNX/ASCS01/exe/sapcontrol -prot NI_HTTP -nr 01 -function Start

21.03.2014 12:24:19

Start

OK

-------------------------------------------

12:24:29

Instance on host SAP1I01LNX01 started

[Former Member · Accepted solution]

Please attach sapstart.log, dev_enqserv and dev_ms from /usr/sap/LNX/ASCS01/work directory.

[Former Member · Accepted solution]

Check active processes related to SAP with ps command and provide output here.

[jakobweimer · Accepted solution]

SAP1I01LNX01:lnxadm 58> ps -A | grep sap

3337 ?        00:00:00 saphostexec

3362 ?        00:00:00 sapstartsrv

3391 ?        00:00:03 saposcol

3565 ?        00:00:01 sapstartsrv

3759 ?        00:00:12 sapstartsrv

3961 ?        00:00:00 sapstartsrv

4276 ?        00:00:00 sapstart

4334 ?        00:00:01 jc.sapDAA_SMDA9

9908 ?        00:00:00 sapstart

9925 ?        00:00:00 ig.sapLNX_DVEBM

[Former Member · Accepted solution]

Please provide output of

> ps -eL -o pid,ppid,state,wchan,cmd | grep sapstart

(preferably as file attachment).

[Former Member · Accepted solution]

Please do the following as lnxadm user:

> sapcontrool -nr 01-function RestartService

and after that attach file with output of command:

> ps -eL -o pid,ppid,lwp,state,wchan,cmd | grep sapstart

[Former Member · Accepted solution]

What is kernel version of OS? Please provide output of uname -r command.

[jakobweimer · Accepted solution]

SAP1I01LNX01:lnxadm 155> uname -r

3.0.101-0.15-default

[Former Member · Accepted solution]

Please provide output of pstack 16164 (as file attachment). Also attach sapstartsrv.log from ASCS work directory.

[Former Member · Accepted solution]

Please attach profiles for ASCS instance.

[Former Member · Accepted solution]

Please provide content of work direcotry for ASCS01 instance (output ls -l command).

[Former Member · Accepted solution]

> This might be the problem...

Maybe.

> Am I right that all the files should be owned by lnxadm and sapsys?

Yes. Change the owner of these files to lnxadm:sapsys and try again.

Please attach also sapstartsrv.log file.

[Former Member · Accepted solution]

Glad to hear that it's working . Good luck.

[jakobweimer · Accepted solution]

Now i am really confused.... Everything was working and now after reboot ASCS01 is not running .

[Former Member · Accepted solution]

As before provide log files (dev_ms and dev_enqsrv) for analysis.

[Reagan · Accepted solution]

Good to see a lot has happened until now.

Stop the SAP system completely.

Clean the shared memory segments.

First start only the ASCS01 and see if that stays up

su - sidadm

startsap r3 ASCS01

Regards

RB

[Former Member · Accepted solution]

Can you attach log files from DVEBMGS00 instance (dev_disp and dev_w0)?

[jakobweimer · Accepted solution]

Yes, a lot happend... it was working for about 4 minutes till I restarted the system.

SAP1I01LNX01:lnxadm 59> startsap r3 ASCS01

Starting Startup Agent sapstartsrv

Instance Service on host SAP1I01LNX01 started

-------------------------------------------

starting SAP Instance ASCS01

Startup-Log is written to /home/lnxadm/startsap_ASCS01.log

-------------------------------------------

/usr/sap/LNX/ASCS01/exe/sapcontrol -prot NI_HTTP -nr 01 -function Start

Instance on host SAP1I01LNX01 started

SAP1I01LNX01:lnxadm 59> stopsap r3 ASCS01

stopping the SAP instance ASCS01

Shutdown-Log is written to /home/lnxadm/stopsap_ASCS01.log

-------------------------------------------

Instance ASCS01 was not running!

Best regards

Jakob

[Reagan · Accepted solution]

M  NiPConnect: SiConnect failed for hdl 399/sock 61
M      (SI_ECONN_REFUSE/111; UD; ST; /tmp/.sapstream3201)NiIInitSocket: set default settings for new hdl 399/sock 61 (I4; ST)

Stop SAP and all processes running under lnxadm

Delete all the stream file under /tmp

Restart SAP.

Regards

RB

[Former Member · Accepted solution]

Perform a clean restart of SAP System and provide updated log files if something goes wrong.

[jakobweimer · Accepted solution]

I tried:

stopsap

kill -2 pid

cleanipc for all systems shown via showipc all

deleted all .sapstream files in /tmp directory

restarted the whole vm

But ASCS01 is still not working.

[Former Member · Accepted solution]

Please attach dev_ms, dev_enqsrv, dev_disp, dev_w* log files.

[Former Member · Accepted solution]

Can you attach content of /usr/sap/LNX/ASCS01/work directory (ls -l output) and also sapstart.log log file from the same directory. At the same time check file owners (user:group) for kernel executables.

[Former Member · Accepted solution]

Don't provide all of them. Just one of them is enough.

[Former Member · Accepted solution]

Check owners and permissions of kernel files for both instances (ASCS01 and DVEBMGS00) and in NFS share (/sapmnt/LNX/exe).

[Former Member · Accepted solution]

Change owners for dev_ms file in ASCS01 work directory to lnxadm:sapsys and try again.

[jakobweimer · Accepted solution]

Changed the user and group but ASCS01 is still not running....

[Former Member · Accepted solution]

Ok. To get the latest state, perform a clean restart again. After that provide output of startsap script and zip and attach content of work directories from ASCS01 and DVEBMGS00 instances.

[Former Member · Accepted solution]

what exactly does "clean restart" mean? I did a "kill" of all processes, cleanipc and deleted .sapstreams from "/tmp". Then i rebooted the LNX vm and started sap.

You are at the right way. You must to make sure that nothing are left active that can affect system startup process. Reboot of the VM is really clear all but this is not necessary if you can check that nothing are left active.

Without log files (form ASCS01 work directory as minimum) it's hard to help you. If you can't provide them open message to SAP Service Support.

[Former Member]

Hi Jakob,

     Check these..

1. Did you mention IP address and Hostname in "/etc/hosts"file

2. check the entry in "/etc/services"

sapms<SID>           3600/tcp

Regards

Santosh K

[jakobweimer]

I checked the files and the entries are there as required.

[Reagan]

Hello

Can you provide the latest message server trace file please ?

The one you have provided us is from:

---------------------------------------------------
trc file: "dev_ms.new", trc level: 1, release: "741"
---------------------------------------------------
[Thr 140298399020832] Mon Mar  3 19:00:57 2014
[Thr 140298399020832] SAP_RELEASE = 741

It appears that the central services failed to start. Check the trace files under /usr/sap/LNX/ASCS01/work

According to the Work porcess trace file I see this error:

M Fri Mar 21 09:45:38 2014
M  ***LOG Q16=> ThGetMsHwId, DpMBufHwIdGet (HWID_PENDING) [thxxmbuf.c   511]
M  *** ERROR => SlicLikeyGetHardwareKey: no hwid from MSG server: -1 [sliclikey.c  1282]
M  {root-id=005056B455F81EE3AC9A975F753B7E63}_{conn-id=00000000000000000000000000000000}_0
M  *** ERROR => 11 likey_get_validity_dates: Error getting the hardware key. You might find some information in file "dev_ms" on the message server. [sliclikey.c  1301]

Also list all the profiles under /usr/sap/LNX/SYS/profile

ls -la /sapmnt/LNX/profile

Provide the output of the commands

sapcontrol -nr 00 -function GetVersionInfo

sapcontrol -nr 01 -function GetVersionInfo

Regards

RB

[Reagan]

Hello Jakob

Please follow these steps.

Stop SAP

Clean the shared memory segments

Kill all SAP processes running under lnxadm user

ps -fu lnxadm

Delete all the stream files (if any) from the /tmp file system

Start SAP and run these commands

sapcontrol -nr 01 -function GetProcessList

sapcontrol -nr 00 -function GetProcessList

If it fails then supply the latest dev_w0 and dev_ms trace file

Regards

RB

[jakobweimer]

Hello Reagan,

unfortunately the system is still not working.

Attached the files you asked for.

Thanks for your Support.

Regards

Jakob

[nirmal_konchada]

Hello Jacob,

From the attached jogs, I see that the message server is not started.

If you check the logs you can see that the latest timestamp on message is that of 3rd March and for others its 21st march.

So can you also check the default and start profile with message server relevant parameters, if they are maintained properly?

Regards,

Nirmal.

[jakobweimer]

Hi Nirmal,

I was already wondering about that log too....

About the settings in these two files i am not really sure so I attached them for you.

As far as I can say that, the settings look ok, but I don´t know if there are any missing.