cancel
Showing results for 
Search instead for 
Did you mean: 

Problems Starting SAP on DI

former_member206552
Active Contributor
0 Kudos

Good Day,

Since Yesterday i have had problems starting the application server where by it hangs on sapcontrol as seen below

startsap r3
Checking sid Database
-------------------------------------------
setTrace: false
J2EE Database is running
See logfile /home/sidadm/JdbcCon.log
Starting Startup Agent sapstartsrv
OK
Instance Service on host hostname started
-------------------------------------------
starting SAP Instance J30
Startup-Log is written to /home/sidadm/startsap_J30.log
-------------------------------------------
/usr/sap/sid/J30/exe/sapcontrol -prot NI_HTTP -nr 30 -function Start

The kernel has been replaced and the enviroment had been double checked, sapcontrol does not generate any log files

-rw-r--r-- 1 sidadm sapsys     342 2013-09-10 14:21 INSTSTAT

-rw-r--r-- 1 sidadm sapsys   31563 2013-09-11 09:29 class_prefetch.lst

-rw-r--r-- 1 sidadm sapsys     850 2013-09-11 10:50 sapstartsrv.old

-rw-r--r-- 1 sidadm sapsys    2106 2013-09-11 11:04 available.log

-rw-r--r-- 1 sidadm sapsys       8 2013-09-11 11:04 logsave.bin

-rw-r--r-- 1 sidadm sapsys     851 2013-09-11 11:04 sapstartsrv.log

hostname:sidadm 65>

the contents of the log file startsap_J30.log can be found below


hostname:sidadm 68> cat startsap_J30.log
Trace of system startup/check of SAP System sid on Wed Sep 11 11:04:03 CEST 2013

Called command: /usr/sap/SID/SYS/exe/uc/linuxx86_64/startsap start

-------------------------------------------
11:04:05
Starting Startup Agent sapstartsrv

-------------------------------------------
11:04:16
Instance Service on host hostname started

-------------------------------------------
11:04:16
starting SAP Instance J30

-------------------------------------------
11:04:16
Startup-Log is written to /home/sidadm/startsap_J30.log

-------------------------------------------
11:04:16
/usr/sap/SID/J30/exe/sapcontrol -prot NI_HTTP -nr 30 -function Start

running sapcontrol from the command line does the same where by no feedback is supplied.

any help would be appreciated

Best Regards

Marius

Accepted Solutions (1)

Accepted Solutions (1)

Reagan
Advisor
Advisor
0 Kudos

Hello

What happens when you issue startsap j2ee ?

Regards

RB

former_member206552
Active Contributor
0 Kudos

Hi RB

hostname:sidadm 73> startsap j2ee

Checking FSI Database

-------------------------------------------

setTrace: false

J2EE Database is running

See logfile /home/sidadm/JdbcCon.log

Starting Startup Agent sapstartsrv

OK

Instance Service on host hostname started

-------------------------------------------

starting SAP Instance J30

Startup-Log is written to /home/sidadm/startsap_J30.log

-------------------------------------------

/usr/sap/FSI/J30/exe/sapcontrol -prot NI_HTTP -nr 30 -function Start

thats all

sunny_pahuja2
Active Contributor
0 Kudos

Could you please also paste sapstartsrv logs?

Thanks

Sunny

former_member206552
Active Contributor
0 Kudos

hostname:sidadm 54> cat sapstartsrv.log

---------------------------------------------------
trc file: "sapstartsrv.log", trc level: 0, release: "720"
---------------------------------------------------
pid        28570

[Thr 46963980054144] Wed Sep 11 13:18:46 2013
No halib defined => HA support disabled
CCMS agent initialization for instance type J2EE: return code 0.
CCMS agent start: return code 0.
Initializing SAPControl Webservice
Starting AutoRestart thread
AutoRestart thread started
Starting WebService SSL thread
Starting WebService thread
Webservice SSL thread started, listening on port 53014
Trusted https connect via Unix domain socket '/tmp/.sapstream53014' enabled.
Webservice thread started, listening on port 53013
Trusted http connect via Unix domain socket '/tmp/.sapstream53013' enabled.

trusted unix domain socket user is starting SAP System at 2013/09/11 13:18:56

former_member193518
Active Participant
0 Kudos

Can you also try stopping sapstartsrv:

> stopsap [vhost] sapstartsrv

Make sure that it is definitely stopped by using "ps".

sunny_pahuja2
Active Contributor
0 Kudos

There are no errors here. I would suggest to raise OSS to SAP.

Thanks

Sunny

former_member206552
Active Contributor
0 Kudos

Hi Sunny

I have logged an OSS Yesterday, thanx for the assistance

Best Regards

Marius

former_member206552
Active Contributor
0 Kudos

Good Day,

It was customer specific enviroment variables that caused the issue, I removed them in the .cshrc and the system started up.

thank you for everyone

best regards

marius

Answers (5)

Answers (5)

Former Member
0 Kudos

Dear Marius,

We are also facing the same error. Can you please tell us what exactly was changed.

Thanks and Regards,

Vinod

former_member193518
Active Participant
0 Kudos

Have you seen the "Correct Answer" is highlighted below the first post?

It was an issue with some customising inside the .cshrc Unix/Linux shell profile.

Do you have any specific customising of the .cshrc or .login or .profile files?
Are you using Linux/Unix or are you using Windows?

Regards,


Darryl

Former Member
0 Kudos

Thanks Darryl.

Yes Of-cource I saw the answer and it was an issue with the profile of the user.

We are on AIX and I could not find any issues with our profile .cshrc or .login profiles and env seems to be okay (atleast I could not find any issues ). I would like to know what specifically was the issue and with the profile of which user (sapadm, sidadm or orasid ).

Best Regards,

Vinod

Former Member
0 Kudos

Dear All,

We solved our issue, Apparently it as due to the latest version of AIX which we were using. There is an SAP not which tells that  AIX SP5 is not supported.

Best Regards.

Vinod

Former Member
0 Kudos

Hello,

I am also facing the same error. I have checked the .login .profile .cshrc (source) files and also compared with anoter system. Nothing found.


Can you please tell us what exactly was changed.


My Kernel version is 721_REL/Unicode patch level 500.

Regards,

Nilesh Navale

My issue is solved. it' a Bug.

Thanks,

Nilesh Navale

Message was edited by: nilesh navale

0 Kudos

Ok, this is really basic, but quick.  Check a full df and make sure you don't have a filesystem full.

Former Member
0 Kudos

Check status of sapstartsrv process with ps command. As a workaround try to stop sapstartsrv service with kill -9. Check with ps command that no process exists for sapstartsrv. Start it again and check with sapcontrol.

Former Member
0 Kudos

Hi,

sapstartsrv can be one of the reasons.

  1. On Windows, a 701 sapstartsrv does not respond; clients such as SAP MMC / MC or sapcontrol hang. "netstat -ano | findstr 5..13 |findstr LISTENING" shows two processes that respond to the same port. For one of them, a PID of a sapstartsrv that no longer runs is displayed.

Can you please follow this note and try,

Note 1565645 - SAP composite note: sapcontrol

What was the kernel version you updated to and from.

Have you check the log in the work directory.

Have you tried to kill all the process and restart back.

What is the result when you run top command.

Thanks

Rishi Abrol

former_member206552
Active Contributor
0 Kudos

Hi Rishi,

I have stopped everything cleared out the /tmp/.sapstream files, made sure no processes are running, cleaned out the memory using cleanipc , made sure no sidadm processes are in memory and tried to start again, but this the same

the kernel version was not update this was a fresh install done 4 weeks ago using 720:401 yesterday i had to make changes to a database parameter filesystemio_options=asynch this is why i had to restart. this is not the problem, (but for a test i have also changed it back to no avail)

as stated in the work directory there is no logs other than shown above,

top command there is no sap processes,

Best Regards

Marius

Former Member
0 Kudos

Hi,

Can you please check the below note.

Note 896973 - Service 'xyz' unknown; error in getservbyname/getaddrinfo

Thanks

Rishi Abrol

former_member206552
Active Contributor
0 Kudos

Hi Rishi

I have just checked the note and did the niping -v -S successfull

Best Regards

Marius

Former Member
0 Kudos

Hi.

I just ran the below command in my system .

sapcontrol -prot NI_HTTP -nr 55 -function Start -debug

and it does the below

NiIGetServNo: servicename '55513' = port 55513

NiICreateHandle: hdl 1 state NI_INITIAL_CON

NiILocalCheck: local loopback address: 127.0.0.1

NiIInitSocket: set default settings for new hdl 1/sock 3 (UD; ST)

NiIBlockMode: set blockmode for hdl 1 FALSE

NiITraceByteOrder: CPU byte order: big endian, network, high val..low val

NiIConnectSocket: hdl 1 is connecting to /tmp/.sapstream55513 (timeout=-1)

NiIConnectSocket: connection of hdl 1 established to /tmp/.sapstream55513

NiIConnect: state of hdl 1 NI_CONNECTED

what happens when you do it.

Is your system able to establish with Port 5XX13.

Please also check that the /tmp directory has proper right.

and

If the sapstartsrv was running with the incorrect profile,

If you system doesn't have the START profiles, and you don't have a backup from the working profile, you may look the profiles of a working system, and then manually add the startup parameters. However, this is a non-supported procedure, and you may do it by your own risk and bear the sole responsibility for it.

Thanks

Rishi Abrol

former_member206552
Active Contributor
0 Kudos

Hi

please see below requested for sapcontrol


sapcontrol -prot NI_HTTP -nr 30 -function Start -debug

hostname:sidadm 56> sapcontrol -prot NI_HTTP -nr 30 -function Start -debug
Wed Sep 11 13:21:22 2013
NiIInit: allocated nitab (2048 at 2acb6f24a010)
NiIHSBufInit: initialize hostname buffer (IPv4)
NiHLInit: alloc host buf (100 entries)
NiSrvLInit: alloc serv bufs (100 entries)
NiPGetNodeAddrList: got 5 interface(s) from operating system
                [ 0-lo      ] IPv4-Address: 127.0.0.1 UP
                [ 1-lo      ] IPv4-Address: 127.0.0.2 UP
                [ 2-eth0    ] IPv4-Address:  UP
                [ 3-eth0:1  ] IPv4-Address:  UP
                [ 4-eth1    ] IPv4-Address:  UP
***LOG Q0I=> NiPGetServByName: 'sapctrl30' not found: getaddrinfo [niuxi.c 1814]
NiSrvLGetServNo: service name 'sapctrl30' not found by operating system
NiInit3: NI already initializes (init=1;cur=2048)
addrinfo of 'localhost':
0: 127.0.0.1:0 'localhost' RAW (2-2-3-0-16)
1: 127.0.0.1:0 RAW (2-2-3-0-16)
NiHLGetNodeAddr: got hostname 'localhost' from operating system
NiIGetNodeAddr: hostname 'localhost' = addr 127.0.0.1
NiIGetServNo: servicename '53013' = port 53013
NiICreateHandle: hdl 1 state NI_INITIAL_CON
NiILocalCheck: local loopback address: 127.0.0.1
NiIInitSocket: set default settings for new hdl 1/sock 3 (UD; ST)
NiIBlockMode: set blockmode for hdl 1 FALSE
NiITraceByteOrder: CPU byte order: little endian, reverse network, low val .. high val
NiIConnectSocket: hdl 1 is connecting to /tmp/.sapstream53013 (timeout=-1)
NiIConnectSocket: connection of hdl 1 established to /tmp/.sapstream53013
NiIConnect: state of hdl 1 NI_CONNECTED
NiIBlockMode: set blockmode for hdl 1 TRUE
NiIWrite: hdl 1 sent data (wrt=687,pac=1,RAW_IO)

sapstartsrv  starts fine when it gets to sapcontrol it hangs

former_member193518
Active Participant
0 Kudos

It's not finding the entry saphostctrl in the /etc/services file:

***LOG Q0I=> NiPGetServByName: 'sapctrl30' not found: getaddrinfo [niuxi.c 1814]

NiSrvLGetServNo: service name 'sapctrl30' not found by operating system

Add the appropriate entry to /etc/services.


Former Member
0 Kudos

Hi,

Can you please check what is the permission of below file.

/usr/sap/SID/J30/exe:


-rwxr-xr-x  1 binadm sapsys 1509173 2008-02-29 08:21 sapuxuserchk


Execute the following commands:

chown root:sapsys sapuxuserchk

chmod u+s,o-rwx sapuxuserchk


The authorization should now look, for example, as follows:

-rwsr-x---  1 root sapsys 1509173 2008-02-29 08:21 sapuxuserchk

Have you activate the ssl for sapstartsrv as in the logs its showing port 5XX14.

Note 1439348 - Extended security settings for sapstartsrv

Thanks

Rishi Abrol

former_member206552
Active Contributor
0 Kudos

Hi Darryl

The saphostctrl is in the services file, and this warning i get in the Dev system as well which is working 100%

Best Regards

Marius

former_member193518
Active Participant
0 Kudos

Sorry, that should have read "sapctrl30".  It's not finding "sapctrl30" in the /etc/services file.

Can you check if that exists?

sunny_pahuja2
Active Contributor
0 Kudos

What is kernel version of the system?

Thanks

Sunny

former_member206552
Active Contributor
0 Kudos

Hi Sunny

kernel release                720

kernel make variant           720_EXT_REL

compiled on                   Linux GNU SLES-11 x86_64 cc4.3.4 use-pr121116 for linuxx86_64

compiled for                  64 BIT

compilation mode              UNICODE

compile time                  Jan 15 2013 18:18:58

update level                  0

patch number                  401

source id                     0.401

sunny_pahuja2
Active Contributor
0 Kudos

There are some recent changes on kernel 720 because of which you might face problem during start/stop. Please refer to SAP note 1825259.

Thanks

Sunny

former_member206552
Active Contributor
0 Kudos

Hi Sunny

This is a helpfull note but running

sapcontrol -nr 30 -function GetEnvironment

does the same also hangs, i have also double cheked it with another system the enviroment to make sure its correct

best regards

marius

sunny_pahuja2
Active Contributor
0 Kudos

sapcontrol -nr <instance number> -function GetEnvironment -debug

Could you please run this command and share the output?

Please also refer to SAP note 1301712.

Thanks

Sunny

former_member206552
Active Contributor
0 Kudos

Hi Sunny

please see output below

sapcontrol -nr 30 -function GetEnvironment -debug


hostname:sidadm 52> sapcontrol -nr 30 -function GetEnvironment -debug
Wed Sep 11 12:24:19 2013
NiIInit: allocated nitab (2048 at 2ae5a69ad010)
NiIHSBufInit: initialize hostname buffer (IPv4)
NiHLInit: alloc host buf (100 entries)
NiSrvLInit: alloc serv bufs (100 entries)
NiPGetNodeAddrList: got 5 interface(s) from operating system
                [ 0-lo      ] IPv4-Address: 127.0.0.1 UP
                [ 1-lo      ] IPv4-Address: 127.0.0.2 UP
                [ 2-eth0    ] IPv4-Address: UP
                [ 3-eth0:1  ] IPv4-Address: UP
                [ 4-eth1    ] IPv4-Address: UP
***LOG Q0I=> NiPGetServByName: 'sapctrl30' not found: getaddrinfo [niuxi.c 1814]
NiSrvLGetServNo: service name 'sapctrl30' not found by operating system
NiInit3: NI already initializes (init=1;cur=2048)
addrinfo of 'localhost':
0: 127.0.0.1:0 'localhost' RAW (2-2-3-0-16)
1: 127.0.0.1:0 RAW (2-2-3-0-16)
NiHLGetNodeAddr: got hostname 'localhost' from operating system
NiIGetNodeAddr: hostname 'localhost' = addr 127.0.0.1
NiIGetServNo: servicename '53013' = port 53013
NiICreateHandle: hdl 1 state NI_INITIAL_CON
NiILocalCheck: local loopback address: 127.0.0.1
NiIInitSocket: set default settings for new hdl 1/sock 3 (UD; ST)
NiIBlockMode: set blockmode for hdl 1 FALSE
NiITraceByteOrder: CPU byte order: little endian, reverse network, low val .. high val
NiIConnectSocket: hdl 1 is connecting to /tmp/.sapstream53013 (timeout=-1)
NiIConnectSocket: connection of hdl 1 established to /tmp/.sapstream53013
NiIConnect: state of hdl 1 NI_CONNECTED
NiIBlockMode: set blockmode for hdl 1 TRUE
NiIWrite: hdl 1 sent data (wrt=705,pac=1,RAW_IO)

I have checked the .login .profile .cshrc (source) files and also compared with anoter system

Best Regards

Marius