SAP Instance is Starting after karnal Downgrade

[Former Member]

Dear Expert Team,

I have done upgarde Ecc6.0 to Ecc with Ehp7 in my Quality Server , Then for some activity

,

I was done downgrade ehp7 to ehp6 as given  process.

1. First Restore Full offline backup of Ehp6

2. Second Restore Old Kernal i.e 720

3. Third Restore Old SAP Profile Directory .

I have  already taken  Full Offline backup  of Ehp7 .

Now I have done restore of Full Offline backup of Ehp7 in same server.

Then I Restore Ehp7 Kernal i.e 740

Then Restore Ehp7 SAP Profile .

Now When I am starting Listner and Oracle , Its starting successfully.

But when I am starting SAP Instance ,Its given below error.

sapqas:qasadm 11> startsap r3

Checking QAS Database

Database is running

-------------------------------------------

Could not open the ICU common library.

The following files must be in the path described by

the environment variable "LD_LIBRARY_PATH":

libicuuc.sl.30, libicudata.sl.30, libicui18n.sl.30 [nlsui0.c 1606]

pid

= 4101

/usr/sap/QAS/SYS/exe/uc/hpia64/startsap[6]: test: Specify a parameter

with this command.

touch: /dev_tp cannot create

Starting Startup Agent sapstartsrv

Unknown webmethod: WaitforServiceStarted

Startup of Instance Service failed

See /home/qasadm/startsap_DVEBMGS00.log for details.

But When I check work directory ,In this only one file is available i.e available.log

sapqas:qasadm 1> cd /usr/sap/QAS/DV*

sapqas:qasadm 2> cd work

sapqas:qasadm 3> ls -ltr

total 2

-rw-rw-rw-   1 qasadm     sapsys          54 Dec 22 14:38 available.log

Regards

[isaias_freitas]

Hello,

Could not open the ICU common library.
The following files must be in the path described by
the environment variable "LD_LIBRARY_PATH":
libicuuc.sl.30, libicudata.sl.30, libicui18n.sl.30 [nlsui0.c 1606]

If the environment variable "LD_LIBRARY_PATH" is not set, set it pointing it to the SAP kernel folder.

If it is already set, include the kernel folder at the beginning of its definition.

Regards,

Isaías

[Former Member]

Dear Isaias,

Thanks for your response ,

I have check environment as given below .In this LD_LIBRARY_PATH is not showing.

sapqas:qasadm 21> env

HOME=/home/qasadm

PATH=/oracle/QAS/11203/bin:/opt/java1.4/bin:/usr/bin:/usr/ccs/bin:/usr/contrib/bin:/usr/contrib/Q4/bin:/o

LOGNAME=qasadm

SHELL=/bin/csh

TERM=hp

COLUMNS=110

LINES=58

MANPATH=/usr/share/man/%L:/usr/share/man:/usr/contrib/man/%L:/usr/contrib/man:/usr/local/man/%L:/usr/loca

TZ=IST-5:30

SAPSYSTEMNAME=QAS

DIR_LIBRARY=/usr/sap/QAS/SYS/exe/run

RSEC_SSFS_DATAPATH=/usr/sap/QAS/SYS/global/security/rsecssfs/data

RSEC_SSFS_KEYPATH=/usr/sap/QAS/SYS/global/security/rsecssfs/key

rsdb_ssfs_connect=1

SHLIB_PATH=/usr/sap/QAS/SYS/exe/run:/usr/sap/QAS/SYS/exe/uc/hpia64:/oracle/client/11x_64/instantclient

JAVA_HOME=/opt/java1.4

SAPEXE=/usr/sap/QAS/SYS/exe/run

THREAD=NOPS

DB_SID=QAS

dbms_type=ORA

dbs_ora_tnsname=QAS

dbs_ora_schema=SAPSR3

ORACLE_SID=QAS

ORACLE_BASE=/oracle

TNS_ADMIN=/usr/sap/QAS/SYS/profile/oracle

ORACLE_HOME=/oracle/QAS/11203

NLS_LANG=AMERICAN_AMERICA.UTF8

SAPDATA_HOME=/oracle/QAS

sapqas:qasadm 22>

But when I check kernal files , its show in /sapmnt/QAS/exe/uc/hpia64

sapqas:qasadm 22> cd /sapmnt/QAS/exe/

sapqas:qasadm 23> ls -ltr

total 63136

drwxr-sr-x   3 qasadm     sapsys          96 Sep 25 10:02 uc

-rwxr-xr-x   1 qasadm     sapsys     8697248 Sep 25 10:03 dsrlib.so

-rwxr-xr-x   1 qasadm     sapsys     21449672 Sep 25 10:03 sapccmsr

-rwxr-xr-x   1 qasadm     sapsys     2163488 Sep 25 10:03 sapuxuserchk

sapqas:qasadm 24> cd uc

sapqas:qasadm 25> ll

total 16

drwxr-sr-x   5 qasadm     sapsys        8192 Dec 17 11:44 hpia64

sapqas:qasadm 26> cd hpia64

sapqas:qasadm 27> ll

total 3572160

-rwxr-xr-x   1 qasadm     sapsys      930206 Sep 25 10:02 ABAP.pad

-rwxrwxrwx   1 qasadm     sapsys          41 Sep 25 10:03 DBATL720O10_40-10011323

-rwxrwxrwx   1 qasadm     sapsys     65628058 Sep 25 10:03 DBATL720O10_40-10011323.SAR

-rwxr-xr-x   1 qasadm     sapsys     46419840 Sep 25 10:02 ITS.SAR

-rwxr-xr-x   1 qasadm     sapsys     20397576 Sep 25 10:02 R3check

-rwxr-xr-x   1 qasadm     sapsys     13589880 Sep 25 10:03 R3ldctl

-rwxr-xr-x   1 qasadm     sapsys     18875760 Sep 25 10:03 R3load

Please suggest .

[Sriram2009]

Hi Pooja.

Could you refer the SAP Note for starting issue

1994537 - Incorrect version of SAP NW RFC library causes IGS mutliplexer to fail to start

Regards

SS

[Former Member]

Dear Sir,

Can I update  IGS  for  igsexe_10-10007944.sar and igshelper_10-10007944.sar

Please suggest.

Regards.

[Sriram2009]

Hi Pooja.

Ya, You can update the IGS and check the SAP startup ..

On your Landscape you check the IGS version in Dev & Prd systems.

How to check the IGS  -

Regards

SS

[Former Member]

Dear Sriram,

I have update IGS , then check the vesion of igs.

sapqas:qasadm 38> ll igs*

-rwxr-xr-x   1 qasadm     sapsys         189 Jun 16  2015 igsexe.lst

-rw-r-----   1 qasadm     sapsys          51 Dec 23 15:24 igsexe_10-10007944

-rw-r-----   1 qasadm     sapsys     117801514 Dec 23 15:23 igsexe_10-10007944.sar

-rwxr-xr-x   1 qasadm     sapsys         460 Jun 16  2015 igsmanifest.mf

-rwxr-xr-x   1 qasadm     sapsys     34712040 Jun 16  2015 igsmux_mt

-rwxr-xr-x   1 qasadm     sapsys     16074448 Jun 16  2015 igspw_mt

-rwxr-xr-x   1 qasadm     sapsys     13750808 Jun 16  2015 igswd_mt

sapqas:qasadm 39> more igsmanifest.mf

a57y0CManifest-Version: 1.0

keyname: BC-FES-IGS

keyvendor: sap.com

keylocation: SAP AG

igs os: hpia64

igs release: 720

make variant: 720_REL

igs patch number: 10

patch number igswd_mt: 0

patch number igsmux_mt: 1

patch number igspw_mt: 0

patch number gfwchart.so: 1001

patch number xmlchart.so: 1000

patch number bwgis.so: 10

patch number sgxgis.so: 1

patch number imgconv.so: 0

patch number zipper.so: 0

downward-compatible to: 700 710 701 702 711 720 730 740

sapqas:qasadm 40> pwd

/usr/sap/QAS/DVEBMGS00/exe

sapqas:qasadm 41>

But When I am starting SAP Instance , Its give same error.

sapqas:qasadm 21>

sapqas:qasadm 21> startsap r3

Checking QAS Database

Database is running

-------------------------------------------

Could not open the ICU common library.

   The following files must be in the path described by

   the environment variable "LD_LIBRARY_PATH":

   libicuuc.sl.30, libicudata.sl.30, libicui18n.sl.30 [nlsui0.c 1606] pid = 7759

/usr/sap/QAS/SYS/exe/uc/hpia64/startsap[6]: test: Specify a parameter with this command.

touch: /dev_tp cannot create

Starting Startup Agent sapstartsrv

Unknown webmethod: WaitforServiceStarted

Startup of Instance Service failed

See /home/qasadm/startsap_DVEBMGS00.log for details

-------------------------------------------

sapqas:qasadm 22> pwd

/home/qasadm

sapqas:qasadm 23>

sapqas:qasadm 25> cd /sapmnt/QAS/exe/uc/

sapqas:qasadm 26> ll

total 16

drwxr-sr-x   5 qasadm     sapsys        8192 Dec 23 21:45 hpia64

sapqas:qasadm 27> cd hpia64

sapqas:qasadm 28> ll

total 4429264

-rwxr-xr-x   1 qasadm     sapsys      930206 Sep 25 10:02 ABAP.pad

-rwxrwxrwx   1 qasadm     sapsys          41 Sep 25 10:03 DBATL720O10_40-10011323

-rwxrwxrwx   1 qasadm     sapsys     65628058 Sep 25 10:03 DBATL720O10_40-10011323.SAR

-rwxr-xr-x   1 qasadm     sapsys     46419840 Sep 25 10:02 ITS.SAR

-rwxr-xr-x   1 qasadm     sapsys     20397576 Sep 25 10:02 R3check

-rwxr-xr-x   1 qasadm     sapsys     13589880 Sep 25 10:03 R3ldctl

-rwxr-xr-x   1 qasadm     sapsys     18875760 Sep 25 10:03 R3load

-rwxr-xr-x   1 qasadm     sapsys     12542352 Sep 25 10:03 R3szchk

-rwxr-xr-x   1 qasadm     sapsys     16853080 Sep 25 10:02 R3ta

-rwxr-xr-x   1 qasadm     sapsys     20725152 Sep 25 10:02 R3trans

[isaias_freitas]

Hello,

I have check environment as given below .In this LD_LIBRARY_PATH is not showing.

This would be the root cause.

In this case, you need to set the variable and point it to the "exe" folder of the instance (/usr/sap/QAS/DVEBMGS??/exe), as I indicated in my previous reply .

Regards,

Isaías

[Sriram2009]

Hi Pooja.

1. Could you share the log home/qasadm/startsap_DVEBMGS00.log for details ?

2. Refer the SAP Notes above startup error mesasge

519753 - Problems with ICU shared libraries

1574751 - Linux: libc.so.6: version `GLIBC_2.7' not found

2223428 - After applying kernel 7.42, IGS does not start anymore

Regards

SS

[Former Member]

Dear Sirram,

Please find the below log

sapqas:qasadm 22> more startsap_DVEBMGS00.log

a57y0CTrace of system startup/check of SAP System QAS on Wed Dec 23 21:46:46 IST 2015

Called command: /usr/sap/QAS/SYS/exe/uc/hpia64/startsap start

-------------------------------------------

21:46:47

Starting Startup Agent sapstartsrv

-------------------------------------------

21:46:48

Startup of Instance Service failed

-------------------------------------------

21:46:48

See /home/qasadm/startsap_DVEBMGS00.log for details

d@sapqas:qasadm 23> .log: ENDd@

Regards

[Former Member]

Dear ,

How to set  environment variable  for "LD_LIBRARY_PATH .

All kernal exe files in the  /sapmnt/QAS/exe/uc/hpia64 .

As given below.

sapqas:qasadm 23> pwd

/home/qasadm

sapqas:qasadm 24> cd /sapmnt/QAS/exe/

sapqas:qasadm 25> ll

total 63136

-rwxr-xr-x   1 qasadm     sapsys     8697248 Sep 25 10:03 dsrlib.so

-rwxr-xr-x   1 qasadm     sapsys     21449672 Sep 25 10:03 sapccmsr

-rwxr-xr-x   1 qasadm     sapsys     2163488 Sep 25 10:03 sapuxuserchk

drwxr-sr-x   3 qasadm     sapsys          96 Sep 25 10:02 uc

sapqas:qasadm 26> cd uc

sapqas:qasadm 27> ll

total 16

drwxr-sr-x   5 qasadm     sapsys        8192 Dec 23 21:45 hpia64

sapqas:qasadm 28> cd hpia64

sapqas:qasadm 29> ll

total 4429264

-rwxr-xr-x   1 qasadm     sapsys      930206 Sep 25 10:02 ABAP.pad

-rwxrwxrwx   1 qasadm     sapsys          41 Sep 25 10:03 DBATL720O10_40-10011323

-rwxrwxrwx   1 qasadm     sapsys     65628058 Sep 25 10:03 DBATL720O10_40-10011323.SAR

-rwxr-xr-x   1 qasadm     sapsys     46419840 Sep 25 10:02 ITS.SAR

-rwxr-xr-x   1 qasadm     sapsys     20397576 Sep 25 10:02 R3check

-rwxr-xr-x   1 qasadm     sapsys     13589880 Sep 25 10:03 R3ldctl

-rwxr-xr-x   1 qasadm     sapsys     18875760 Sep 25 10:03 R3load

-rwxr-xr-x   1 qasadm     sapsys     12542352 Sep 25 10:03 R3szchk

Please suggest .

Regards

[Former Member]

Dear Sirram ,

When I check the directory structure of given  path  /usr/sap/QAS/SYS/exe/ from other server.

In this dbg and run   link is different from  other SAP Server .

As given below.

sapqas:qasadm 58> cd /usr/sap/QAS/SYS/exe/

sapqas:qasadm 59> ll

total 0

lrwxrwxr-x   1 qasadm     sapsys           9 Jan 23  2015 dbg -> uc/hpia64

lrwxr-xr-x   1 qasadm     sapsys          19 May 11  2014 nuc -> /sapmnt/QAS/exe/nuc

drwxr-xr-x   2 qasadm     sapsys          96 May 11  2014 opt

lrwxrwxr-x   1 qasadm     sapsys           3 Jan 23  2015 run -> dbg

lrwxr-xr-x   1 qasadm     sapsys          18 May 11  2014 uc -> /sapmnt/QAS/exe/uc

sapqas:qasadm 60>

sapprd1:/usr/sap/PRD/SYS/exe>ll

total 0

lrwxr-xr-x   1 prdadm     sapsys          15 Jul 17  2013 dbg -> /sapmnt/PRD/exe

lrwxr-xr-x   1 prdadm     sapsys          19 Jul 17  2013 nuc -> /sapmnt/PRD/exe/nuc

drwxr-xr-x   2 prdadm     sapsys          96 Jul 17  2013 opt

lrwxr-xr-x   1 prdadm     sapsys          24 Jul 17  2013 run -> /usr/sap/PRD/SYS/exe/dbg

lrwxr-xr-x   1 prdadm     sapsys          18 Jul 17  2013 uc -> /sapmnt/PRD/exe/uc

sapprd1:/usr/sap/PRD/SYS/exe>cd uc

sh: uc:  not found.

sapprd1:/usr/sap/PRD/SYS/exe>

Regards

[isaias_freitas]

Hello,

The kernel files will also be at the local "exe" folder of the instance and it is strongly recommended to set the env. variable pointing to the local "exe" folder, not the "/sapmnt/.../exe" folder.

You can contact your operating system team, so they set the env. variable to you in such a way that it will persist server restarts. Otherwise, you would have to manually set it each time...

Regards,

Isaías