cancel
Showing results for 
Search instead for 
Did you mean: 

dp lib version mismatch-After kernel upgrade

Former Member
0 Kudos

Hi All,

After kernel upgrade from 700 162 to 179 all the workprocess are not coming up i am getting the below error:

***********************************************************************************************

Full qualified hostname = XXXXXX.saipc.XXX.com

***LOG Q0Z=> DpSysAdmExtCreate, bad version (lib=241000 krn=239000) [dpxxtool2.c 681]

*****************************************************************************

*

  • LOCATION SAP-Gateway on host XXXXXXX / sapgw01

  • ERROR dp lib version mismatch, please check installation

*

  • TIME Mon Oct 20 00:33:37 2008

  • RELEASE 700

  • COMPONENT DP

  • VERSION 241000

  • RC -9999

  • MODULE dpxxtool2.c

  • LINE 688

  • DETAIL version of external and kernel dp lib mismatch (ext lib

  • version is 241000 / kernel lib version is 239000)

  • COUNTER 1

*

*****************************************************************************

      • ERROR => DpIPCInit2: DpSysAdmExtCreate [dpxxtool2.c 369]

***LOG S0V=> GwStopGateway, gateway stopped () [gwxxrd.c 14652]

XXXXXXXXX:ts2adm 30% pg sapcpe.log

================ >>> main =======================

    • INFO: sapcpe version: @(#) $Id: //bas/700_REL/src/ccm/sapstart/sapxxcpe.c#18 $ SAP

=================================================

    • INFO: Try to find file table sapcpeft (default:sapcpeft)

    • INFO: Try to find file table in the central directory /usr/sap/TS2/SYS/exe/ctrun/sapcpeft

    • INFO: not found any file table.

=================================================

Update Local Programs (dir-sync + file-path + ln)

=================================================

Starting at 2008/10/20 00:33:34

    • ERROR: can't change to central Executable-Dir /usr/sap/TS2/SYS/exe/ctrun (No such file or directory) [sapxxcpe.c:1488]

Mon Oct 20 00:50:19 2008

      • ERROR => gateway (pid 24413) died [dpxxdisp.c 16063]

DpGwCheck: appc_adm.stat = 2

      • DP_FATAL_ERROR => Gateway could not be started - I better exit now

*************************************************************************************************************************

please help in solving this problem

Thanks

Giridhar

Edited by: giridhar n on Oct 20, 2008 12:47 PM

Accepted Solutions (0)

Answers (6)

Answers (6)

raoul_serra2
Participant
0 Kudos

Beside the Full Procedure for a Kernel Upgrade that I posted in this "Treat"...

Here some more details about the "permanent fix" for this sapcpe kernel replication error

When a SAP instance is upgraded you will find in the "start profile" the following 4 parameters:

(but those parameters are not in the instance profile, they will be if you do a fresh install)

DIR_CT_RUN = $(DIR_EXE_ROOT)/run

DIR_EXECUTABLE = $(DIR_INSTANCE)/exe

DIR_PROFILE = $(DIR_INSTALL)/profile

PF = $(DIRPROFILE)/PSR_DVEBMGS<NN>_<hostname>

OSS Note 1104735 give the real permanent fix:

At point 4

4. Copy the profile parameters DIR_CT_RUN, DIR_EXECUTABLE, DIR_PROFILE

and _PF from the start profile to the instance profile.

Solution:

Add to the instance profile those 4 same entries as in start profile

DIR_CT_RUN = $(DIR_EXE_ROOT)/run

DIR_EXECUTABLE = $(DIR_INSTANCE)/exe

DIR_PROFILE = $(DIR_INSTALL)/profile

PF = $(DIRPROFILE)/PSR_DVEBMGS<NN>_<hostname>

(replace <NN> with your instance number and <hostname> with your own value)

This will make "sapcpe" working again like it should.

Kind regards,

Raoul Serra

Hope this will close the question

richard_howard
Active Participant
0 Kudos

We had this same issue today and folks that are not familiar with sapcpe can really be at a loss on this error, so I'm updating some of these older threads for clarification.

When sapcpe is active, you actually have two copies of the SAP kernel on your Unix file system:

/sapmnt/SID/exe - Which is probably where you update your kernel (this version was at 201)

(aka: /usr/sap/SID/SYS/exe/run)

/usr/sap/SID/DVEBMGS##/exe - A location many don't know about (this version was at 133)

Typically, sapcpe keeps these two locations identical and there are no mismatch errors but if anything happens to your configuration, the next time you update your kernel in /sapmnt/SID/exe, the replication does not occur and the mismatch happens as seen in (dev_disp or dev_disp.new):

***LOG Q00=> DpSapEnvInit, DPStart (18 22336) [dpxxdisp.c 1283]

DwSLCheckVersion: shared library version mismatch:

shared lib "dw_xml.sl" version 133 <-> kernel version 201

shared lib "dw_xtc.sl" version 133 <-> kernel version 201

shared lib "dw_stl.sl" version 133 <-> kernel version 201

shared lib "dw_gui.sl" version 133 <-> kernel version 201

shared lib "dw_mdm.sl" version 133 <-> kernel version 201

This is made even more confusing because if you do an "ldd /sapmnt/SID/exe/disp+work". The results will tell you that it's reading those files from where you just patched your kernel. That ldd is incorrect, however. If the two copies of the kernel are not in sync, some files will indeed be loaded from /usr/sap/SID/DVEBMGS##/exe which will not match the other files that are loading from /sapmnt/SID/exe and you'll have the mismatch error.

Short Term: You can delete the contents in /usr/sap/SID/DVEBMGS##/exe and then everything is loaded from /sapmnt/SID/exe.

Long Term: Correct the configuration of sapcpe so that it keeps everything in sync and you don't have dualing kernels. (See note 1104735)

raoul_serra2
Participant
0 Kudos

Here is the solution (and procedure) plus explanation about your problem:

A NW 7.0 Kernel is replicated from /sapmnt/<SID>/exe into /usr/sap/<SID>/DVEBMGS<NN>/exe

this is done at startup by program sapcpe

in your case sapcpe is not working, probably because your instace is an ugrade one

- check the log in /usr/sap/<SID>/DVEBMGS<NN>/work/sapcpe.log

You will probably find something like :

>more sapcpe.log

================ >>> main =======================

    • INFO: sapcpe version: @(#) $Id: //bas/700_REL/src/ccm/sapstart/sapxxcpe.c#17 $ SAP

=================================================

    • INFO: Try to find file table sapcpeft (default:sapcpeft)

    • INFO: Try to find file table in the central directory /usr/sap/<SID>P/SYS/exe/ctrun/sapcpeft

    • INFO: not found any file table.

=================================================

Update Local Programs (dir-sync + file-path + ln)

=================================================

Starting at yyyy/mm/dd hh:mm:ss

    • ERROR: can't change to central Executable-Dir

/usr/sap/<SID>/SYS/exe/ctrun (No such file or directory)

This problem may be there after an SAP release upgrade

You don't have a .../exe/ctrun directory in your case you have .../exe/run

If SAPCPE dosen't work. You have 3 choices:

1. Add a manual copy of the new kernel files into /usr/sap/<SID>/<instance>/exe path

2. Proceed according to Note 1104735 to setup sapcpe

3. ensure that the directory /usr/sap/<SID>/<instance>/exe is empty or

does not exist. [Not recommend, because some security file may exist in

local kernel, that may cause no more logon possible]

Please check also SAP Help URL :

http://help.sap.com/saphelp_nw70/helpdata/EN/4f/37782d21fc11d288cd0000e83539c3/frameset.htm

Well you have also another choice... Use my procedure that work perfect !

Here it is :

PROCEDURE for SAP Kernel Upgrade - ABAP stack only - (NW 7.0 - AIX64 / Oracle)

Replace [sid] - <SID> - <NN> - <hostname> by your own values

Check for free space in /sapmnt/<SID>

and in /usr/sap/<SID>

/sapmnt/<SID> 7372800 = 3735552 85% free OK

/usr/sap/<SID> 6553600 = 3276800 36% free OK

ora[sid]>

crontab -e

(disable brbackup/brarchive)

[sid]adm>

stopsap

saposcol -k

ps -ef|grep sap

kill <remaining sap processes>

cleanipc <NN> remove

to revert back to old kernel

cd /sapmnt/<SID>/exe

/usr/sbin/slibclean

cleanipc <NN> remove

/sapmnt/SAPCAR -xvf /sapmnt/<SID>/old_SAP_kernel-1.SAR -R /sapmnt/<SID>/exe

/sapmnt/SAPCAR -xvf /sapmnt/<SID>/old_SAP_kernel-2.SAR -R /usr/sap/<SID>/DVEBMGS<NN>/exe

./saproot.sh <SID>

root>

/usr/sbin/slibclean

use SAPCAR (or tar) to backup old Kernel like here under

[ download latest SAPCAR and copy it to /sapmnt/ ]

cd /sapmnt/<SID>/exe

/sapmnt/SAPCAR -cvf /sapmnt/<SID>/old_SAP_kernel-1.SAR *

cd /usr/sap/<SID>/DVEBMGS00/exe

/sapmnt/SAPCAR -cvf /sapmnt/<SID>/old_SAP_kernel-2.SAR *

extract new kernel

cd /sapmnt/<SID>

mkdir kernelNEW

cd /sapmnt/<SID>/kernelNEW

/sapmnt/SAPCAR -xvf /sapmnt/SAPEXE_*.SAR

/sapmnt/SAPCAR -xvf /sapmnt/SAPEXEDB_*.SAR

/sapmnt/SAPCAR -xvf /sapmnt/DBATL700*.SAR

/sapmnt/SAPCAR -xvf /sapmnt/SAPCPE_*.SAR

/sapmnt/SAPCAR -xvf /sapmnt/LIBRFC_*.SAR

/sapmnt/SAPCAR -xvf /sapmnt/CPICTLIB_*.SAR

/sapmnt/SAPCAR -xvf /sapmnt/DW_*.SAR

/sapmnt/SAPCAR -xvf /sapmnt/IGSEXE_*.SAR

cd /sapmnt/<SID>/

chown -Rf <SID>adm:sapsys kernelNEW

cp -pr ./kernelNEW/* /sapmnt/<SID>/exe/

cp -pr ./kernelNEW/* /usr/sap/<SID>/DVEBMGS<NN>/exe/

cd /sapmnt/<SID>/exe

./saproot.sh <SID>

/usr/sbin/slibclean

ora<SID>>

crontab -e

(enable again brbackup/brarchive)

<SID>adm>

sappfpar check pf=/usr/sap/<SID>/SYS/profile/<SID>_DVEBMGS<NN>_<hostname>

saposcol -l

startsap

          1. Check if you can logon to SAP - You are done ######

Kind regards,

I hope this will help ...let me know

Raoul Serra

former_member204746
Active Contributor
0 Kudos

you might have run out of memory. check your memory-related parameters.

Former Member
0 Kudos

Hi,

We faced an issue with workprocesses which are not coming up after the kernel(700) upgrade from patch 162 to 179. below are the error logs:

Error Log

(XXXXXXXXX is the hostname)

*******************************************************************************************************************

Dev_W1:

XXXXXXXXX:ts2adm 9% more dev_w1.old

-


trc file: "dev_w1", trc level: 1, release: "700"

-


*

  • ACTIVE TRACE LEVEL 1

  • ACTIVE TRACE COMPONENTS all, MJ

*

M sysno 01

M sid TS2

M systemid 370 (Solaris on SPARCV9 CPU)

M relno 7000

M patchlevel 0

M patchno 162

M intno 20050900

M make: single threaded, Unicode, 64 bit, optimized

M pid 3867

M

M

M Mon Oct 20 03:59:26 2008

M kernel runs with dp version 239000(ext=110000) (-(#) DPLIB-INT-VERSION-239000-UC)

M length of sys_adm_ext is 576 bytes

M ***LOG Q01=> ThInit, WPStart (Workproc 1 1 3867) [thxxhead.c 1281]

M ThInit: running on host XXXXXXXXX

M calling db_connect ...

C Oracle Client Version: '10.2.0.2.0'

C

C Mon Oct 20 03:59:27 2008

C Client NLS settings: AMERICAN_AMERICA.UTF8

C Logon as OPS$-user to get SAPTS2's password

C Connecting as /-TS2 on connection 0 (nls_hdl 0) ... (dbsl 700 030508)

C Nls CharacterSet NationalCharSet C EnvHp ErrHp ErrHpBatch

C 0 UTF8 1 0x106eea0c0 0x106ef1b80 0x106f02318

C Attaching to DB Server TS2 (con_hdl=0,svchp=0x106f02248,srvhp=0x106f04598)

C Starting user session (con_hdl=0,svchp=0x106f02248,srvhp=0x106f04598,usrhp=0x106ef2398)

C Now '/-TS2' is connected: con_hdl=0, nls_hdl=0, session_id=475.

C Got SAPTS2's password from OPS$-user

C Disconnecting from connection 0 ...

C Closing user session (con_hdl=0,svchp=0x106f02248,usrhp=0x106ef2398)

C Now I'm disconnected from ORACLE

C Connecting as SAPTS2/<pwd>-TS2 on connection 0 (nls_hdl 0) ... (dbsl 700 030508)

C Nls CharacterSet NationalCharSet C EnvHp ErrHp ErrHpBatch

C 0 UTF8 1 0x106eea0c0 0x106ef1b80 0x106f02318

C Starting user session (con_hdl=0,svchp=0x106f02248,srvhp=0x106f04598,usrhp=0x106ef2398)

C Now 'SAPTS2/<pwd>-TS2' is connected: con_hdl=0, nls_hdl=0, session_id=475.

C Database NLS settings: AMERICAN_AMERICA.UTF8

C DB instance TS2 is running on XXXXXXXXX with ORACLE version 10.2.0.2.0 since OCT 20, 2008, 03:49:47

B Connection 0 opened (DBSL handle 0)

B Wp Hdl ConName ConId ConState TX PRM RCT TIM MAX OPT Date Time DBHost

B 000 000 R/3 000000000 ACTIVE NO YES NO 000 255 255 20081020 035926 XXXXXXXXX

C build_stmt: reallocating stmt buffer: 256 -> 2000 characters

M db_connect o.k.

M ICT: exclude compression: .zip,.cs,.rar,.arj,.z,.gz,.tar,.lzh,.cab,.hqx,.ace,.jar,.ear,.war,.css,.pdf,.js,.gzip,.uue,.bz2,.iso,.sda,

.sar,.gif

I

I Mon Oct 20 03:59:30 2008

I MtxInit: 1 0 0

M SHM_PRES_BUF (addr: 0xffffffff64c00000, size: 20000768)

M SHM_ROLL_AREA (addr: 0xfffffffe40000000, size: 268435456)

M SHM_PAGING_AREA (addr: 0xfffffffe36000000, size: 134217728)

M SHM_ROLL_ADM (addr: 0xffffffff7597a000, size: 3715586)

M SHM_PAGING_ADM (addr: 0xffffffff79a00000, size: 656416)

M ThCreateNoBuffer allocated 572152 bytes for 1000 entries at 0xfffffffe2c004000

M ThCreateNoBuffer index size: 3000 elems

M ThCreateVBAdm allocated 12176 bytes (50 server) at 0xffffffff7a900000

X EmInit: MmSetImplementation( 2 ).

X MM global diagnostic options set: 0

X <ES> client 1 initializing ....

X Using implementation std

X <ES> Info: use normal pages (no huge table support available)

X ES initialized.

B dbntab: NTAB buffers attached

B dbntab: Buffer FTAB(hash header) (addr: 0xfffffffe2c092088, size: 576)

B dbntab: Buffer FTAB(anchor array) (addr: 0xfffffffe2c0922c8, size: 798968)

B dbntab: Buffer FTAB(item array) (addr: 0xfffffffe2c1553c0, size: 3195648)

B dbntab: Buffer FTAB(data area) (addr: 0xfffffffe2c4616c0, size: 30740480)

B dbntab: Buffer IREC(hash header) (addr: 0xfffffffe2e1b6088, size: 576)

B dbntab: Buffer IREC(anchor array) (addr: 0xfffffffe2e1b62c8, size: 798968)

B dbntab: Buffer IREC(item array) (addr: 0xfffffffe2e2793c0, size: 798912)

B dbntab: Buffer IREC(data area) (addr: 0xfffffffe2e33c480, size: 6148096)

B dbntab: Buffer STAB(hash header) (addr: 0xfffffffe2e91c088, size: 576)

B dbntab: Buffer STAB(anchor array) (addr: 0xfffffffe2e91c2c8, size: 798968)

B dbntab: Buffer STAB(item array) (addr: 0xfffffffe2e9df3c0, size: 798912)

B dbntab: Buffer STAB(data area) (addr: 0xfffffffe2eaa2480, size: 3072000)

B dbntab: Buffer TTAB(hash header) (addr: 0xfffffffe2ed94088, size: 3072)

B dbntab: Buffer TTAB(anchor array) (addr: 0xfffffffe2ed94c88, size: 798968)

B dbntab: Buffer TTAB(item array) (addr: 0xfffffffe2ee57d80, size: 1997280)

B dbntab: Buffer TTAB(data area) (addr: 0xfffffffe2f03f760, size: 14580144)

B db_con_shm_ini: WP_ID = 1, WP_CNT = 24, CON_ID = -1

B dbstat: TABSTAT buffer attached (addr: 0xfffffffe28012008)

B dbtbxbuf: Buffer TABL (addr: 0xfffffffe24000100, size: 60000256, end: 0xfffffffe27938900)

B dbtbxbuf: Buffer TABLP (addr: 0xfffffffe20000100, size: 40960000, end: 0xfffffffe22710100)

B dbexpbuf: Buffer EIBUF (addr: 0xffffffff5d800108, size: 4194304, end: 0xffffffff5dc00108)

B dbexpbuf: Buffer ESM (addr: 0xfffffffe5f800108, size: 4194304, end: 0xfffffffe5fc00108)

B dbexpbuf: Buffer CUA (addr: 0xfffffffe2fe30108, size: 5120000, end: 0xfffffffe30312108)

B dbexpbuf: Buffer OTR (addr: 0xfffffffe59800108, size: 4194304, end: 0xfffffffe59c00108)

B dbcalbuf: Buffer CALE (addr: 0xffffffff75d08000, size: 500000, end: 0xffffffff75d82120)

I *** ERROR => ShmProtect(62,3) shmat(268435641,0x0xfffffffe5a000000,(SHM_RND | 0)) (22: Invalid argument) [shmux.c 2782]

I *** ERROR => ShmCreate: ShmProtect( 62, 3) failed [shmux.c 1359]

I *** ERROR => ShmCreate( ATTACH 62, 86228824) failed 1 [mpixx.c 855]

M *** ERROR => DpInitMpi: MpiInit failed (1) [dpxxtool2.c 5064]

M in_ThErrHandle: 1

M *** ERROR => ThInit: DpInitMpi (step 1, th_errno 17, action 3, level 1) [thxxhead.c 10506]

M

M Info for wp 1

M

M pid = 3867

M severity = 0

M status = 0

M stat = WP_RUN

M waiting_for = NO_WAITING

M reqtype = DP_RQ_DIAWP

M act_reqtype = NO_REQTYPE

M rq_info = 0

M tid = -1

M mode = 255

M len = -1

M rq_id = 65535

M rq_source =

M last_tid = 0

M last_mode = 0

M semaphore = 0

M act_cs_count = 0

M csTrack = 0

M csTrackRwExcl = 0

M csTrackRwShrd = 0

M mode_cleaned_counter = 0

M control_flag = 0

M int_checked_resource(RFC) = 0

M ext_checked_resource(RFC) = 0

M int_checked_resource(HTTP) = 0

M ext_checked_resource(HTTP) = 0

M report = > <

M action = 0

M tab_name = > <

M attachedVm = no VM

M PfStatDisconnect: disconnect statistics

M Entering TH_CALLHOOKS

M ThCallHooks: call hook >SAP-Trace buffer write< for event BEFORE_DUMP

M TrThHookFunc: called for WP dump

M ThCallHooks: call hook >ThrSaveSPAFields< for event BEFORE_DUMP

M *** ERROR => ThrSaveSPAFields: no valid thr_wpadm [thxxrun1.c 724]

M *** ERROR => ThCallHooks: event handler ThrSaveSPAFields for event BEFORE_DUMP failed [thxxtool3.c 261]

M Entering ThSetStatError

M ThIErrHandle: do not call ThrCoreInfo (no_core_info=0, in_dynp_env=0)

M Entering ThReadDetachMode

M call ThrShutDown (1)...

B dbtbxbuf: Saving TBX statistics:

B dbtbxbuf: 0 object entries written.

M ***LOG Q02=> wp_halt, WPStop (Workproc 1 3867) [dpuxtool.c 269]

dev_icm:

-


trc file: "dev_icm", trc level: 1, release: "700"

-


sysno 01

sid TS2

systemid 370 (Solaris on SPARCV9 CPU)

relno 7000

patchlevel 0

patchno 177

intno 20050900

make: multithreaded, Unicode, 64 bit, optimized

pid 3865

[Thr 1] started security log to file dev_icm_sec

[Thr 1] ICM running on: XXXXXXXXX.saipc.XXX.com

[Thr 1] MtxInit: 30001 0 2

[Thr 1] IcmInit: listening to admin port: 64999

[Thr 1] ***LOG Q0Z=> DpSysAdmExtCreate, bad version (lib=241000 krn=239000) [dpxxtool2_mt 681]

[Thr 1]

*****************************************************************************

*

[Thr 1] * LOCATION ICM runing on host XXXXXXXXX

[Thr 1] * ERROR dp lib version mismatch, please check installation

[Thr 1] *

  • TIME Mon Oct 20 03:59:28 2008

[Thr 1] * RELEASE 700

[Thr 1] * COMPONENT DP

[Thr 1] * VERSION 241000

[Thr 1] * RC -9999

[Thr 1] * MODULE dpxxtool2_mt.c

[Thr 1] * LINE 688

[Thr 1] * DETAIL version of external and kernel dp lib mismatch (ext lib

  • version is 241000 / kernel lib version is 239000)

[Thr 1] * COUNTER 3

[Thr 1] *

[Thr 1] *****************************************************************************

[Thr 1] *** ERROR => DpIPCInit2: DpSysAdmExtCreate [dpxxtool2_mt 369]

[Thr 1] *** ERROR => IcmInit: IcmIPCInit failed (rc=-9999) [icxxman_mt.c 1741]

[Thr 1] *** ICM shutdown completed (pid: 3865) ***

dev_ms:

-


trc file: "dev_ms", trc level: 1, release: "700"

-


[Thr 1] Mon Oct 20 03:59:24 2008

[Thr 1] MsSSetTrcLog: trc logging active, max size = 20971520 bytes

systemid 370 (Solaris on SPARCV9 CPU)

relno 7000

patchlevel 0

patchno 145

intno 20050900

make: multithreaded, Unicode, 64 bit, optimized

pid 3853

[Thr 1] ***LOG Q01=> MsSInit, MSStart (Msg Server 1 3853) [msxxserv_mt. 1834]

[Thr 1] SigISetDefaultAction : default handling for signal 18

[Thr 1] load acl file = /usr/sap/TS2/SYS/global/ms_acl_info

[Thr 1] MsGetOwnIpAddr: my host addresses are :

[Thr 1] 1 : [148.92.31.49] XXXXXXXXX (HOSTNAME)

[Thr 1] 2 : [127.0.0.1] localhost (LOCALHOST)

[Thr 1] 3 : [148.92.31.157] XXXXXXXXX-maint (NILIST)

[Thr 1] 4 : [10.220.6.72] XXXXXXXXX-bkup (NILIST)

[Thr 1] MsHttpInit: full qualified hostname = XXXXXXXXX.saipc.XXX.com

[Thr 1] HTTP logging is switch off

[Thr 1] MsHttpOwnDomain: own domain[1] = saipc.XXX.com

[Thr 1] ms/icf_info_server : deleted

[Thr 1] *** I listen to port sapmsTS2 (3601) ***

[Thr 1] *** I listen to internal port 3901 (3901) ***

[Thr 1] CUSTOMER KEY: >C0395101982<

[Thr 1] Mon Oct 20 04:01:28 2008

[Thr 1] *** ERROR => MsSClientHandle: no server provides service ENQ (4), requested from XXXXXXXXX_TS2_01 [msxxserv_mt. 4687]

[Thr 1] Mon Oct 20 04:05:07 2008

[Thr 1] MsSExit: received SIGINT (2)

[Thr 1] ***LOG Q02=> MsSHalt, MSStop (Msg Server 3853) [msxxserv_mt. 5998]

dev_rd:

-


trc file: "dev_rd", trc level: 1, release: "700"

-


Mon Oct 20 03:59:26 2008

***LOG S00=> GwInitReader, gateway started ( 3864) [gwxxrd.c 1757]

systemid 370 (Solaris on SPARCV9 CPU)

relno 7000

patchlevel 0

patchno 176

intno 20050900

make: single threaded, Unicode, 64 bit, optimized

pid 3864

gateway runs with dp version 241000(ext=110000) (-(#) DPLIB-INT-VERSION-241000-UC)

gateway (version=700.2008.06.23)

gw/local_addr : 0.0.0.0

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

CCMS: Initalizing shared memory of size 60000000 for monitoring segment.

Mon Oct 20 03:59:27 2008

CCMS: Checking Downtime Configuration of Monitoring Segment.

Bind service sapgw01 (socket) to port 3301

GwPrintMyHostAddr: my host addresses are :

1 : [148.92.31.49] XXXXXXXXX (HOSTNAME)

2 : [127.0.0.1] localhost (LOCALHOST)

3 : [148.92.31.157] XXXXXXXXX-maint (NILIST)

4 : [10.220.6.72] XXXXXXXXX-bkup (NILIST)

Full qualified hostname = XXXXXXXXX.saipc.XXX.com

***LOG Q0Z=> DpSysAdmExtCreate, bad version (lib=241000 krn=239000) [dpxxtool2.c 681]

*****************************************************************************

*

  • LOCATION SAP-Gateway on host XXXXXXXXX / sapgw01

  • ERROR dp lib version mismatch, please check installation

*

  • TIME Mon Oct 20 03:59:27 2008

  • RELEASE 700

  • COMPONENT DP

  • VERSION 241000

  • RC -9999

  • MODULE dpxxtool2.c

  • LINE 688

  • DETAIL version of external and kernel dp lib mismatch (ext lib

  • version is 241000 / kernel lib version is 239000)

  • COUNTER 1

*

*****************************************************************************

      • ERROR => DpIPCInit2: DpSysAdmExtCreate [dpxxtool2.c 369]

***LOG S0V=> GwStopGateway, gateway stopped () [gwxxrd.c 14652]

dev_rfc24:

        • Trace file opened at 20081020 031506 EDT SAP-REL 700,0,162 RFC-VER U 3 985555

======> User is locked. Please notify the person responsible

ABAP Programm: SAPLTMSC (Transaction: )

Called function module: TMS_CI_START_SERVICE

User: DDIC (Client: 015)

Destination: TMSADM-TS2.DOMAIN_DV2 (handle: 2, 11671309, {48FC3006-2FF4-60E5-E100-0000945C1F31})

dev_disp

-


trc file: "dev_disp.new", trc level: 1, release: "700"

-


sysno 01

sid TS2

systemid 370 (Solaris on SPARCV9 CPU)

relno 7000

patchlevel 0

patchno 162

intno 20050900

make: single threaded, Unicode, 64 bit, optimized

pid 3854

Mon Oct 20 03:59:25 2008

kernel runs with dp version 239000(ext=110000) (-(#) DPLIB-INT-VERSION-239000-UC)

length of sys_adm_ext is 576 bytes

      • SWITCH TRC-HIDE on ***

***LOG Q00=> DpSapEnvInit, DPStart (01 3854) [dpxxdisp.c 1257]

shared lib "dw_xml.so" version 162 successfully loaded

shared lib "dw_xtc.so" version 162 successfully loaded

shared lib "dw_stl.so" version 162 successfully loaded

shared lib "dw_gui.so" version 162 successfully loaded

shared lib "dw_mdm.so" version 162 successfully loaded

rdisp/softcancel_sequence : -> 0,5,-1

use internal message server connection to port 3901

MtxInit: 30000 0 0

DpSysAdmExtInit: ABAP is active

DpSysAdmExtInit: VMC (JAVA VM in WP) is not active

DpIPCInit2: start server >XXXXXXXXX_TS2_01 <

DpShMCreate: sizeof(wp_adm) 42240 (1760)

DpShMCreate: sizeof(tm_adm) 150350080 (30064)

DpShMCreate: sizeof(wp_ca_adm) 31232 (104)

DpShMCreate: sizeof(appc_ca_adm) 208000 (104)

DpCommTableSize: max/headSize/ftSize/tableSize=500/8/548056/548064

DpShMCreate: sizeof(comm_adm) 548064 (1088)

DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0

DpShMCreate: sizeof(slock_adm) 0 (104)

DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0

DpShMCreate: sizeof(file_adm) 0 (72)

DpShMCreate: sizeof(vmc_adm) 0 (2080)

DpShMCreate: sizeof(wall_adm) (1000056/862328/88/192)

DpShMCreate: sizeof(gw_adm) 48

DpShMCreate: SHM_DP_ADM_KEY (addr: 0xffffffff66000000, size: 153051096)

DpShMCreate: allocated sys_adm at 0xffffffff66000000

DpShMCreate: allocated wp_adm at 0xffffffff66002218

DpShMCreate: allocated tm_adm_list at 0xffffffff6600c718

DpShMCreate: allocated tm_adm at 0xffffffff6600c778

DpShMCreate: allocated wp_ca_adm at 0xffffffff6ef6f078

DpShMCreate: allocated appc_ca_adm at 0xffffffff6ef76a78

DpShMCreate: allocated comm_adm at 0xffffffff6efa96f8

DpShMCreate: system runs without slock table

DpShMCreate: system runs without file table

DpShMCreate: allocated vmc_adm_list at 0xffffffff6f02f3d8

DpShMCreate: allocated gw_adm at 0xffffffff6f02f458

DpShMCreate: system runs without vmc_adm

DpShMCreate: allocated ca_info at 0xffffffff6f02f488

DpShMCreate: allocated wall_adm at 0xffffffff6f02f490

Mon Oct 20 03:59:26 2008

MBUF state OFF

DpCommInitTable: init table for 500 entries

rdisp/queue_size_check_value : -> off

ThTaskStatus: rdisp/reset_online_during_debug 0

EmInit: MmSetImplementation( 2 ).

MM global diagnostic options set: 0

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 1024 kByte.

Using implementation std

<ES> Info: use normal pages (no huge table support available)

EsStdUnamFileMapInit: ES base = 0x0xfffffffe60000000

EsStdInit: Extended Memory 4048 MB allocated

<ES> 4047 blocks reserved for free list.

ES initialized.

Mon Oct 20 03:59:31 2008

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1659]

***LOG Q0K=> DpMsAttach, mscon ( XXXXXXXXX) [dpxxdisp.c 12153]

DpStartStopMsg: send start message (myname is >XXXXXXXXX_TS2_01 <)

DpStartStopMsg: start msg sent

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

      • ERROR => DpWPCheck: W0 (pid 3866) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3866) exited with exit code 255

my types changed after wp death/restart 0xbf --> 0xbd

      • ERROR => DpWPCheck: W1 (pid 3867) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3867) exited with exit code 255

      • ERROR => DpWPCheck: W2 (pid 3868) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3868) exited with exit code 255

      • ERROR => DpWPCheck: W4 (pid 3870) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3870) exited with exit code 255

      • ERROR => DpWPCheck: W5 (pid 3871) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3871) exited with exit code 255

      • ERROR => DpWPCheck: W6 (pid 3872) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3872) exited with exit code 255

      • ERROR => DpWPCheck: W7 (pid 3873) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3873) exited with exit code 255

      • ERROR => DpWPCheck: W8 (pid 3874) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3874) exited with exit code 255

      • ERROR => DpWPCheck: W9 (pid 3875) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3875) exited with exit code 255

      • ERROR => DpWPCheck: W10 (pid 3885) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3885) exited with exit code 255

      • ERROR => DpWPCheck: W11 (pid 3888) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3888) exited with exit code 255

      • ERROR => DpWPCheck: W12 (pid 3890) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3890) exited with exit code 255

      • ERROR => DpWPCheck: W13 (pid 3902) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3902) exited with exit code 255

DpMsgAdmin: Set release to 7000, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1050]

DpMsgAdmin: Set patchno for this platform to 162

Release check o.K.

Mon Oct 20 03:59:51 2008

my types changed after wp death/restart 0xbd --> 0x81

      • ERROR => DpWPCheck: W14 (pid 3903) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3903) exited with exit code 255

      • ERROR => DpWPCheck: W15 (pid 3904) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3904) exited with exit code 255

      • ERROR => DpWPCheck: W16 (pid 3905) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3905) exited with exit code 255

      • ERROR => DpWPCheck: W17 (pid 3908) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3908) exited with exit code 255

      • ERROR => DpWPCheck: W18 (pid 3911) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3911) exited with exit code 255

      • ERROR => DpWPCheck: W19 (pid 3914) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3914) exited with exit code 255

      • ERROR => DpWPCheck: W20 (pid 3915) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3915) exited with exit code 255

      • ERROR => DpWPCheck: W21 (pid 3916) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3916) exited with exit code 255

      • ERROR => DpWPCheck: W22 (pid 3919) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3919) exited with exit code 255

      • ERROR => DpWPCheck: W23 (pid 3924) died (severity=0, status=65280) [dpxxdisp.c 15218]

child (pid=3924) exited with exit code 255

Mon Oct 20 04:00:11 2008

      • ERROR => gateway (pid 3864) died [dpxxdisp.c 16063]

DpGwCheck: appc_adm.stat = 2

      • DP_FATAL_ERROR => Gateway could not be started - I better exit now

      • DISPATCHER EMERGENCY SHUTDOWN ***

increase tracelevel of WPs

kill(3869,0) successful -> process alive

killing W3-3869 (SIGUSR2)

NiWait: sleep (10000ms) ...

NiISelect: timeout 10000ms

NiISelect: maximum fd=12

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Mon Oct 20 04:00:21 2008

NiISelect: TIMEOUT occured (10000ms)

dump system status

Workprocess Table (long) Mon Oct 20 08:00:21 2008

========================

No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table

-


0 DIA 3866 Ended no 3 0 0

1 DIA 3867 Ended no 3 0 0

2 DIA 3868 Ended no 3 0 0

3 DIA 3869 Run yes 0 0 0

4 DIA 3870 Ended no 3 0 0

5 DIA 3871 Ended no 3 0 0

6 DIA 3872 Ended no 3 0 0

7 DIA 3873 Ended no 3 0 0

8 DIA 3874 Ended no 3 0 0

9 DIA 3875 Ended no 3 0 0

10 UPD 3885 Ended no 3 0 0

11 UPD 3888 Ended no 3 0 0

12 UPD 3890 Ended no 3 0 0

13 UPD 3902 Ended no 3 0 0

14 ENQ 3903 Ended no 2 0 0

15 BTC 3904 Ended no 2 0 0

16 BTC 3905 Ended no 2 0 0

17 BTC 3908 Ended no 2 0 0

18 BTC 3911 Ended no 2 0 0

19 BTC 3914 Ended no 2 0 0

20 BTC 3915 Ended no 2 0 0

21 SPO 3916 Ended no 2 0 0

22 UP2 3919 Ended no 2 0 0

23 UP2 3924 Ended no 2 0 0

Dispatcher Queue Statistics Mon Oct 20 08:00:21 2008

===========================

--------


+
+

+

+
--


+

Typ

now

high

max

writes

reads

--------


+
+

+

+
--


+

NOWP

0

0

4000

0

0

--------


+
+

+

+
--


+

DIA

4

4

4000

4

0

--------


+
+

+

+
--


+

UPD

0

0

4000

0

0

--------


+
+

+

+
--


+

ENQ

0

0

4000

0

0

--------


+
+

+

+
--


+

BTC

0

0

4000

0

0

--------


+
+

+

+
--


+

SPO

0

0

4000

0

0

--------


+
+

+

+
--


+

UP2

0

0

4000

0

0

--------


+
+

+

+
--


+

max_rq_id 7

wake_evt_udp_now 0

wake events total 3, udp 2 ( 66%), shm 1 ( 33%)

since last update total 3, udp 2 ( 66%), shm 1 ( 33%)

Dump of tm_adm structure: Mon Oct 20 08:00:21 2008

=========================

Term uid man user term lastop mod wp ta a/i (modes)

Workprocess Comm. Area Blocks Mon Oct 20 08:00:21 2008

=============================

Slots: 300, Used: 1, Max: 0

--------


+
+
--


+

id

owner

pid

eyecatcher

--------


+
+
--


+

0

DISPATCHER

-1

WPCAAD000

NiWait: sleep (5000ms) ...

NiISelect: timeout 5000ms

NiISelect: maximum fd=12

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Mon Oct 20 04:00:26 2008

NiISelect: TIMEOUT occured (5000ms)

DpHalt: shutdown server >XXXXXXXXX_TS2_01 < (normal)

DpJ2eeDisableRestart

DpModState: buffer in state MBUF_PREPARED

please help me to solve this.

Thanks

Giridhar

markus_doehr2
Active Contributor
0 Kudos

> I *** ERROR => ShmProtect(62,3) shmat(268435641,0x0xfffffffe5a000000,(SHM_RND | 0)) (22: Invalid argument) [shmux.c 2782]

> I *** ERROR => ShmCreate: ShmProtect( 62, 3) failed [shmux.c 1359]

> I *** ERROR => ShmCreate( ATTACH 62, 86228824) failed 1 [mpixx.c 855]

> M *** ERROR => DpInitMpi: MpiInit failed (1) [dpxxtool2.c 5064]

> M in_ThErrHandle: 1

> M *** ERROR => ThInit: DpInitMpi (step 1, th_errno 17, action 3, level 1) [thxxhead.c 10506]

The system is not able to create the shared memory segment.

Try the following:

- stop the system (stosap)

- su - root

- then execute "/usr/sap/<SID>/exe/cleanipc 00 remove"

Then try to restart the system.

Markus

Former Member
0 Kudos

Hi,

Check out SNote 17108 which suggests to use cleanipc.

Rgds

Radhakrishna D S

Former Member
0 Kudos

check the below directory

ERROR: can't change to central Executable-Dir /usr/sap/TS2/SYS/exe/ctrun (No such file or directory)

cheers,

-Sunil

Former Member
0 Kudos

Can you please eloborate the steps you used in kernel upgrade.

Regards,

Sekhar.