Shadow system doesnt start during upgrade of BI3.0 to BI 7 EhP

[Former Member]

Hello,

We are upgradeing BI 3.0 (only ABAP) to BI 7, (only ABAP). The RAM of my system is 18 Gigs.

During the preprocessing phase, the shadow instance doesnt startup and goves the following error.

Excerpts from STARTSFI.LOG

*2 ETQ399 Starting shadow instance*

*4 ETQ359 RFC Login to: System="GBP", Nr="01", GwHost="KCRMAPP", GwService="sapgw01"*

*2 ETQ231 RFC Login failed*

*4 ETQ359 RFC Login to: System="GBP", Nr="01", GwHost="KCRMAPP", GwService="sapgw01"*

*2 ETQ231 RFC Login failed*

*2 ETQ399 Stopping shadow instance*

*4 ETQ399 2009/11/23 11:52:43: put_execute: (stopsap) forkpid:11031*

*4 ETQ399 2009/11/23 11:52:45: put_execute: (sapcontrol) forkpid:11131*

*4 ETQ359 RFC Login to: System="GBP", Nr="01", GwHost="KCRMAPP", GwService="sapgw*

Excerpts from DEVTRACE.LOG

-

---

trc file: "dev_ms", trc level: 1, release: "701"

-

---

[Thr 01] Mon Nov 23 11:52:58 2009

[Thr 01] MsSSetTrcLog: trc logging active, max size = 20971520 bytes

systemid 370 (Solaris on SPARCV9 CPU)

relno 7010

patchlevel 0

patchno 11

intno 20020600

make: multithreaded, ASCII, 64 bit, optimized

pid 11242

[Thr 01] ***LOG Q01=> MsSInit, MSStart (Msg Server 1 11242) [msxxserv_mt. 1853]

[Thr 01] SigISetDefaultAction : default handling for signal 18

[Thr 01] load acl file = /usr/sap/put/abap/GBP/SYS/global/ms_acl_info

[Thr 01] MsGetOwnIpAddr: my host addresses are :

[Thr 01] 1 : [172.31.11.71] KCRMAPP (HOSTNAME)

[Thr 01] 2 : [127.0.0.1] localhost (LOCALHOST)

[Thr 01] 3 : [0.0.0.0] 0.0.0.0 (NILIST)

[Thr 01] MsHttpInit: full qualified hostname = KCRMAPP

[Thr 01] HTTP logging is switch off

[Thr 01] ms/icf_info_server : deleted

[Thr 01] *** I listen to port 3601 (3601) ***

[Thr 01] CUSTOMER KEY: >P1609031036<

[Thr 01] build version=701.2008.03.06

[Thr 01] Mon Nov 23 11:53:37 2009

[Thr 01] *** ERROR => MsSClientHandle: no server provides service ENQ (4), requested from KCRMAPP_GBP_01 [msxxserv_mt. 4711]

-

---

trc file: "dev_rd", trc level: 1, release: "701"

-

---

Mon Nov 23 11:52:59 2009

***LOG S00=> GwInitReader, gateway started ( 11244) [gwxxrd.c 1757]

systemid 370 (Solaris on SPARCV9 CPU)

relno 7010

patchlevel 0

patchno 32

intno 20020600

make: single threaded, ASCII, 64 bit, optimized

pid 11244

gateway runs with dp version 241(ext=110) (@(#) DPLIB-INT-VERSION-241)

gateway (version=701.2009.01.21)

gw/local_addr : 0.0.0.0

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

CCMS: Initalizing shared memory of size 40000000 for monitoring segment.

CCMS: Checking Downtime Configuration of Monitoring Segment.

Mon Nov 23 11:53:00 2009

Bind service sapgw01 (socket) to port 3301

GwPrintMyHostAddr: my host addresses are :

1 : [172.31.11.71] KCRMAPP (HOSTNAME)

2 : [127.0.0.1] localhost (LOCALHOST)

3 : [0.0.0.0] 0.0.0.0 (NILIST)

Full qualified hostname = KCRMAPP

DpSysAdmExtCreate: ABAP is active

DpSysAdmExtCreate: VMC (JAVA VM in WP) is not active

DpShMCreate: sizeof(wp_adm) 20944 (1232)

DpShMCreate: sizeof(tm_adm) 5385216 (26792)

DpShMCreate: sizeof(wp_ca_adm) 26496 (88)

DpShMCreate: sizeof(appc_ca_adm) 8800 (88)

DpCommTableSize: max/headSize/ftSize/tableSize=500/8/548040/548048

DpShMCreate: sizeof(comm_adm) 548048 (1088)

DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0

DpShMCreate: sizeof(slock_adm) 0 (104)

DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0

DpShMCreate: sizeof(file_adm) 0 (72)

DpShMCreate: sizeof(vmc_adm) 0 (1840)

DpShMCreate: sizeof(wall_adm) (22440/36712/80/104)

DpShMCreate: sizeof(gw_adm) 48

DpShMCreate: SHM_DP_ADM_KEY (addr: ffffffff75800000, size: 6056712)

DpShMCreate: allocated sys_adm at ffffffff75800000

DpShMCreate: allocated wp_adm at ffffffff75801e10

DpShMCreate: allocated tm_adm_list at ffffffff75806fe0

DpShMCreate: allocated tm_adm at ffffffff75807040

DpShMCreate: allocated appc_ca_adm at ffffffff75d303c0

DpShMCreate: allocated comm_adm at ffffffff75d32620

DpShMCreate: system runs without slock table

DpShMCreate: system runs without file table

DpShMCreate: allocated vmc_adm_list at ffffffff75db82f0

DpShMCreate: allocated gw_adm at ffffffff75db8370

DpShMCreate: system runs without vmc_adm

DpShMCreate: allocated ca_info at ffffffff75db83a0

MtxInit: -2 0 0

Mon Nov 23 11:53:36 2009

caught SIGINT (2)

***LOG S30=> GwStopGateway, gateway stopped () [gwxxrd.c 14600]

Excerpts from dev_w0 of shadow instance

B db_con_shm_ini: WP_ID = 0, WP_CNT = 17, CON_ID = -1

B dbstat: TABSTAT buffer attached (addr: ffffffff69407f90)

B ***LOG BBB=> ADM message TBX buffer: function getshmdesc returns RC = FALSE [dbtbxbuf#2 @ 16103] [dbtbxbuf1610 3]

B ***LOG BZL=> internal error in table buffer: table buf init fail [dbtbxbuf#2 @ 1701] [dbtbxbuf1701 ]

B dbtbxbuf: return code (sap_rc): 2, Buffer TBX_GENERIC will not be available

B db_tblinit failed

M *** ERROR => ThCallHooks: event handler db_init for event CREATE_SHM failed [thxxtool3.c 261]

M *** ERROR => ThIPCInit: hook failed [thxxhead.c 2105]

M ***LOG R19=> ThInit, ThIPCInit ( TSKH-IPC-000001) [thxxhead.c 1532]

M in_ThErrHandle: 1

M *** ERROR => ThInit: ThIPCInit (step 1, th_errno 17, action 3, level 1) [thxxhead.c 10563]

M

M Info for wp 0

M

M pid = 11245

M severity = 0

M status = 0

M stat = WP_RUN

M waiting_for = NO_WAITING

M reqtype = DP_RQ_DIAWP

M act_reqtype = NO_REQTYPE

M rq_info = 0

M tid = -1

M mode = 255

M len = -1

M rq_id = 65535

M rq_source =

M last_tid = 0

M last_mode = 0

M semaphore = 0

M act_cs_count = 0

M csTrack = 0

M csTrackRwExcl = 0

M csTrackRwShrd = 0

M mode_cleaned_counter = 0

M control_flag = 0

M int_checked_resource(RFC) = 0

M ext_checked_resource(RFC) = 0

M int_checked_resource(HTTP) = 0

M ext_checked_resource(HTTP) = 0

M report = > <

M action = 0

M tab_name = > <

M attachedVm = no VM

M PfStatDisconnect: disconnect statistics

M Entering TH_CALLHOOKS

M ThCallHooks: call hook >ThrSaveSPAFields< for event BEFORE_DUMP

M *** ERROR => ThrSaveSPAFields: no valid thr_wpadm [thxxrun1.c 723]

M *** ERROR => ThCallHooks: event handler ThrSaveSPAFields for event BEFORE_DUMP failed [thxxtool3.c 261]

M ThCallHooks: call hook >BtcCallLgCl< for event BEFORE_DUMP

M Entering ThSetStatError

M ThIErrHandle: do not call ThrCoreInfo (no_core_info=0, in_dynp_env=0)

M Entering ThReadDetachMode

M call ThrShutDown (1)...

M ***LOG Q02=> wp_halt, WPStop (Workproc 0 11245) [dpuxtool.c 269]

As it clearly is a problem where OS is not able to create the Shared memory segments, I am attaching the OS parameters as well.

1. more /etc/project

system:0::::

user.root:1::::process.max-sem-nsems=(priv,2048,deny);project.max-sem-ids=(priv,

1024,deny);project.max-shm-ids=(priv,256,deny);project.max-shm-memory=(priv,1352

9146982,deny)

noproject:2::::

default:3::::process.max-sem-nsems=(priv,2048,deny);project.max-sem-ids=(priv,10

24,deny);project.max-shm-ids=(priv,256,deny);project.max-shm-memory=(priv,135291

46982,deny)

group.staff:10::::

1. prtconf

System Configuration: Sun Microsystems sun4v

Memory size: 18432 Megabytes

System Peripherals (Software Nodes):

Any help in this regart is much appreciated.

Thanks

Nischal

[markus_doehr2]

> default:3::::process.max-sem-nsems=(priv,2048,deny);project.max-sem-ids=(priv,10

> 24,deny);project.max-shm-ids=(priv,256,deny);project.max-shm-memory=(priv,135291

> 46982,deny)

- check in /etc/user_attr if <sid>adm is assigned to "default"

- increase the parameters according to "Note 724713 - parameter settings for Solaris 10"

Markus

[Former Member]

Hello Markus,

We had set all the parameters inaccordance with the note that you have mentioned. Do you see any shortcoming?

I do see, no project being assigned to my <sid>adm user.

1. projects -d gbpadm

default

do you suggest any action?

Thnaks

Nischal

[markus_doehr2]

Please check the note again, your parameters in /etc/project are lower than mentioned in the note. And again please check if the user is assigned to the project in /etc/user_attr.

Markus

[Former Member]

I have configured the project as per SAP note.

GBP:100:SAP System GBP:gbpadm,oragbp::process.max-sem-insems=(priv,2048,deny);project.max-sem-ids=(priv,1024,deny);project.max-shm-ids=(priv,256,deny);project.max-shm-memory=(priv,18446744073709551615,deny)

user has been assigned to project GBP. This has been checked with command projects -d gbpadm.

It shows GBP.

But still shadow instance is not coming up. IT gives the same error message.

Edited by: K. V. Ranganathan on Nov 24, 2009 3:19 PM

[markus_doehr2]

> GBP:100:SAP System GBP:gbpadm,oragbp::process.max-sem-insems=(priv,2048,deny);project.max-sem-ids=(priv,1024,deny);project.max-shm-ids=(priv,256,deny);project.max-shm-memory=(priv,18446744073709551615,deny)

>

> user has been assigned to project GBP. This has been checked with command projects -d gbpadm.

> It shows GBP.

>

> But still shadow instance is not coming up. IT gives the same error message.

increase the values for max-sem-ids and max-shm-ids, they are too low.

Markus

[Former Member]

latest value is as follows

projmod -K "project.max-sem-ids=(priv,4096,deny)" -K "process.max-sem-insems=(priv,2048,deny)" -K "project.max-shm-ids=(priv,4096,deny)" -K

"project.max-shm-memory=(priv,18446744073709551615,deny)" GBP

Still the same error.

Any further suggestion

[markus_doehr2]

You may need to stop all processes of the shadow instance that are running with the old limitations. I'd try the following:

ps -ef | grep sapstart

then kill the process of the shadow instance (check for the system number of the shadow instance to identify).

I'd also try to stop the instance first so all shared memory segments are cleared - and then try to manually start it:

cd <upgrade-directory/bin
./SAPup stopshd
./SAPup startshd

You may assign the user directly to the project but this won't be taken into account if the assignment is not set in /etc/user_attr.,

Markus

[Former Member]

entries in /etc/user_attr

gbpadm::::project=GBP

oragbp::::project=GBP

Followed the steps mentioned by you but landed up in the same error

[markus_doehr2]

I must admit have no clue what's causing that error. I have done tons of upgrades on Solaris and tweaking those settings helped in all cases.

I'd open an OSS call, without system access it's difficult to help you further.

Markus