cancel
Showing results for 
Search instead for 
Did you mean: 

Failed To Start Instance during Installation

Former Member
0 Kudos

Dear All,

I m doing Solman 7.0 With Ehp1 with database 10g on Linux 64 bit ( Red Hat).facing Error During Start Instance paste log below.Log of W0

  • ACTIVE TRACE LEVEL 1

  • ACTIVE TRACE COMPONENTS all, MJ

*

M Sun Oct 30 20:38:42 2011

M kernel runs with dp version 245000(ext=110000) (@(#) DPLIB-INT-VERSION-245000-UC)

M length of sys_adm_ext is 576 bytes

M ThInit: rdisp/cleanup_after_crash = 1

M ***LOG Q01=> ThInit, WPStart (Workproc 0 1 7257) [thxxhead.c 1346]

M ThInit: running on host sapsol

M calling db_connect ...

B Loading DB library '/usr/sap/SOL/DVEBMGS00/exe/dboraslib.so' ...

B Library '/usr/sap/SOL/DVEBMGS00/exe/dboraslib.so' loaded

B Version of '/usr/sap/SOL/DVEBMGS00/exe/dboraslib.so' is "700.08", patchlevel (0.134)

C Oracle Client Version: '10.2.0.2.0', (dbsl 701 090311, UNICODE[2])

C Application info callback registered.

C Client NLS setting (by OCINlsGetInfo): con=0, 'AMERICAN_AMERICA.UTF16'

C Logon as OPS$-user to get SAPSR3's password

C Connecting as /@SOL on connection 0 (nls 0) ... (dbsl 701 090311, UNICODE[2])

C Attaching to DB Server SOL (con_hdl=0,svchp=0x150ee598,srvhp=0x150f1028)

C Starting user session: OCISessionBegin(con_hdl=0, usr='/',svchp=0x150ee598, srvhp=0x150f1028, usrhp=0x150de728)

C CbApplInfoGet() failed (ignored 1).

C Now '/@SOL' is connected: con_hdl=0, nls_hdl=0, session_id=148.

C Got SAPSR3's password from OPS$-user

C Disconnecting from connection 0 ...

C Closing user session (con_hdl=0,svchp=0x150ee598,usrhp=0x150de728)

C Disconnected (con=0) from ORACLE.

C Connecting as SAPSR3/<pwd>@SOL on connection 0 (nls 0) ... (dbsl 701 090311, UNICODE[2])

C Starting user session: OCISessionBegin(con_hdl=0, usr=SAPSR3/<pwd>, svchp=0x150ee598, srvhp=0x150f1028, usrhp=0x150de728)

C Now 'SAPSR3/<pwd>@SOL' is connected: con_hdl=0, nls_hdl=0, session_id=148.

C con=0, V$NLS_PARAMETERS: NLS_LANG=AMERICAN_AMERICA.UTF8, NLS_NCHAR=UTF8, UNI_NON=FALSE

C Nls CharacterSet NationalCharSet EnvHp ErrHp ErrBt

C 0 UTF16 AL16UTF16 0x150d6460 0x150ddf10 0x150ee668

C DB instance SOL is running on sapsol with ORACLE version 10.2.0.4.0 since OCT 30, 2011, 20:38:09

B

B Sun Oct 30 20:38:43 2011

B Connection 0 opened (DBSL handle 0)

M db_connect o.k.

M ICT: exclude compression: .zip,.cs,.rar,.arj,.z,.gz,.tar,.lzh,.cab,.hqx,.ace,.jar,.ear,.war,.css,.pdf,.js,.gzip,.uue,.bz2,.iso,.sda,.sar,.gif,.png,.swc,*.swf

I MtxInit: 0 0 0

M SHM_PRES_BUF (addr: 0x2b42dd101000, size: 4400000)

M SHM_ROLL_AREA (addr: 0x2b43f1a7f000, size: 606208000)

M SHM_PAGING_AREA (addr: 0x2b4415c9f000, size: 268435456)

M SHM_ROLL_ADM (addr: 0x2b42dd535000, size: 11116480)

M SHM_PAGING_ADM (addr: 0x2b4425c9f000, size: 3277856)

M ThCreateNoBuffer allocated 560152 bytes for 1000 entries at 0x2b4425fc2000

M ThCreateNoBuffer index size: 3000 elems

M ThCreateVBAdm allocated 12176 bytes (50 server) at 0x2b442ca90000

X EmInit: MmSetImplementation( 2 ).

X MM global diagnostic options set: 0

X <ES> client 0 initializing ....

X Using implementation map

X Linux: Kernel supports shared memory disclaiming

X Linux: using madvise(<pointer>, <size>, 9).

X Linux: disclaiming for shared memory enabled

X ES initialized.

X mm.dump: set maximum dump mem to 96 MB

M Deactivate statistics hyper index locking

I *** INFO Shm 45 in Pool 40 4771 KB estimated 3625 KB real ( -1146 KB -25 %)

B dbntab: NTAB buffers created

B dbntab: Buffer FTAB(hash header) (addr: 0x2b442604c088, size: 392)

B dbntab: Buffer FTAB(anchor array) (addr: 0x2b442604c210, size: 320072)

B dbntab: Buffer FTAB(item array) (addr: 0x2b442609a458, size: 1280000)

B dbntab: Buffer FTAB(data area) (addr: 0x2b44261d2c58, size: 30720000)

B dbntab: Buffer IREC(hash header) (addr: 0x2b4427f20088, size: 392)

B dbntab: Buffer IREC(anchor array) (addr: 0x2b4427f20210, size: 320072)

B dbntab: Buffer IREC(item array) (addr: 0x2b4427f6e458, size: 320000)

B dbntab: Buffer IREC(data area) (addr: 0x2b4427fbc658, size: 6144000)

B dbntab: Buffer STAB(hash header) (addr: 0x2b442859a088, size: 392)

B dbntab: Buffer STAB(anchor array) (addr: 0x2b442859a210, size: 320072)

B dbntab: Buffer STAB(item array) (addr: 0x2b44285e8458, size: 320000)

B dbntab: Buffer STAB(data area) (addr: 0x2b4428636658, size: 3072000)

B dbntab: Buffer TTAB(hash header) (addr: 0x2b4428926088, size: 2160)

B dbntab: Buffer TTAB(anchor array) (addr: 0x2b44289268f8, size: 320072)

B dbntab: Buffer TTAB(item array) (addr: 0x2b4428974b40, size: 800000)

B dbntab: Buffer TTAB(data area) (addr: 0x2b4428a38040, size: 5840000)

B

B Sun Oct 30 20:38:50 2011

B dbstat: table statistics switched on for 35493 tables

B dbstat: TABSTAT buffer created (addr: 0x2b42e6ec1000, size: 17380280)

B db_con_shm_ini: WP_ID = 0, WP_CNT = 17, CON_ID = -1

B dbtbxbuf: Buffer TABL (addr: 0x2b442ca93100, size: 30000000, end: 0x2b442e72f480)

B dbtbxbuf: Profile: max_objects = 5000, displace = 1, reorg = 1

B dbtbxbuf: request_unit = 2000, sync_reload = 5, inval_reload = 5

B dbtbxbuf: protect_shm = 0, force_checks = 0

B dbtbxbuf: tsize_retry = 14203392

B ***LOG BB0=> buffer TABL started with length 30000000 bytes [dbtbxbuf#6 @ 16383] [dbtbxbuf1638 3]

B dbtbxbuf: Buffer TABLP (addr: 0x2b442e730100, size: 10240000, end: 0x2b442f0f4100)

B dbtbxbuf: Profile: max_objects = 500, displace = 1, reorg = 1

B dbtbxbuf: request_unit = 2000, sync_reload = 5, inval_reload = 5

B dbtbxbuf: protect_shm = 0, force_checks = 0

B dbtbxbuf: tsize_retry = 5030144

B ***LOG BB0=> buffer TABLP started with length 10240000 bytes [dbtbxbuf#6 @ 16383] [dbtbxbuf1638 3]

B dbtbxbuf: Reading TBX statistics:

B dbtbxbuf: Opening /usr/sap/SOL/DVEBMGS00/data/tbxstat failed (No such file or directory).

B dbtbxbuf: Opening /usr/sap/SOL/DVEBMGS00/data/tbxnew failed (No such file or directory).

B dbtbxbuf: Renaming /usr/sap/SOL/DVEBMGS00/data/tbxnew to /usr/sap/SOL/DVEBMGS00/data/tbxstat failed (No such file or directory).

B dbtbxbuf: 0 object entries precreated

B

B Sun Oct 30 20:38:51 2011

B dbexpbuf[EXP_SHB]: Aquired semaphore 35 in db_exp_init(EXP_INIT)

B dbexpbuf[EXP_SHB]: shared memory layout of buffer EIBUF:

B EYE-CATCHER : 1 * 4 = 4

B ***LOG BB0=> buffer EIBUF started with length 4096k bytes [dbexpbuf#3 @ 2409] [dbexpbuf2409 ]

B dbexpbuf[EXP_SHB]: semaphore 35 released in db_exp_init

B dbexpbuf[EXP_SHM]: Aquired semaphore 56 in db_exp_init(EXP_INIT)

B dbexpbuf[EXP_SHM]: shared memory layout of buffer ESM :

B EYE-CATCHER : 1 * 4 = 4

B ***LOG BB0=> buffer OTR started with length 4096k bytes [dbexpbuf#3 @ 2409] [dbexpbuf2409 ]

B dbexpbuf[EXP_OTR]: semaphore 55 released in db_exp_init

B ***LOG BB0=> buffer CALE started with length 500000 bytes [dbcalbuf#4 @ 2304] [dbcalbuf2304 ]

B dbtran INFO (init_connection '<DEFAULT>' [ORACLE:700.08]):

B max_blocking_factor = 5, max_in_blocking_factor = 5,

B min_blocking_factor = 5, min_in_blocking_factor = 5,

B prefer_union_all = 0, prefer_join = 0,

B prefer_fix_blocking = 0, prefer_in_itab_opt = 1,

B convert AVG = 0, alias table FUPD = 0,

B escape_as_literal = 1, opt GE LE to BETWEEN = 0,

B select * =0x0f, character encoding = STD / <none>:-,

B use_hints = abap->1, dbif->0x1, upto->2147483647, rule_in->0,

B rule_fae->0, concat_fae->0, concat_fae_or->0

M

M Sun Oct 30 20:38:56 2011

M SecAudit(RsauInit): Start init of Security Audit Log for first wp.

M SecAudit(RsauInit): Shared memory for Security Audit Log already exists.

M SecAudit(RsauInit): Re-initialize with new profile parameters

M SecAudit(RsauShmInit): SCSA size................ = 4096

M SecAudit(RsauShmInit): addr of SCSA............. = 0x2b42e196c000

M SecAudit(RsauShmInit): addr of RSAUSHM.......... = 0x2b42e196c768

M SecAudit(RsauShmInit): addr of RSAUSLOTINFO..... = 0x2b42e196c7a0

M SecAudit(RsauShmInit): addr of RSAUSLOTS........ = 0x2b42e196c7ac

M SecAudit(RsauShmInit): SHM version.............. = 5

M SecAudit(RsauShmInit): SHM Slot version......... = 2

M SecAudit(RsauShmInit): RSAU active.............. = 0

M SecAudit(RsauShmInit): number of slots possible. = 10

M SecAudit(RsauShmInit): number of slots requested = 2

M SecAudit(RsauShmInit): number of slots used..... = 2

M SecAudit(RsauShmInit): user selection........... = 0

M SecAudit(RsauShmInit): max size of one file..... = 0 KB

M SecAudit(RsauShmInit): max size of all files.... = 102400 KB

M SecAudit(RsauGetCurrentProfile): Init of shared memory completed

M SecAudit(RsauGetCurrentProfile): Security Audit Log not active

M SsfSapSecin: automatic application server initialization for SAPSECULIB

N SsfSapSecin: Looking for PSE in database

N SsfPseLoad: started...(path=/usr/sap/SOL/DVEBMGS00/sec, AS=sapsol, instanceid=00)

N

N Sun Oct 30 20:38:57 2011

N SsfPseLoad: ended (0 of 0 sucessfully loaded, 0 checked...

N

N Sun Oct 30 20:38:59 2011

N MskiCreateLogonTicketCache: Logon Ticket cache created in shared memory.

N MskiCreateLogonTicketCache: Logon Ticket cache pointer registered in shared memory.

M CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

M CCMS: start to initalize 3.X shared alert area (first segment).

S

S Sun Oct 30 20:39:03 2011

S *** init spool environment

S TSPEVJOB updates outside critical section: event_update_nocsec = 1

S initialize debug system

T Stack direction is downwards.

T debug control: prepare exclude for printer trace

T new memory block 0x1526da90

S

S Sun Oct 30 20:39:06 2011

S spool kernel/ddic check: Ok

S using table TSP02FX for frontend printing

S 1 spool work process(es) found

S frontend print via spool service enabled

S printer list size is 150

S printer type list size is 50

S queue size (profile) = 300

S hostspool list size = 3000

S option list size is 30

I *** INFO Shm 49 in Pool 40 2898 KB estimated 1632 KB real ( -1266 KB -44 %)

S found processing queue enabled

S

S Sun Oct 30 20:39:07 2011

S found spool memory service RSPO-RCLOCKS at 0x2b44292bf070

S doing lock recovery

S setting server cache root

S found spool memory service RSPO-SERVERCACHE at 0x2b44292bf6a0

S using messages for server info

S size of spec char cache entry: 297032 bytes (timeout 100 sec)

S size of open spool request entry: 2512 bytes

S immediate print option for implicitely closed spool requests is disabled

A

A Sun Oct 30 20:39:08 2011

A **GENER Trace switched on ***

A

A -PXA--


A PXA INITIALIZATION

A PXA: Locked PXA-Semaphore.

A PXA: max_map_count = 1000000: ok

A System page size: 4kb, total admin_size: 20884kb, dir_size: 20764kb.

A Attached to PXA (address 0x2b442fd18000, size 300000K)

A abap/pxa = shared protect gen_remote

A PXA INITIALIZATION FINISHED

A -PXA--


A

M -


C-STACK -


(CTrcStack2+0x82)[0x6cdb92]

(SigIGenAction+0x2ad)[0x1a08edd]

/lib64/libpthread.so.0[0x34f7e0e4c0]

/lib64/libc.so.6(gsignal+0x35)[0x34f7230215]

/lib64/libc.so.6(abort+0x110)[0x34f7231cc0]

(ab_init+0x6c8)[0xb8eed8]

(ThrInitRunTime+0x8d)[0x6bbf8d]

(ThStartUp2+0x150)[0x6682f0]

(ThInit+0x1129)[0x55b8b9]

(ThStart+0x11b)[0x55d6bb]

(DpMain+0x228)[0x4bfc08]

/lib64/libc.so.6(__libc_start_main+0xf4)[0x34f721d974]

M PfStatDisconnect: disconnect statistics

M Entering TH_CALLHOOKS

M ThCallHooks: call hook >SAP-Trace buffer write< for event BEFORE_DUMP

M TrThHookFunc: called for WP dump

M ThCallHooks: call hook >ThrSaveSPAFields< for event BEFORE_DUMP

M *** ERROR => ThrSaveSPAFields: no valid thr_wpadm [thxxrun1.c 730]

M *** ERROR => ThCallHooks: event handler ThrSaveSPAFields for event BEFORE_DUMP failed [thxxtool3.c 262]

M ThCallHooks: call hook >BtcCallLgCl< for event BEFORE_DUMP

M Entering ThSetStatError

M ThIErrHandle: do not call ThrCoreInfo (no_core_info=0, in_dynp_env=0)

M ThErrPrivHandle: set th_errno (11)

M Entering ThReadDetachMode

M *** ERROR => ThIErrHandle: bad value for th_act_em_hdl (15), detach T0/M0 [thxxhead.c 11202]

M

Accepted Solutions (0)

Answers (11)

Answers (11)

Former Member
0 Kudos

Thanks deepak for all the help

Did kernel upgrade and it worked fine the installation completed without any problems.

Former Member
0 Kudos

Thanks for the reply Deepak

Will try kernel upgrade to the latest patch level and are there any env variables that needs to be set after kernel upgrade.

Please let me know if there are any variables that needs to be set.

former_member188883
Active Contributor
0 Kudos

Hi ,

No additional env variables need to be set.

Regards,

Deepak Kori

Former Member
0 Kudos

protect_shm = 0

B ***LOG BB0=> buffer OTR started with length 4096k bytes [dbexpbuf#3 @ 2409] [dbexpbuf2409 ]

B dbexpbuf[EXP_OTR]: semaphore 55 released in db_exp_init

B ***LOG BB0=> buffer CALE started with length 500000 bytes [dbcalbuf#4 @ 2304] [dbcalbuf2304 ]

B dbtran INFO (init_connection '<DEFAULT>' [ORACLE:700.08]):

B max_blocking_factor = 5, max_in_blocking_factor = 5,

B min_blocking_factor = 5, min_in_blocking_factor = 5,

B prefer_union_all = 0, prefer_join = 0,

B prefer_fix_blocking = 0, prefer_in_itab_opt = 1,

B convert AVG = 0, alias table FUPD = 0,

B escape_as_literal = 1, opt GE LE to BETWEEN = 0,

B select * =0x0f, character encoding = STD / <none>:-,

B use_hints = abap->1, dbif->0x1, upto->2147483647, rule_in->0,

B rule_fae->0, concat_fae->0, concat_fae_or->0

M

M Wed Nov 2 21:57:25 2011

M SecAudit(RsauInit): Start init of Security Audit Log for first wp.

M SecAudit(RsauInit): Shared memory for Security Audit Log already exists.

M SecAudit(RsauInit): Re-initialize with new profile parameters

M SecAudit(RsauShmInit): SCSA size................ = 4096

M SecAudit(RsauShmInit): addr of SCSA............. = 0x2b4452a0f000

M SecAudit(RsauShmInit): addr of RSAUSHM.......... = 0x2b4452a0f768

M SecAudit(RsauShmInit): addr of RSAUSLOTINFO..... = 0x2b4452a0f7a0

M SecAudit(RsauShmInit): addr of RSAUSLOTS........ = 0x2b4452a0f7ac

M SecAudit(RsauShmInit): SHM version.............. = 5

M SecAudit(RsauShmInit): SHM Slot version......... = 2

M SecAudit(RsauShmInit): RSAU active.............. = 0

M SecAudit(RsauShmInit): number of slots possible. = 10

M SecAudit(RsauShmInit): number of slots requested = 2

M SecAudit(RsauShmInit): number of slots used..... = 2

M SecAudit(RsauShmInit): user selection........... = 0

M SecAudit(RsauShmInit): max size of one file..... = 0 KB

M SecAudit(RsauShmInit): max size of all files.... = 102400 KB

M SecAudit(RsauGetCurrentProfile): Init of shared memory completed

M SecAudit(RsauGetCurrentProfile): Security Audit Log not active

M SsfSapSecin: automatic application server initialization for SAPSECULIB

N SsfSapSecin: Looking for PSE in database

N SsfPseLoad: started...(path=/usr/sap/SOL/DVEBMGS00/sec, AS=sapsol, instanceid=00)

N SsfPseLoad: ended (0 of 0 sucessfully loaded, 0 checked...

N

N Wed Nov 2 21:57:26 2011

N MskiCreateLogonTicketCache: Logon Ticket cache created in shared memory.

N MskiCreateLogonTicketCache: Logon Ticket cache pointer registered in shared memory.

M CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

M CCMS: AlMsUpload called by wp 0.

M CCMS: AlMsUpload successful for /usr/sap/SOL/DVEBMGS00/log/ALMTTREE (249 MTEs).

S

S Wed Nov 2 21:57:27 2011

S *** init spool environment

S TSPEVJOB updates outside critical section: event_update_nocsec = 1

S initialize debug system

T Stack direction is downwards.

T debug control: prepare exclude for printer trace

T new memory block 0x14a4ea90

S

S Wed Nov 2 21:57:28 2011

S spool kernel/ddic check: Ok

S using table TSP02FX for frontend printing

S 1 spool work process(es) found

S frontend print via spool service enabled

S printer list size is 150

S printer type list size is 50

S queue size (profile) = 300

S hostspool list size = 3000

S option list size is 30

I *** INFO Shm 49 in Pool 40 2898 KB estimated 1632 KB real ( -1266 KB -44 %)

S found processing queue enabled

S found spool memory service RSPO-RCLOCKS at 0x2b459a362070

S doing lock recovery

S setting server cache root

S found spool memory service RSPO-SERVERCACHE at 0x2b459a3626a0

S using messages for server info

S size of spec char cache entry: 297032 bytes (timeout 100 sec)

S size of open spool request entry: 2512 bytes

S immediate print option for implicitely closed spool requests is disabled

A

A Wed Nov 2 21:57:29 2011

A **GENER Trace switched on ***

A

A -PXA--


A PXA INITIALIZATION

A PXA: Locked PXA-Semaphore.

A PXA: max_map_count = 1000000: ok

A System page size: 4kb, total admin_size: 20884kb, dir_size: 20764kb.

A Attached to PXA (address 0x2b45a31f9000, size 300000K)

A abap/pxa = shared protect gen_remote

A PXA INITIALIZATION FINISHED

A -PXA--


A

M -


C-STACK -


(CTrcStack2+0x82)[0x6cdb92]

(SigIGenAction+0x2ad)[0x1a08edd]

/lib64/libpthread.so.0[0x34f7e0e4c0]

/lib64/libc.so.6(gsignal+0x35)[0x34f7230215]

/lib64/libc.so.6(abort+0x110)[0x34f7231cc0]

(ab_init+0x6c8)[0xb8eed8]

(ThrInitRunTime+0x8d)[0x6bbf8d]

(ThStartUp2+0x150)[0x6682f0]

(ThInit+0x1129)[0x55b8b9]

(ThStart+0x11b)[0x55d6bb]

(DpMain+0x228)[0x4bfc08]

/lib64/libc.so.6(__libc_start_main+0xf4)[0x34f721d974]

M -


M

M Wed Nov 2 21:57:40 2011

M ***LOG Q0E=> SigIGenAction, signal ( 6) [sigux.c 1067]

M

M Wed Nov 2 21:57:41 2011

M in_ThErrHandle: 1

M ThSigHandler: signal (step 1, th_errno 11, action 4)

M

M Info for wp 0

M

M pid = 6502

M severity = 0

M status = 0

M stat = WP_RUN

M waiting_for = NO_WAITING

M reqtype = DP_RQ_DIAWP

M act_reqtype = NO_REQTYPE

M rq_info = 0

M tid = 0

M mode = 0

M len = -1

M rq_id = 65535

M rq_source =

M last_tid = 0

M last_mode = 0

M semaphore = 0

M act_cs_count = 0

M csTrack = 0

M csTrackRwExcl = 0

M csTrackRwShrd = 0

M mode_cleaned_counter = 0

M control_flag = 0

M int_checked_resource(RFC) = 0

M ext_checked_resource(RFC) = 0

M int_checked_resource(HTTP) = 0

M ext_checked_resource(HTTP) = 0

M report = > <

M action = 0

M tab_name = > <

M attachedVm = no VM

M

M Modeinfo for User T0/M0

M

M tm state = 2

M uid = 1

M term type = 0x2

M display = 0x0

M cpic_no = 0

M cpic_idx = -1

M usr = >SAPSYS <

M terminal = > <

M client = > <

M conversation_ID = > <

M appc_tm_conv_idx = -1

M its_plugin = NO

M allowCreateMode = YES

M wp_ca block = 30

M appc_ca block = 10

M blockSoftCanel = NO

M session_id = > <

M ext_session_id = > <

M imode = 0

M mode state = 0x41

M mode clean_state = 1

M task_type = 0

M lastThFc = THFCINVA

M lastAction = TH_IACT_NO_ACTION

M th_errno = 11

M rollout_reason = 0

M last_rollout_level = 0

M async_receives = 0

M cpic_receive = 0

M em handle = 3

M roll state = 1

M abap state = 1

M em state = 3

M eg state = 1

M spa state = 1

M enq state = 0

M softcancel = 0

M cancelInitiator = ?

M clean_state = DP_DEFAULT_CLEANING

M next hook = T-1/U-1/M255

M master hook = T-1/U-1/M255

M slave hook = T-1/U-1/M255

M debug_tid = -1

M debug_mode = 255

M mode type = 0x1

M debug = 0

M msg_count = 0

M tcode = > <

M last_wp = -1

M client conversation_ID = > <

M server conversation_ID = > <

M lock = 0

M max enq infos = 0

M act enq infos = 0

M em_hyper_hdl = 0x2b45521844b0

M plugin_info = NULL

M act_plugin_hdl = -1

M act_plugin_no = 0

M max_plugin_no = 0

M

M PfStatDisconnect: disconnect statistics

M Entering TH_CALLHOOKS

M ThCallHooks: call hook >SAP-Trace buffer write< for event BEFORE_DUMP

M TrThHookFunc: called for WP dump

M ThCallHooks: call hook >ThrSaveSPAFields< for event BEFORE_DUMP

M *** ERROR => ThrSaveSPAFields: no valid thr_wpadm [thxxrun1.c 730]

M *** ERROR => ThCallHooks: event handler ThrSaveSPAFields for event BEFORE_DUMP failed [thxxtool3.c 262]

M ThCallHooks: call hook >BtcCallLgCl< for event BEFORE_DUMP

M Entering ThSetStatError

M ThIErrHandle: do not call ThrCoreInfo (no_core_info=0, in_dynp_env=0)

M ThErrPrivHandle: set th_errno (11)

M Entering ThReadDetachMode

M *** ERROR => ThIErrHandle: bad value for th_act_em_hdl (3), detach T0/M0 [thxxhead.c 11202]

M

M Modeinfo for User T0/M0

M

M tm state = 2

M uid = 1

M term type = 0x2

M display = 0x0

M cpic_no = 0

M cpic_idx = -1

M usr = >SAPSYS <

M terminal = > <

M client = > <

M conversation_ID = > <

M appc_tm_conv_idx = -1

M its_plugin = NO

M allowCreateMode = YES

M wp_ca block = 30

M appc_ca block = 10

M blockSoftCanel = NO

M session_id = > <

M ext_session_id = > <

M imode = 0

M mode state = 0x41

M mode clean_state = 1

M task_type = 0

M lastThFc = THFCINVA

M lastAction = TH_IACT_NO_ACTION

M th_errno = 11

M rollout_reason = 0

M last_rollout_level = 0

M async_receives = 0

M cpic_receive = 0

M em handle = 3

M roll state = 1

M abap state = 1

M em state = 2

M eg state = 1

M spa state = 1

M enq state = 0

M softcancel = 0

M cancelInitiator = ?

M clean_state = DP_DEFAULT_CLEANING

M next hook = T-1/U-1/M255

M master hook = T-1/U-1/M255

M slave hook = T-1/U-1/M255

M debug_tid = -1

M debug_mode = 255

M mode type = 0x1

M debug = 0

M msg_count = 0

M tcode = > <

M last_wp = -1

M client conversation_ID = > <

M server conversation_ID = > <

M lock = 0

M max enq infos = 0

M act enq infos = 0

M em_hyper_hdl = 0x2b45521844b0

M plugin_info = NULL

M act_plugin_hdl = -1

M act_plugin_no = 0

M max_plugin_no = 0

M

M ThIErrHandle: Detach all shared memory segments in EM

M ***LOG Q02=> wp_halt, WPStop (Workproc 0 6502) [dpuxtool.c 269]

former_member188883
Active Contributor
0 Kudos

Hi,

Could you apply latest kernel patch and check whether system starts or not.

Regards,

Deepak Kori

Former Member
0 Kudos

Thanks deepak for the quick reply,This is the log that u asked for

-


trc file: "dev_w0", trc level: 1, release: "701"

-


*

  • ACTIVE TRACE LEVEL 1

  • ACTIVE TRACE COMPONENTS all, MJ

*

M sysno 00

M sid SOL

M systemid 390 (AMD/Intel x86_64 with Linux)

M relno 7010

M patchlevel 0

M patchno 137

M intno 20020600

M make: single threaded, Unicode, 64 bit, optimized

M pid 6502

M

M

M Wed Nov 2 21:57:20 2011

M kernel runs with dp version 245000(ext=110000) (@(#) DPLIB-INT-VERSION-245000-UC)

M length of sys_adm_ext is 576 bytes

M ThInit: rdisp/cleanup_after_crash = 1

M ***LOG Q01=> ThInit, WPStart (Workproc 0 1 6502) [thxxhead.c 1346]

M

M Wed Nov 2 21:57:21 2011

M ThInit: running on host sapsol

M calling db_connect ...

B Loading DB library '/usr/sap/SOL/DVEBMGS00/exe/dboraslib.so' ...

B Library '/usr/sap/SOL/DVEBMGS00/exe/dboraslib.so' loaded

B Version of '/usr/sap/SOL/DVEBMGS00/exe/dboraslib.so' is "700.08", patchlevel (0.134)

C Oracle Client Version: '10.2.0.2.0', (dbsl 701 090311, UNICODE[2])

C Application info callback registered.

C Client NLS setting (by OCINlsGetInfo): con=0, 'AMERICAN_AMERICA.UTF16'

C Logon as OPS$-user to get SAPSR3's password

C Connecting as /@SOL on connection 0 (nls 0) ... (dbsl 701 090311, UNICODE[2])

C Attaching to DB Server SOL (con_hdl=0,svchp=0x148cf598,srvhp=0x148d2028)

C Starting user session: OCISessionBegin(con_hdl=0, usr='/',svchp=0x148cf598, srvhp=0x148d2028, usrhp=0x148bf728)

C CbApplInfoGet() failed (ignored 1).

C Now '/@SOL' is connected: con_hdl=0, nls_hdl=0, session_id=139.

C Got SAPSR3's password from OPS$-user

C Disconnecting from connection 0 ...

C Closing user session (con_hdl=0,svchp=0x148cf598,usrhp=0x148bf728)

C Disconnected (con=0) from ORACLE.

C Connecting as SAPSR3/<pwd>@SOL on connection 0 (nls 0) ... (dbsl 701 090311, UNICODE[2])

C Starting user session: OCISessionBegin(con_hdl=0, usr=SAPSR3/<pwd>, svchp=0x148cf598, srvhp=0x148d2028, usrhp=0x148bf728)

C Now 'SAPSR3/<pwd>@SOL' is connected: con_hdl=0, nls_hdl=0, session_id=139.

C con=0, V$NLS_PARAMETERS: NLS_LANG=AMERICAN_AMERICA.UTF8, NLS_NCHAR=UTF8, UNI_NON=FALSE

C Nls CharacterSet NationalCharSet EnvHp ErrHp ErrBt

C 0 UTF16 AL16UTF16 0x148b7460 0x148bef10 0x148cf668

C DB instance SOL is running on sapsol with ORACLE version 10.2.0.4.0 since NOV 02, 2011, 21:56:49

B Connection 0 opened (DBSL handle 0)

M db_connect o.k.

M ICT: exclude compression: .zip,.cs,.rar,.arj,.z,.gz,.tar,.lzh,.cab,.hqx,.ace,.jar,.ear,.war,.css,.pdf,.js,.gzip,.uue,.bz2,.iso,.sda,.sar,.gif,.png,.swc,*.swf

I MtxInit: 0 0 0

M SHM_PRES_BUF (addr: 0x2b444c138000, size: 4400000)

M SHM_ROLL_AREA (addr: 0x2b4562b22000, size: 606208000)

M SHM_PAGING_AREA (addr: 0x2b4586d42000, size: 268435456)

M SHM_ROLL_ADM (addr: 0x2b444c56c000, size: 11116480)

M SHM_PAGING_ADM (addr: 0x2b4596d42000, size: 3277856)

M ThCreateNoBuffer allocated 560152 bytes for 1000 entries at 0x2b4597065000

M ThCreateNoBuffer index size: 3000 elems

M ThCreateVBAdm allocated 12176 bytes (50 server) at 0x2b459ff71000

X EmInit: MmSetImplementation( 2 ).

X MM global diagnostic options set: 0

X <ES> client 0 initializing ....

X Using implementation map

X Linux: Kernel supports shared memory disclaiming

X Linux: using madvise(<pointer>, <size>, 9).

X Linux: disclaiming for shared memory enabled

X ES initialized.

X mm.dump: set maximum dump mem to 96 MB

M Deactivate statistics hyper index locking

I *** INFO Shm 45 in Pool 40 4771 KB estimated 3625 KB real ( -1146 KB -25 %)

B dbntab: NTAB buffers created

B dbntab: Buffer FTAB(hash header) (addr: 0x2b45970ef088, size: 392)

B dbntab: Buffer FTAB(anchor array) (addr: 0x2b45970ef210, size: 320072)

B dbntab: Buffer FTAB(item array) (addr: 0x2b459713d458, size: 1280000)

B dbntab: Buffer FTAB(data area) (addr: 0x2b4597275c58, size: 30720000)

B dbntab: Buffer IREC(hash header) (addr: 0x2b4598fc3088, size: 392)

B dbntab: Buffer IREC(anchor array) (addr: 0x2b4598fc3210, size: 320072)

B dbntab: Buffer IREC(item array) (addr: 0x2b4599011458, size: 320000)

B dbntab: Buffer IREC(data area) (addr: 0x2b459905f658, size: 6144000)

B dbntab: Buffer STAB(hash header) (addr: 0x2b459963d088, size: 392)

B dbntab: Buffer STAB(anchor array) (addr: 0x2b459963d210, size: 320072)

B dbntab: Buffer STAB(item array) (addr: 0x2b459968b458, size: 320000)

B dbntab: Buffer STAB(data area) (addr: 0x2b45996d9658, size: 3072000)

B dbntab: Buffer TTAB(hash header) (addr: 0x2b45999c9088, size: 2160)

B dbntab: Buffer TTAB(anchor array) (addr: 0x2b45999c98f8, size: 320072)

B dbntab: Buffer TTAB(item array) (addr: 0x2b4599a17b40, size: 800000)

B dbntab: Buffer TTAB(data area) (addr: 0x2b4599adb040, size: 5840000)

B

B Wed Nov 2 21:57:23 2011

B dbstat: table statistics switched on for 35493 tables

B dbstat: TABSTAT buffer created (addr: 0x2b4457f64000, size: 17380280)

B db_con_shm_ini: WP_ID = 0, WP_CNT = 17, CON_ID = -1

B dbtbxbuf: Buffer TABL (addr: 0x2b459ff74100, size: 30000000, end: 0x2b45a1c10480)

B dbtbxbuf: Profile: max_objects = 5000, displace = 1, reorg = 1

B dbtbxbuf: request_unit = 2000, sync_reload = 5, inval_reload = 5

B dbtbxbuf: protect_shm = 0, force_checks = 0

B dbtbxbuf: tsize_retry = 14203392

B ***LOG BB0=> buffer TABL started with length 30000000 bytes [dbtbxbuf#6 @ 16383] [dbtbxbuf1638 3]

B dbtbxbuf: Buffer TABLP (addr: 0x2b45a1c11100, size: 10240000, end: 0x2b45a25d5100)

B dbtbxbuf: Profile: max_objects = 500, displace = 1, reorg = 1

B dbtbxbuf: request_unit = 2000, sync_reload = 5, inval_reload = 5

B dbtbxbuf: protect_shm = 0, force_checks = 0

B dbtbxbuf: tsize_retry = 5030144

B ***LOG BB0=> buffer TABLP started with length 10240000 bytes [dbtbxbuf#6 @ 16383] [dbtbxbuf1638 3]

B dbtbxbuf: Reading TBX statistics:

B dbtbxbuf: Opening /usr/sap/SOL/DVEBMGS00/data/tbxstat failed (No such file or directory).

B dbtbxbuf: Opening /usr/sap/SOL/DVEBMGS00/data/tbxnew failed (No such file or directory).

B dbtbxbuf: Renaming /usr/sap/SOL/DVEBMGS00/data/tbxnew to /usr/sap/SOL/DVEBMGS00/data/tbxstat failed (No such file or directory).

B dbtbxbuf: 0 object entries precreated

B dbexpbuf[EXP_SHB]: Aquired semaphore 35 in db_exp_init(EXP_INIT)

B dbexpbuf[EXP_SHB]: shared memory layout of buffer EIBUF:

B EYE-CATCHER : 1 * 4 = 4

B ADMIN : 1 * 472 = 472

B RECOVERY : 17 * 40 = 680

B MUTEX VECTOR : 4001 * 64 = 256064

B OBJECT DIRECTORY : 2000 * 256 = 512000

B HASH VECTOR : 4001 * 8 = 32008

B STATISTICS : 1 * 200 = 200

B FREELIST : 65 * 8 = 520

B DATA SPACE : 13251 * 256 = 3392256

B dbexpbuf[EXP_SHB]: buffer EIBUF installed with

B semkey = 35

B shmkey = 54

B wp_n = 17

B sclass = 0

B block_length = 256

B max_objects = 2000

B max_obj_size = 847904

B pref_obj_size = 0

B est_large_obj_size = 16384

B free_vec_lg = 65

B hash_vec_size = 4001

B buffer_l = 4194304

B max_blocks = 13251

B free_blocks = 13251

B mutex_n = 4001

B recovery_delay = 500000

B tracing = 0

B force_checks = 0

B protect_shm = 0

B ***LOG BB0=> buffer EIBUF started with length 4096k bytes [dbexpbuf#3 @ 2409] [dbexpbuf2409 ]

B dbexpbuf[EXP_SHB]: semaphore 35 released in db_exp_init

B dbexpbuf[EXP_SHM]: Aquired semaphore 56 in db_exp_init(EXP_INIT)

B dbexpbuf[EXP_SHM]: shared memory layout of buffer ESM :

B EYE-CATCHER : 1 * 4 = 4

B ADMIN : 1 * 472 = 472

B RECOVERY : 17 * 40 = 680

B MUTEX VECTOR : 4001 * 64 = 256064

B OBJECT DIRECTORY : 2000 * 256 = 512000

B HASH VECTOR : 4001 * 8 = 32008

B STATISTICS : 1 * 200 = 200

B FREELIST : 65 * 8 = 520

B DATA SPACE : 13251 * 256 = 3392256

B dbexpbuf[EXP_SHM]: buffer ESM installed with

B semkey = 56

B shmkey = 65

B wp_n = 17

B sclass = 0

B block_length = 256

B max_objects = 2000

B max_obj_size = 847904

B pref_obj_size = 0

B est_large_obj_size = 16384

B free_vec_lg = 65

B hash_vec_size = 4001

B buffer_l = 4194304

B max_blocks = 13251

B free_blocks = 13251

B mutex_n = 4001

B recovery_delay = 500000

B tracing = 0

B force_checks = 0

continued in next post.........................thanks in advance

Former Member
0 Kudos

This is the new sap inst log after correcting the shared memory error

INFO 2011-10-30 20:33:12.786

Creating file /tmp/dev_sap_kernel_test_30_Oct_2011_20_33_12.

INFO 2011-10-30 20:33:12.786

Removed file /tmp/dev_sap_kernel_test_30_Oct_2011_20_33_12.

INFO 2011-10-30 20:33:12.788

Working directory changed to /tmp/sapinst_exe.6611.1319986088.

INFO 2011-10-30 20:33:12.791

Working directory changed to /sapdump/51040437/IM_LINUX_X86_64.

INFO 2011-10-30 20:33:12.895

Creating file /tmp/dev_sap_kernel_test_30_Oct_2011_20_33_12.

INFO 2011-10-30 20:33:12.895

Removed file /tmp/dev_sap_kernel_test_30_Oct_2011_20_33_12.

INFO 2011-10-30 20:33:12.898

Real group ID set to 501.

INFO 2011-10-30 20:33:14.172

Creating file /tmp/sapinst_instdir/x.

INFO 2011-10-30 20:33:14.172

Removed file /tmp/sapinst_instdir/x.

INFO 2011-10-30 20:33:14.179

Authorizations set for /tmp/sapinst_instdir.

INFO 2011-10-30 20:33:14.180

Working directory changed to /tmp/sapinst_exe.6611.1319986088.

INFO 2011-10-30 20:33:14.209

Working directory changed to /sapdump/51040437/IM_LINUX_X86_64.

INFO 2011-10-30 20:33:32.377

Creating file /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/x.

INFO 2011-10-30 20:33:32.378

Removed file /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/x.

INFO 2011-10-30 20:33:36.107

Creating file /tmp/sapinst_instdir/x.

INFO 2011-10-30 20:33:36.108

Removed file /tmp/sapinst_instdir/x.

INFO 2011-10-30 20:33:36.116

Authorizations set for /tmp/sapinst_instdir.

INFO 2011-10-30 20:33:36.123

Removed file /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/dev_sap_kernel.

INFO 2011-10-30 20:33:36.126

Removed file /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/dev_sap_kernel.

INFO 2011-10-30 20:33:36.128

Copied file '/sapdump/51040437/IM_LINUX_X86_64/dev_sap_kernel' to '/tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/dev_sap_kernel'.

INFO 2011-10-30 20:33:36.130

Authorizations set for /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/dev_sap_kernel.

INFO 2011-10-30 20:33:36.130

Removed file /sapdump/51040437/IM_LINUX_X86_64/dev_sap_kernel.

INFO 2011-10-30 20:33:38.419

Copied file '/tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/keydb.xml' to '/tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/keydb.2.xml'.

INFO 2011-10-30 20:33:40.980

Copied file '/tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/statistic.xml' to '/tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/statistic.1.xml'.

INFO 2011-10-30 20:37:07.197

Working directory changed to /tmp/sapinst_exe.6611.1319986088.

INFO 2011-10-30 20:37:07.200

Working directory changed to /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS.

INFO 2011-10-30 20:37:07.203

Working directory changed to /tmp/sapinst_exe.6611.1319986088.

INFO 2011-10-30 20:37:07.206

Working directory changed to /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS.

INFO 2011-10-30 20:37:15.690

Working directory changed to /tmp/sapinst_exe.6611.1319986088.

INFO 2011-10-30 20:37:15.692

Working directory changed to /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS.

INFO 2011-10-30 20:37:21.765

Working directory changed to /tmp/sapinst_exe.6611.1319986088.

INFO 2011-10-30 20:37:21.768

Working directory changed to /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS.

WARNING[E] 2011-10-30 20:37:22.804

FSL-02053 Read error in /proc/sys/net/ipv6/route/flush.

WARNING[E] 2011-10-30 20:37:23.393

FSL-02053 Read error in /proc/sys/net/ipv4/route/flush.

WARNING[E] 2011-10-30 20:37:23.836

FSL-02053 Read error in /proc/sys/fs/binfmt_misc/register.

INFO 2011-10-30 20:37:24.347

Copied file '/tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/inifile.xml' to '/tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/inifile.1.xml'.

INFO 2011-10-30 20:37:36.664

Execute step start of component |NW_Onehost|ind|ind|ind|ind|0|0|NW_Onehost_System|ind|ind|ind|ind|onehost|0|NW_CI_Instance|ind|ind|ind|ind|ci|0|NW_CI_Instance_Start|ind|ind|ind|ind|2|0

INFO 2011-10-30 20:38:04.471

Working directory changed to /tmp/sapinst_exe.6611.1319986088.

INFO 2011-10-30 20:38:04.473

Working directory changed to /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS.

INFO 2011-10-30 20:38:04.485

Working directory changed to /tmp/sapinst_exe.6611.1319986088.

INFO 2011-10-30 20:38:04.490

Working directory changed to /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS.

INFO 2011-10-30 20:38:05.18

Working directory changed to /tmp/sapinst_exe.6611.1319986088.

INFO 2011-10-30 20:38:05.706

Working directory changed to /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS.

INFO 2011-10-30 20:38:05.939

Starting instance SOL/DVEBMGS00...

WARNING 2011-10-30 20:38:06.024

Connect to message server (sapsol/3900) failed: MSENILAYER.

INFO 2011-10-30 20:38:08.24

Creating file /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/start_SOL_DVEBMGS00.log.

INFO 2011-10-30 20:38:08.216

Output of /usr/sap/SOL/SYS/exe/run/startsap all DVEBMGS00 sapsol is written to the logfile start_SOL_DVEBMGS00.log.

INFO 2011-10-30 20:39:10.649

Execution of the command "/usr/sap/SOL/SYS/exe/run/startsap all DVEBMGS00 sapsol" finished with return code 0. Output:

Checking SOL Database

-


Database is not available via R3trans

Running /usr/sap/SOL/SYS/exe/run/startdb

Trying to start SOL database ...

Log file: /home/soladm/startdb.log

SOL database started

/usr/sap/SOL/SYS/exe/run/startdb completed successfully

Starting Startup Agent sapstartsrv

-


Instance Service on host sapsol started

Starting SAP Instance DVEBMGS00

-


Startup-Log is written to /home/soladm/startsap_DVEBMGS00.log

Instance on host sapsol started

Starting SAP-Collector Daemon

-


20:39:10 30.10.2011 LOG: Effective User Id is root

***********************************************************************

  • This is Saposcol Version COLL 20.95 701 - v2.00, AMD/Intel x86_64 with Linux, 2007/02/16

  • Usage: saposcol -l: Start OS Collector

  • saposcol -k: Stop OS Collector

  • saposcol -d: OS Collector Dialog Mode

  • saposcol -s: OS Collector Status

  • The OS Collector (PID 5550) is already running .....

************************************************************************

saposcol already running

INFO 2011-10-30 20:39:10.990

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:39:10.991

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:39:10.993

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:39:10.994

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:39:11.077

State of instance SOL/DVEBMGS00 changed from ABAP: UNKNOWN to ABAP: UNKNOWN.

INFO 2011-10-30 20:39:37.938

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:39:37.940

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:39:37.944

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:39:37.945

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:40:08.138

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:40:08.139

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:40:08.141

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:40:08.141

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:40:37.453

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:40:37.454

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:40:37.456

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:40:37.457

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:41:07.670

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:41:07.670

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:41:07.672

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:41:07.672

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:41:37.052

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:41:37.052

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:41:37.054

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:41:37.055

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:42:07.595

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:42:07.596

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:42:07.599

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:42:07.600

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:42:37.997

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:42:37.998

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:42:38.000

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:42:38.000

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:43:07.223

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:43:07.224

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:43:07.227

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:43:07.228

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:43:37.514

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:43:37.515

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:43:37.517

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:43:37.517

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:44:07.910

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:44:07.911

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:44:07.914

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:44:07.915

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:44:37.099

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:44:37.099

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:44:37.101

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:44:37.275

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:45:07.680

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:45:07.680

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:45:07.682

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:45:07.682

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:45:38.151

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:45:38.151

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:45:38.156

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:45:38.157

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:46:09.053

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:46:09.053

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:46:09.056

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:46:09.057

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:46:38.589

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:46:38.589

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:46:38.591

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:46:38.592

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:47:08.120

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:47:08.120

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:47:08.122

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:47:08.122

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:47:37.442

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:47:37.442

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:47:37.443

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:47:37.444

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:48:08.175

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:48:08.176

Disconnect from message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:48:08.177

Connect to message server (sapsol/3900) succeeded.

INFO 2011-10-30 20:48:08.178

Disconnect from message server (sapsol/3900) succeeded.

ERROR 2011-10-30 20:48:08.886

CJS-30149 ABAP processes of instance SOL/DVEBMGS00 [ABAP: STARTING] did not start after 10:00 minutes. Giving up.

ERROR 2011-10-30 20:48:19.956

FCO-00011 The step start with step key |NW_Onehost|ind|ind|ind|ind|0|0|NW_Onehost_System|ind|ind|ind|ind|onehost|0|NW_CI_Instance|ind|ind|ind|ind|ci|0|NW_CI_Instance_Start|ind|ind|ind|ind|2|0|start was executed with status ERROR ( Last error reported by the step: ABAP processes of instance SOL/DVEBMGS00 [ABAP: STARTING] did not start after 10:00 minutes. Giving up.).

INFO 2011-10-30 20:48:34.526

Creating file /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS/__instana_tmp.xml.

INFO 2011-10-30 20:58:45.951

An error occured and the user decided to stop.\n Current step "|NW_Onehost|ind|ind|ind|ind|0|0|NW_Onehost_System|ind|ind|ind|ind|onehost|0|NW_CI_Instance|ind|ind|ind|ind|ci|0|NW_CI_Instance_Start|ind|ind|ind|ind|2|0|start".

INFO 2011-10-30 21:00:52.109

Working directory changed to /tmp/sapinst_instdir/SOLMAN/SYSTEM/ORA/CENTRAL/AS.

INFO 2011-10-30 21:00:59.474

Creating file /tmp/sapinst_instdir/.lastInstallationLocation.

INFO 2011-10-30 21:01:03.53

Cancelled task 0.

former_member188883
Active Contributor
0 Kudos

Hi,

From the logs shared by you, I could see following Os related errors

FSL-02053 Read error in /proc/sys/net/ipv6/route/flush

FSL-02053 Read error in /proc/sys/fs/binfmt_misc/register

Can you look for these files and their respective permission in conjuction with OS guys.

Secondly , request you to share the dev_w0 logs.

Regards,

Deepak Kori

Former Member
0 Kudos

Sorry for the delayed response deepak

This is the new pf par check the error is resolved however still getting the same error in sapinst start instance phase

================================================================================

== Checking profile: /usr/sap/SOL/SYS/profile/SOL_DVEBMGS00_sapsol

================================================================================

***WARNING: Unexpected parameter: SAPFQDN =fccrico.com

***WARNING: Unexpected parameter: jstartup/vm/home =/opt/IBMJava2-amd64-142

Shared memory disposition overview

================================================================

Shared memory pools

Key: 10 Pool

Size configured.....: 170000000 ( 162.1 MB)

Size min. estimated.: 132539648 ( 126.4 MB)

Advised Size........: 136000000 ( 129.7 MB)

Key: 40 Pool for database buffers

Size configured.....: 150000000 ( 143.0 MB)

Size min. estimated.: 109175040 ( 104.1 MB)

Advised Size........: 112000000 ( 106.8 MB)

Shared memories inside of pool 10

Key: 11 Size: 500000 ( 0.5 MB) Factory calender buffer

Key: 12 Size: 6000000 ( 5.7 MB) TemSe Char-Code convert Buf.

Key: 13 Size: 60500000 ( 57.7 MB) Alert Area

Key: 14 Size: 4400000 ( 4.2 MB) Presentation buffer

Key: 16 Size: 22400 ( 0.0 MB) Semaphore activity monitoring

Key: 17 Size: 11116480 ( 10.6 MB) Roll administration

Shared memories inside of pool 40

Key: 42 Size: 7232992 ( 6.9 MB) DB TTAB buffer

Key: 43 Size: 32534392 ( 31.0 MB) DB FTAB buffer

Key: 44 Size: 7958392 ( 7.6 MB) DB IREC buffer

Key: 45 Size: 4886392 ( 4.7 MB) DB short nametab buffer

Key: 46 Size: 20480 ( 0.0 MB) DB sync table

Key: 47 Size: 3073024 ( 2.9 MB) DB CUA buffer

Key: 48 Size: 500000 ( 0.5 MB) Number range buffer

Key: 49 Size: 2968344 ( 2.8 MB) Spool admin (SpoolWP+DiaWP)

Shared memories outside of pools

Key: 1 Size: 2500 ( 0.0 MB) System administration

Key: 2 Size: 6237508 ( 5.9 MB) Disp. administration tables

Key: 3 Size: 13714400 ( 13.1 MB) Disp. communication areas

Key: 4 Size: 512248 ( 0.5 MB) statistic area

Key: 6 Size: 319488000 ( 304.7 MB) ABAP program buffer

Key: 7 Size: 14838 ( 0.0 MB) Update task administration

Key: 8 Size: 268435556 ( 256.0 MB) Paging buffer

Key: 9 Size: 606208100 ( 578.1 MB) Roll buffer

Key: 18 Size: 3670116 ( 3.5 MB) Paging adminitration

Key: 19 Size: 30000000 ( 28.6 MB) Table-buffer

Key: 30 Size: 18432 ( 0.0 MB) Taskhandler runtime admin.

Key: 31 Size: 4806000 ( 4.6 MB) Dispatcher request queue

Key: 33 Size: 10240000 ( 9.8 MB) Table buffer, part.buffering

Key: 34 Size: 33554432 ( 32.0 MB) Enqueue table

Key: 41 Size: 25010000 ( 23.9 MB) DB statistics buffer

Key: 51 Size: 3200000 ( 3.1 MB) Extended memory admin.

Key: 52 Size: 40000 ( 0.0 MB) Message Server buffer

Key: 54 Size: 4202496 ( 4.0 MB) Export/Import buffer

Key: 55 Size: 8192 ( 0.0 MB) Spool local printer+joblist

Key: 57 Size: 1048576 ( 1.0 MB) Profilparameter in shared mem

Key: 58 Size: 4096 ( 0.0 MB) Enqueue ID for reset

Key: 62 Size: 85983232 ( 82.0 MB) Memory pipes

Key: 63 Size: 409600 ( 0.4 MB) ICMAN shared memory

Key: 64 Size: 4202496 ( 4.0 MB) Online Text Repository Buf.

Key: 65 Size: 4202496 ( 4.0 MB) Export/Import Shared Memory

Key: 1002 Size: 400000 ( 0.4 MB) Performance monitoring V01.0

Key: 58900100 Size: 4096 ( 0.0 MB) SCSA area

Nr of operating system shared memory segments: 29

Shared memory resource requirements estimated

================================================================

Total Nr of shared segments required.....: 29

System-imposed number of shared memories.: 1000

Shared memory segment size required min..: 606208100 ( 578.1 MB)

System-imposed maximum segment size......: 26440892416 (25216.0 MB)

Swap space requirements estimated

================================================

Shared memory....................: 1598.0 MB

..in pool 10 126.4 MB, 77% used

..in pool 40 104.1 MB, 72% used

..not in pool: 1359.6 MB

Processes........................: 231.6 MB

Extended Memory .................: 6040.0 MB

-


Total, minimum requirement.......: 7869.6 MB

Process local heaps, worst case..: 1907.3 MB

Total, worst case requirement....: 9783.0 MB

Errors detected..................: 0

Warnings detected................: 2

sapsol:soladm 4>

Former Member
0 Kudos

Dear Henry Hsu

Thanks for Reply

Very First log of dev_w0 trace file.

With Regards

Anant

former_member188883
Active Contributor
0 Kudos

Hi,

As per the output of sappfpar command there are 2 errors as below

***ERROR: Size of shared memory pool 10 too small ================================================================ SOLUTIONS: (1) Locate shared memory segments outside of pool 10 with parameters like: ipc/shm_psize_ =0 SOLUTION: Increase size of shared memory pool 10 with parameter: ipc/shm_psize_10 =136000000 ***ERROR: Size of shared memory pool 40 too small ================================================================ SOLUTIONS: (1) Locate shared memory segments outside of pool 40 with parameters like: ipc/shm_psize_ =0 SOLUTION: Increase size of shared memory pool 40 with parameter: ipc/shm_psize_40 =112000000

You need to adjust the value of parameter ipc/shm_psize_10 & ipc/shm_psize_40 to a higher value than current.

Run the sappfpar command until these errors vanish.

Post this your sap system should come up.

Hope this helps.

Regards,

Deepak Kori

Former Member
0 Kudos

Dear Deepak Kori

Thanks for Replaying. mentioned below output of sappfpar command.

sapsol:soladm 2> sappfpar check pf=/usr/sap/SOL/SYS/profile/SOL_SCS01_sapsol

================================================================================

== Checking profile: /usr/sap/SOL/SYS/profile/SOL_SCS01_sapsol

================================================================================

***WARNING: Unexpected parameter: SAPFQDN =fccrico.com

***WARNING: Unexpected parameter: enque/snapshot_pck_ids =100

***WARNING: Unexpected parameter: ms/standalone =1

***ERROR: Size of shared memory pool 10 too small

================================================================

SOLUTIONS: (1) Locate shared memory segments outside of pool 10

with parameters like: ipc/shm_psize_<key> =0

SOLUTION: Increase size of shared memory pool 10

with parameter: ipc/shm_psize_10 =136000000

***ERROR: Size of shared memory pool 40 too small

================================================================

SOLUTIONS: (1) Locate shared memory segments outside of pool 40

with parameters like: ipc/shm_psize_<key> =0

SOLUTION: Increase size of shared memory pool 40

with parameter: ipc/shm_psize_40 =112000000

Shared memory disposition overview

================================================================

Shared memory pools

Key: 10 Pool

Size configured.....: 19880000 ( 19.0 MB)

Size min. estimated.: 132539648 ( 126.4 MB)

Advised Size........: 136000000 ( 129.7 MB)

Key: 40 Pool for database buffers

Size configured.....: 14250000 ( 13.6 MB)

Size min. estimated.: 109175040 ( 104.1 MB)

Advised Size........: 112000000 ( 106.8 MB)

Shared memories inside of pool 10

Key: 11 Size: 500000 ( 0.5 MB) Factory calender buffer

Key: 12 Size: 6000000 ( 5.7 MB) TemSe Char-Code convert Buf.

Key: 13 Size: 60500000 ( 57.7 MB) Alert Area

Key: 14 Size: 4400000 ( 4.2 MB) Presentation buffer

Key: 16 Size: 22400 ( 0.0 MB) Semaphore activity monitoring

Key: 17 Size: 11116480 ( 10.6 MB) Roll administration

Shared memories inside of pool 40

Key: 42 Size: 7232992 ( 6.9 MB) DB TTAB buffer

Key: 43 Size: 32534392 ( 31.0 MB) DB FTAB buffer

Key: 44 Size: 7958392 ( 7.6 MB) DB IREC buffer

Key: 45 Size: 4886392 ( 4.7 MB) DB short nametab buffer

Key: 46 Size: 20480 ( 0.0 MB) DB sync table

Key: 47 Size: 3073024 ( 2.9 MB) DB CUA buffer

Key: 48 Size: 500000 ( 0.5 MB) Number range buffer

Key: 49 Size: 2968344 ( 2.8 MB) Spool admin (SpoolWP+DiaWP)

Shared memories outside of pools

Key: 1 Size: 2500 ( 0.0 MB) System administration

Key: 2 Size: 6211228 ( 5.9 MB) Disp. administration tables

Key: 3 Size: 13714400 ( 13.1 MB) Disp. communication areas

Key: 4 Size: 503248 ( 0.5 MB) statistic area

Key: 6 Size: 319488000 ( 304.7 MB) ABAP program buffer

Key: 7 Size: 14838 ( 0.0 MB) Update task administration

Key: 8 Size: 268435556 ( 256.0 MB) Paging buffer

Key: 9 Size: 606208100 ( 578.1 MB) Roll buffer

Key: 18 Size: 3670116 ( 3.5 MB) Paging adminitration

Key: 19 Size: 30000000 ( 28.6 MB) Table-buffer

Key: 30 Size: 3072 ( 0.0 MB) Taskhandler runtime admin.

Key: 31 Size: 1806000 ( 1.7 MB) Dispatcher request queue

Key: 33 Size: 10240000 ( 9.8 MB) Table buffer, part.buffering

Key: 34 Size: 4194304 ( 4.0 MB) Enqueue table

Key: 41 Size: 25010000 ( 23.9 MB) DB statistics buffer

Key: 51 Size: 3200000 ( 3.1 MB) Extended memory admin.

Key: 52 Size: 40000 ( 0.0 MB) Message Server buffer

Key: 54 Size: 4202496 ( 4.0 MB) Export/Import buffer

Key: 55 Size: 8192 ( 0.0 MB) Spool local printer+joblist

Key: 57 Size: 1048576 ( 1.0 MB) Profilparameter in shared mem

Key: 58 Size: 4096 ( 0.0 MB) Enqueue ID for reset

Key: 62 Size: 85983232 ( 82.0 MB) Memory pipes

Key: 63 Size: 409600 ( 0.4 MB) ICMAN shared memory

Key: 64 Size: 4202496 ( 4.0 MB) Online Text Repository Buf.

Key: 65 Size: 4202496 ( 4.0 MB) Export/Import Shared Memory

Key: 1002 Size: 400000 ( 0.4 MB) Performance monitoring V01.0

Key: 58900101 Size: 4096 ( 0.0 MB) SCSA area

Nr of operating system shared memory segments: 29

Shared memory resource requirements estimated

================================================================

Total Nr of shared segments required.....: 29

System-imposed number of shared memories.: 1000

Shared memory segment size required min..: 606208100 ( 578.1 MB)

System-imposed maximum segment size......: 26843545600 (25600.0 MB)

Swap space requirements estimated

================================================

Shared memory....................: 1567.1 MB

..in pool 10 19.0 MB, 666% used !!

..in pool 40 13.6 MB, 766% used !!

..not in pool: 1328.7 MB

Processes........................: 35.7 MB

Extended Memory .................: 6040.0 MB

-


Total, minimum requirement.......: 7642.7 MB

Process local heaps, worst case..: 1907.3 MB

Total, worst case requirement....: 9556.1 MB

Errors detected..................: 2

Warnings detected................: 3

Former Member
0 Kudos

could you provide dev_w0 trace file?

Former Member
0 Kudos

Trace of system startup/check of SAP System SOL on Sun Oct 30 20:38:30 NPT 2011

Start Sap Log

Called command: /usr/sap/SOL/SYS/exe/run/startsap start

Starting Startup Agent sapstartsrv

-


Instance Service on host sapsol started

Starting SAP Instance DVEBMGS00

-


SAP-R/3-Startup Program Rel 701 V1.8 (2003/04/24)

-


Starting at 2011/10/30 20:38:40

Startup Profile: "/usr/sap/SOL/SYS/profile/START_DVEBMGS00_sapsol"

Setup Environment Variables

-


(7220) SETENV LD_LIBRARY_PATH=/usr/sap/SOL/DVEBMGS00/exe:/usr/sap/SOL/DVEBMGS00/exe:/tmp/sapinst_exe.6611.1319986088/jre/lib/amd64/server::/tmp/sapinst_exe.6611.1319986088/jre/lib/amd64::/tmp/sapinst_exe.6611.1319986088:/usr/sap/SOL/SYS/exe/run:/oracle/client/10x_64/instantclient

(7220) SETENV SHLIB_PATH=/usr/sap/SOL/DVEBMGS00/exe:

(7220) SETENV LIBPATH=/usr/sap/SOL/DVEBMGS00/exe:

Execute Pre-Startup Commands

-


(7221) Local: /usr/sap/SOL/SYS/exe/run/sapcpe pf=/usr/sap/SOL/SYS/profile/SOL_DVEBMGS00_sapsol

(7220) system(/usr/sap/SOL/SYS/exe/run/sapcpe pf=/usr/sap/SOL/SYS/profile/SOL_DVEBMGS00_sapsol) returns 4

(7231) Local: /usr/sap/SOL/SYS/exe/run/sapcpe pf=/usr/sap/SOL/SYS/profile/SOL_DVEBMGS00_sapsol list:/usr/sap/SOL/SYS/exe/run/sapcrypto.lst

(7233) Local: /usr/sap/SOL/DVEBMGS00/exe/sapmscsa pf=/usr/sap/SOL/SYS/profile/SOL_DVEBMGS00_sapsol -n

/usr/sap/SOL/DVEBMGS00/exe/sapmscsa: SCSA is attached and useable.

/usr/sap/SOL/DVEBMGS00/exe/sapmscsa: finished.

(7234) Local: rm -f ms.sapSOL_DVEBMGS00

(7235) Local: ln -s -f /usr/sap/SOL/DVEBMGS00/exe/msg_server ms.sapSOL_DVEBMGS00

(7236) Local: rm -f dw.sapSOL_DVEBMGS00

(7237) Local: ln -s -f /usr/sap/SOL/DVEBMGS00/exe/disp+work dw.sapSOL_DVEBMGS00

(7238) Local: rm -f co.sapSOL_DVEBMGS00

(7239) Local: ln -s -f /usr/sap/SOL/DVEBMGS00/exe/rslgcoll co.sapSOL_DVEBMGS00

(7240) Local: rm -f se.sapSOL_DVEBMGS00

(7241) Local: ln -s -f /usr/sap/SOL/DVEBMGS00/exe/rslgsend se.sapSOL_DVEBMGS00

(7242) Local: rm -f ig.sapSOL_DVEBMGS00

(7243) Local: ln -s -f /usr/sap/SOL/DVEBMGS00/exe/igswd_mt ig.sapSOL_DVEBMGS00

Starting Programs

-


30.10.2011 20:38:41

ShmDetach

OK

(7247) Starting: local ms.sapSOL_DVEBMGS00 pf=/usr/sap/SOL/SYS/profile/SOL_DVEBMGS00_sapsol

(7248) Starting: local dw.sapSOL_DVEBMGS00 pf=/usr/sap/SOL/SYS/profile/SOL_DVEBMGS00_sapsol

(7249) Starting: local co.sapSOL_DVEBMGS00 pf=/usr/sap/SOL/SYS/profile/SOL_DVEBMGS00_sapsol -F

(7250) Starting: local se.sapSOL_DVEBMGS00 pf=/usr/sap/SOL/SYS/profile/SOL_DVEBMGS00_sapsol -F

(7251) Starting: local ig.sapSOL_DVEBMGS00 -mode=profile pf=/usr/sap/SOL/SYS/profile/SOL_DVEBMGS00_sapsol

(7220) Waiting for Child Processes to terminate.

Instance on host sapsol started

(7220) **** 2011/10/30 21:10:47 Child 7248 terminated with Status 0 . ****

(7248) **** 2011/10/30 21:10:48 No RestartProgram command for program 1 ****

(7220) **** 2011/10/30 23:17:08 Caught Signal SIGTERM. ****

(7220) **** 2011/10/30 23:17:09 Child 7249 terminated with Status 0 . ****

(7249) **** 2011/10/30 23:17:09 No RestartProgram command for program 2 ****

(7220) **** 2011/10/30 23:17:09 Child 7250 terminated with Status 0 . ****

(7250) **** 2011/10/30 23:17:09 No RestartProgram command for program 3 ****

(7220) **** 2011/10/30 23:17:09 Child 7247 died due to Signal 6 (core dumped). ****

(7247) **** 2011/10/30 23:17:09 No RestartProgram command for program 0 ****

(7220) **** 2011/10/30 23:17:09 Child 7251 died due to Signal 6 (core dumped). ****

(7251) **** 2011/10/30 23:17:09 No RestartProgram command for program 4 ****

(7220) **** No more Child Processes to wait for.

(7220) Parent Shutdown at 2011/10/30 23:17:09

Execute Post-Shutdown Commands

-


30.10.2011 23:17:10

ShmDetach

FAIL: NIECONN_REFUSED (Network is unreachable), NiRawConnect failed in plugin_fopen()

(7220) Exiting with Return-Code 3. (No more child processes)

former_member188883
Active Contributor
0 Kudos

Hi,

Can you paste the output of sappfpar command.

Login with <sid>adm

sappfpar check pf=<path of instance profile>

Regards,

Deepak Kori

Former Member
0 Kudos

trc file: "dev_ms", trc level: 1, release: "701"

-


[Thr 47608620124224] Sun Oct 30 20:38:41 2011

[Thr 47608620124224] MsSSetTrcLog: trc logging active, max size = 20971520 bytes

systemid 390 (AMD/Intel x86_64 with Linux)

relno 7010

patchlevel 0

patchno 135

intno 20020600

make: multithreaded, Unicode, 64 bit, optimized

pid 7247

[Thr 47608620124224] ***LOG Q01=> MsSInit, MSStart (Msg Server 1 7247) [msxxserv_mt. 1853]

[Thr 47608620124224] SigISetDefaultAction : default handling for signal 17

[Thr 47608620124224] load acl file = /usr/sap/SOL/SYS/global/ms_acl_info

[Thr 47608620124224] MsGetOwnIpAddr: my host addresses are :

[Thr 47608620124224] 1 : [192.168.0.109] sapsol.fccrico.com (HOSTNAME)

[Thr 47608620124224] 2 : [127.0.0.1] localhost.localdomain (LOCALHOST)

[Thr 47608620124224] MsHttpInit: full qualified hostname = sapsol.fccrico.com

[Thr 47608620124224] HTTP logging is switch off

[Thr 47608620124224] set HTTP state to LISTEN

[Thr 47608620124224] MsHttpOwnDomain: own domain[1] = fccrico.com

[Thr 47608620124224] ms/icf_info_server : deleted

[Thr 47608620124224] *** I listen to port sapmsSOL (3600) ***

[Thr 47608620124224] *** I listen to internal port 3900 (3900) ***

[Thr 47608620124224] *** HTTP port 8100 state LISTEN ***

[Thr 47608620124224] CUSTOMER KEY: >C0361703344<

[Thr 47608620124224] build version=701.2009.12.02

[Thr 47608620124224] Sun Oct 30 21:10:42 2011

[Thr 47608620124224] *** ERROR => MsSClientHandle: no server provides service ENQ (4), requested from sapsol_SOL_00 [msxxserv_mt. 4731]

[Thr 47608620124224] Sun Oct 30 21:20:23 2011

[Thr 47608620124224] *** ERROR => MsSCheckConnections: no response from client C1 (127.0.0.1) after 300 secs received [msxxserv_mt. 3217]

[Thr 47608620124224] *** ERROR => MsSCheckConnections: disconnect now [127.0.0.1] [msxxserv_mt. 3221]

Former Member
0 Kudos

log of Dev_Disp

Sun Oct 30 20:38:42 2011

kernel runs with dp version 245000(ext=110000) (@(#) DPLIB-INT-VERSION-245000-UC)

length of sys_adm_ext is 576 bytes

      • SWITCH TRC-HIDE on ***

***LOG Q00=> DpSapEnvInit, DPStart (00 7248) [dpxxdisp.c 1292]

shared lib "dw_xml.so" version 137 successfully loaded

shared lib "dw_xtc.so" version 137 successfully loaded

shared lib "dw_stl.so" version 137 successfully loaded

shared lib "dw_gui.so" version 137 successfully loaded

shared lib "dw_mdm.so" version 137 successfully loaded

rdisp/softcancel_sequence : -> 0,5,-1

use internal message server connection to port 3900

MtxInit: 30000 0 0

DpSysAdmExtInit: ABAP is active

DpSysAdmExtInit: VMC (JAVA VM in WP) is not active

DpIPCInit2: start server >sapsol_SOL_00 <

DpShMCreate: sizeof(wp_adm) 29784 (1752)

DpShMCreate: sizeof(tm_adm) 6009216 (29896)

DpShMCreate: sizeof(wp_ca_adm) 28800 (96)

DpShMCreate: sizeof(appc_ca_adm) 9600 (96)

DpCommTableSize: max/headSize/ftSize/tableSize=500/8/548056/548064

DpShMCreate: sizeof(comm_adm) 548064 (1088)

DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0

DpShMCreate: sizeof(slock_adm) 0 (104)

DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0

DpShMCreate: sizeof(file_adm) 0 (72)

DpShMCreate: sizeof(vmc_adm) 0 (2008)

DpShMCreate: sizeof(wall_adm) (40056/36728/80/192)

DpShMCreate: sizeof(gw_adm) 48

DpShMCreate: SHM_DP_ADM_KEY (addr: 0x2b42e1da3000, size: 6711656)

DpShMCreate: allocated sys_adm at 0x2b42e1da3000

DpShMCreate: allocated wp_adm at 0x2b42e1da5350

DpShMCreate: allocated tm_adm_list at 0x2b42e1dac7a8

DpShMCreate: allocated tm_adm at 0x2b42e1dac808

DpShMCreate: allocated wp_ca_adm at 0x2b42e2367988

DpShMCreate: allocated appc_ca_adm at 0x2b42e236ea08

DpShMCreate: allocated comm_adm at 0x2b42e2370f88

DpShMCreate: system runs without slock table

DpShMCreate: system runs without file table

DpShMCreate: allocated vmc_adm_list at 0x2b42e23f6c68

DpShMCreate: allocated gw_adm at 0x2b42e23f6ce8

DpShMCreate: system runs without vmc_adm

DpShMCreate: allocated ca_info at 0x2b42e23f6d18

DpShMCreate: allocated wall_adm at 0x2b42e23f6d28

MBUF state OFF

DpCommInitTable: init table for 500 entries

DpRqQInit: Parameter rdisp/queue_lock_level = 2

rdisp/queue_size_check_value : -> on,50,30,40,500,50,500,80

ThTaskStatus: rdisp/reset_online_during_debug 0

EmInit: MmSetImplementation( 2 ).

MM global diagnostic options set: 0

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 4096 kByte.

Using implementation map

<EsMap> EsMapUnamFileMapInit: Initialize the memory 1944 MB

Linux: Kernel supports shared memory disclaiming

Linux: using madvise(<pointer>, <size>, 9).

Linux: disclaiming for shared memory enabled

<ES> 485 blocks reserved for free list.

ES initialized.

mm.dump: set maximum dump mem to 96 MB

Sun Oct 30 20:39:00 2011

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1687]

***LOG Q0K=> DpMsAttach, mscon ( sapsol) [dpxxdisp.c 12759]

DpStartStopMsg: send start message (myname is >sapsol_SOL_00 <)

DpStartStopMsg: start msg sent

Warning: tmpfs at /dev/shm is configured quite small with 1960 MB!

Minimum value is 8192 MB.

Recommended size is 75 % of RAM + swap.

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

DpMsgAdmin: Set release to 7010, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1048]

DpMsgAdmin: Set patchno for this platform to 137

Release check o.K.

Sun Oct 30 20:55:05 2011

      • ERROR => DpWPCheck: W0 (pid 7257) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7257) killed with signal 6

Sun Oct 30 20:55:39 2011

      • ERROR => DpWPCheck: W4 (pid 7266) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7266) killed with signal 6

my types changed after wp death/restart 0xbf --> 0x9f

      • ERROR => DpWPCheck: W2 (pid 7262) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7262) killed with signal 6

      • ERROR => DpWPCheck: W4 (pid 7266) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W6 (pid 7288) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7288) killed with signal 6

      • ERROR => DpWPCheck: W8 (pid 7290) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7290) killed with signal 6

      • ERROR => DpWPCheck: W16 (pid 7327) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7327) killed with signal 6

Sun Oct 30 20:57:52 2011

      • ERROR => DpWPCheck: W1 (pid 7258) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W2 (pid 7262) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W4 (pid 7266) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W6 (pid 7288) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W8 (pid 7290) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W16 (pid 7327) died (severity=0, status=0) [dpxxdisp.c 15932]

Sun Oct 30 20:58:12 2011

      • ERROR => DpWPCheck: W1 (pid 7258) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W2 (pid 7262) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W4 (pid 7266) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W6 (pid 7288) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W8 (pid 7290) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W16 (pid 7327) died (severity=0, status=0) [dpxxdisp.c 15932]

Sun Oct 30 20:58:32 2011

      • ERROR => DpWPCheck: W1 (pid 7258) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W2 (pid 7262) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W4 (pid 7266) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W6 (pid 7288) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W8 (pid 7290) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W16 (pid 7327) died (severity=0, status=0) [dpxxdisp.c 15932]

Sun Oct 30 20:58:52 2011

      • ERROR => DpWPCheck: W1 (pid 7258) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W2 (pid 7262) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W4 (pid 7266) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W6 (pid 7288) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W8 (pid 7290) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W16 (pid 7327) died (severity=0, status=0) [dpxxdisp.c 15932]

Sun Oct 30 20:59:12 2011

      • ERROR => DpWPCheck: W1 (pid 7258) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W2 (pid 7262) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W4 (pid 7266) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W6 (pid 7288) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W8 (pid 7290) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W16 (pid 7327) died (severity=0, status=0) [dpxxdisp.c 15932]

Sun Oct 30 20:59:32 2011

      • ERROR => DpWPCheck: W1 (pid 7258) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W2 (pid 7262) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W4 (pid 7266) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W6 (pid 7288) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W8 (pid 7290) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W16 (pid 7327) died (severity=0, status=0) [dpxxdisp.c 15932]

Sun Oct 30 20:59:52 2011

      • ERROR => DpWPCheck: W1 (pid 7258) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W2 (pid 7262) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W4 (pid 7266) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W6 (pid 7288) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W8 (pid 7290) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W16 (pid 7327) died (severity=0, status=0) [dpxxdisp.c 15932]

Sun Oct 30 21:00:12 2011

      • ERROR => DpWPCheck: W1 (pid 7258) died (severity=0, status=0) [dpxxdisp.c 15932]

my types changed after wp death/restart 0x9f --> 0xbf

      • ERROR => DpWPCheck: W2 (pid 7262) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W4 (pid 7266) died (severity=0, status=0) [dpxxdisp.c 15932]

      • ERROR => DpWPCheck: W6 (pid 7288) died (severity=0, status=0) [dpxxdisp.c 15932]

Sun Oct 30 21:00:13 2011

      • ERROR => DpWPCheck: W8 (pid 7290) died (severity=0, status=0) [dpxxdisp.c 15932]

Sun Oct 30 21:00:16 2011

      • ERROR => DpWPCheck: W16 (pid 7327) died (severity=0, status=0) [dpxxdisp.c 15932]

Sun Oct 30 21:10:14 2011

      • ERROR => DpWPCheck: W0 (pid 7560) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7560) killed with signal 6

my types changed after wp death/restart 0xbf --> 0x80

      • ERROR => DpWPCheck: W1 (pid 7620) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7620) killed with signal 6

      • ERROR => DpWPCheck: W2 (pid 7621) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7621) killed with signal 6

      • ERROR => DpWPCheck: W3 (pid 7561) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7561) killed with signal 6

      • ERROR => DpWPCheck: W4 (pid 7622) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7622) killed with signal 6

      • ERROR => DpWPCheck: W5 (pid 7562) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7562) killed with signal 6

      • ERROR => DpWPCheck: W6 (pid 7623) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7623) killed with signal 6

      • ERROR => DpWPCheck: W7 (pid 7563) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7563) killed with signal 6

      • ERROR => DpWPCheck: W8 (pid 7624) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7624) killed with signal 6

      • ERROR => DpWPCheck: W9 (pid 7564) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7564) killed with signal 6

      • ERROR => DpWPCheck: W10 (pid 7565) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7565) killed with signal 6

      • ERROR => DpWPCheck: W11 (pid 7566) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7566) killed with signal 6

      • ERROR => DpWPCheck: W12 (pid 7567) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7567) killed with signal 6

      • ERROR => DpWPCheck: W13 (pid 7568) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7568) killed with signal 6

      • ERROR => DpWPCheck: W14 (pid 7569) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7569) killed with signal 6

      • ERROR => DpWPCheck: W15 (pid 7570) died (severity=1, status=134) [dpxxdisp.c 15932]

child (pid=7570) killed with signal 6

      • ERROR => DpWPCheck: W16 (pid 7626) died (severity=1, status=134) [dpxxdisp.c 15932]