Signal 4 received by operating system

[Former Member]

We recently upgraded to Oracle 10.2 on HP-UX last weekend [SAP 4.7EE Ext110] and since then we did not see this message but today we see a tons of this messages and the work processes re-starting ...its the PRD server..please advise.

One of the work log files info :

Due to special circumstances (for example, storage overwritten), the

current process has received a signal from the operating system and

its signal handling routine has been invoked. For security reasons

this process is terminated. A dump is written which shows the error

context.

=================================================

=== SSF INITIALIZATION:

===...SSF Security Toolkit name SAPSECULIB .

===...SSF trace level is 0 .

===...SSF library is /usr/sap/PRD/SYS/exe/run/libsapsecu.sl .

===...SSF hash algorithm is SHA1 .

===...SSF symmetric encryption algorithm is DES-CBC .

===...sucessfully completed.

=================================================

MskiInitLogonTicketCacheHandle: Logon Ticket cache pointer retrieved from shared memory.

MskiInitLogonTicketCacheHandle: Workprocess runs with Logon Ticket cache.

=================================================

=== ipl_Init() called

ITSP Running against db release 620!

ITSP Disable Kernel Web GUI functionality

=== ipl_Init() returns 2, ITSPE_DISABLED: Service is disabled (sapparam)

=================================================

ThCheckPrevUser: clean previous user T58/U2200/M0/I0

[markus_doehr2]

Signal 4 is "SIGILL".

Check ST22 if you get a dump or post the workprocess trace (dev_w...) containing the stacktrace.

Markus

[Former Member]

---

trc file: "dev_w0", trc level: 1, release: "640"

-

---

*

• ACTIVE TRACE LEVEL 1

• ACTIVE TRACE COMPONENTS all, M

*

M sysno 00

M sid PRD

M systemid 273 (HP/9000 (PA-RISC) with HP-UX)

M relno 6400

M patchlevel 0

M patchno 196

M intno 20020600

M make: single threaded, Unicode, 64 bit

M pid 13565

M

M

M Wed Jul 16 20:20:50 2008

M ***LOG Q01=> tskh_init, WPStart (Workproc 0 1 13565) [thxxhead.c 1142]

M calling db_connect ...

C Got ORACLE_HOME=/oracle/PRD/920_64 from environment

C got NLS_LANG='AMERICAN_AMERICA.UTF8' from environment

C Client NLS settings: AMERICAN_AMERICA.UTF8

C Logon as OPS$-user to get SAPDAT's password

C Connecting as /@PRD on connection 0 (nls_hdl 0) ... (dbsl 640 250407)

C Nls CharacterSet NationalCharSet C EnvHp ErrHp ErrHpBatch

C 0 UTF8 1 0x8000000103c47d10 0x8000000103c5a7c0 0x8000000103c5a158

C Attaching to DB Server PRD (con_hdl=0,svchp=0x8000000103c5a088,srvhp=0x8000000103c5c8b8)

C

C Wed Jul 16 20:20:51 2008

C Starting user session (con_hdl=0,svchp=0x8000000103c5a088,srvhp=0x8000000103c5c8b8,usrhp=0x8000000103c65ae8)

C Now '/@PRD' is connected (con_hdl 0, nls_hdl 0).

C Got SAPDAT's password from OPS$-user

C Disconnecting from connection 0 ...

C Close user session (con_hdl=0,svchp=0x8000000103c5a088,usrhp=0x8000000103c65ae8)

C Now I'm disconnected from ORACLE

C Connecting as SAPDAT/<pwd>@PRD on connection 0 (nls_hdl 0) ... (dbsl 640 250407)

C Nls CharacterSet NationalCharSet C EnvHp ErrHp ErrHpBatch

C 0 UTF8 1 0x8000000103c47d10 0x8000000103c5a7c0 0x8000000103c5a158

C Starting user session (con_hdl=0,svchp=0x8000000103c5a088,srvhp=0x8000000103c5c8b8,usrhp=0x8000000103c65ae8)

C Now 'SAPDAT/<pwd>@PRD' is connected (con_hdl 0, nls_hdl 0).

C Database NLS settings: AMERICAN_AMERICA.UTF8

C DB instance PRD is running on gpdb20a with ORACLE version 10.2.0.2.0 since JUL 16, 2008, 20:06:22

B Connection 0 opened (DBSL handle 0)

B Wp Hdl ConName ConId ConState TX PRM RCT TIM MAX OPT Date Time DBHost

B 000 000 R/3 000000000 ACTIVE NO YES NO 000 255 255 20080716 202050 gpdb20a

M db_connect o.k.

M ICT: exclude compression: .zip,.cs,.rar,.arj,.z,.gz,.tar,.lzh,.cab,.hqx,.ace,.jar,.ear,.war,.css,.pdf,.js,.gzip

I MtxInit: 0 0 0

M SHM_PRES_BUF (addr: 0xc0000001d4000000, size: 39000000)

M SHM_ROLL_AREA (addr: 0xc0000001d7000000, size: 204800000)

M SHM_PAGING_AREA (addr: 0xc0000001e4000000, size: 80527360)

M SHM_ROLL_ADM (addr: 0xc000000004900000, size: 2672386)

M SHM_PAGING_ADM (addr: 0xc000000001040000, size: 656416)

M ThCreateNoBuffer allocated 560152 bytes for 1000 entries at 0xc0000001e9002000

M ThCreateNoBuffer index size: 3000 elems

M ThCreateVBAdm allocated 12176 bytes (50 server) at 0xc00000000007a000

X EmInit: MmSetImplementation( 2 ).

X <ES> client 0 initializing ....

X Using implementation std

X <ES> Info: use shared memory<ES> Info: use mprotect

X ES initialized.

B

B Wed Jul 16 20:20:52 2008

B db_con_shm_ini: WP_ID = 0, WP_CNT = 45, CON_ID = -1

B

B Wed Jul 16 20:20:53 2008

B dbtbxbuf: Buffer TABL (addr: 0xc0000001f7000100, size: 175760000, end: 0xc00000020179e380)

B dbtbxbuf: Profile: max_objects = 20000, displace = 1, reorg = 1

B dbtbxbuf: request_unit = 2000, sync_reload = 5, inval_reload = 5

B dbtbxbuf: protect_shm = 0, force_checks = 0

B dbtbxbuf: tsize_retry = 84677120

B ***LOG BB0=> buffer TABL started with length 175760000 bytes [dbtbxbuf#8 @ 16037] [dbtbxbuf1603 7]

B dbtbxbuf: Buffer TABLP (addr: 0xc000000202000100, size: 61440000, end: 0xc000000205a98100)

B dbtbxbuf: Profile: max_objects = 500, displace = 1, reorg = 1

B dbtbxbuf: request_unit = 2000, sync_reload = 5, inval_reload = 5

B dbtbxbuf: protect_shm = 0, force_checks = 0

B dbtbxbuf: tsize_retry = 30614016

B ***LOG BB0=> buffer TABLP started with length 61440000 bytes [dbtbxbuf#8 @ 16037] [dbtbxbuf1603 7]

B dbtbxbuf: Reading TBX statistics:

B dbtbxbuf: 149 object entries precreated

B Layout of EIBUF buffer shared memory:

B 0: 1 * 4 = 4

B 1: 1 * 464 = 464

B 2: 45 * 40 = 1800

B 3: 50021 * 64 = 3201344

B 4: 25000 * 256 = 6400000

B 5: 50021 * 8 = 400168

B 6: 1 * 200 = 200

B 7: 65 * 8 = 520

B 8: 160919 * 256 = 41195264

B Tracing = 0, Shm Protection = 0, Force checks = 0, Recovery delay = 500000

B

B Wed Jul 16 20:20:54 2008

B dbexpbuf: Buffer EIBUF (addr: 0xc000000206000108, size: 51200000, end: 0xc0000002090d4108)

B ***LOG BB0=> buffer EIBUF started with length 50000k bytes [dbexpbuf#6 @ 2341] [dbexpbuf2341 ]

B Layout of ESM buffer shared memory:

B 0: 1 * 4 = 4

B 1: 1 * 464 = 464

B 2: 45 * 40 = 1800

B 3: 4001 * 64 = 256064

B 4: 2000 * 256 = 512000

B 5: 4001 * 8 = 32008

B 6: 1 * 200 = 200

B 7: 65 * 8 = 520

B 8: 13247 * 256 = 3391232

B Tracing = 0, Shm Protection = 0, Force checks = 0, Recovery delay = 500000

B dbexpbuf: Buffer ESM (addr: 0xc0000001d6800108, size: 4194304, end: 0xc0000001d6c00108)

B ***LOG BB0=> buffer ESM started with length 4096k bytes [dbexpbuf#6 @ 2341] [dbexpbuf2341 ]

B Layout of CUA buffer shared memory:

B 0: 1 * 4 = 4

B 1: 1 * 464 = 464

B 2: 45 * 40 = 1800

B 3: 20011 * 64 = 1280704

B 4: 10000 * 256 = 2560000

B 5: 20011 * 8 = 160088

B 6: 1 * 200 = 200

B 7: 193 * 8 = 1544

B 8: 32178 * 512 = 16475136

B Tracing = 0, Shm Protection = 0, Force checks = 0, Recovery delay = 500000

B dbexpbuf: Buffer CUA (addr: 0xc0000001efbbd108, size: 20480000, end: 0xc0000001f0f45108)

B ***LOG BB0=> buffer CUA started with length 20000k bytes [dbexpbuf#6 @ 2341] [dbexpbuf2341 ]

B Layout of OTR buffer shared memory:

B 0: 1 * 4 = 4

B 1: 1 * 464 = 464

B 2: 45 * 40 = 1800

B 3: 4001 * 64 = 256064

B 4: 2000 * 256 = 512000

B 5: 4001 * 8 = 32008

B 6: 1 * 200 = 200

B 7: 81 * 8 = 648

B 8: 13246 * 256 = 3390976

B Tracing = 0, Shm Protection = 0, Force checks = 0, Recovery delay = 500000

B dbexpbuf: Buffer OTR (addr: 0xc0000001e3400108, size: 4194304, end: 0xc0000001e3800108)

B ***LOG BB0=> buffer OTR started with length 4096k bytes [dbexpbuf#6 @ 2341] [dbexpbuf2341 ]

B ***LOG BB0=> buffer CALE started with length 500000 bytes [dbcalbuf#5 @ 2273] [dbcalbuf2273 ]

B dbtran INFO (init_connection '<DEFAULT>' [ORACLE:640.00]):

B max_blocking_factor = 5, max_in_blocking_factor = 20,

B min_blocking_factor = 5, min_in_blocking_factor = 5,

B prefer_union_all = 0, prefer_union_for_select_all = 0,

B prefer_fix_blocking = 0, prefer_in_itab_opt = 1,

B convert AVG = 0, alias table FUPD = 0,

B escape_as_literal = 1, opt GE LE to BETWEEN = 0,

B select * =0x0f, character encoding = STD / <none>:-,

B use_hints = abap->1, dbif->0x1, upto->1000, rule_in->0,

B rule_fae->0, concat_fae->0, concat_fae_or->0

M

M Wed Jul 16 20:20:56 2008

M PfHIndInitialize: memory=<0xc0000000022c3728>, header=<0xc0000000022c3728>, records=<0xc0000000022c3770>

M SecAudit(RsauInit): Start init of Security Audit Log for first wp.

M SecAudit(RsauInit): Shared memory for Security Audit Log already exists.

M SecAudit(RsauInit): Re-initialize with new profile parameters

M *** ERROR => SecAudit(RsauShmInit): parameter too small rsau/max_diskspace/local; replaced [rsauwr1.c 2680]

M SecAudit(RsauShmInit): SCSA size................ = 4096

M SecAudit(RsauShmInit): addr of SCSA............. = 0xc00000000004e000

M SecAudit(RsauShmInit): addr of RSAUSHM.......... = 0xc00000000004e768

M SecAudit(RsauShmInit): addr of RSAUSLOTINFO..... = 0xc00000000004e7a0

M SecAudit(RsauShmInit): addr of RSAUSLOTS........ = 0xc00000000004e7ac

M SecAudit(RsauShmInit): SHM version.............. = 5

M SecAudit(RsauShmInit): SHM Slot version......... = 2

M SecAudit(RsauShmInit): RSAU active.............. = 1

M SecAudit(RsauShmInit): number of slots possible. = 10

M SecAudit(RsauShmInit): number of slots requested = 4

M SecAudit(RsauShmInit): number of slots used..... = 4

M SecAudit(RsauShmInit): user selection........... = 0

M SecAudit(RsauShmInit): max size of one file..... = 0 KB

M SecAudit(RsauShmInit): max size of all files.... = 102400 KB

M SecAudit(RsauGetCurrentProfile): active audit profile PROD1

M SecAudit(RsauGetCurrentProfile): Init of shared memory completed

M ***LOG AV6=> 04& [rsauprof.c 224]

M SecAudit(check_daily_file): audit file opened /usr/sap/log00/audit_20080716

M SsfSapSecin: automatic application server initialization for SAPSECULIB

N SsfSapSecin: Looking for PSE in database

N SsfPseLoad: started...(path=/usr/sap/PRD/D00/sec, AS=gpap25, instanceid=00)

N SsfPseLoad: Downloading file /usr/sap/PRD/D00/sec/SAPSYS.pse (client: , key: SYSPSE, len: 1584)

N SsfPseLoad: ended (1 of 1 sucessfully loaded, 1 checked...

N MskiCreateLogonTicketCache: Logon Ticket cache created in shared memory.

N MskiCreateLogonTicketCache: Logon Ticket cache pointer registered in shared memory.

M rdisp/reinitialize_code_page -> 0

M icm/accept_remote_trace_level -> 0

M rdisp/no_hooks_for_sqlbreak -> 0

M CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

M CCMS: AlMsUpload called by wp 0.

M

M Wed Jul 16 20:20:58 2008

M CCMS: AlMsUpload successful for /usr/sap/PRD/D00/log/ALMTTREE (445 MTEs).

S

S Wed Jul 16 20:21:19 2008

S *** init spool environment

S initialize debug system

T Stack direction is upwards.

T debug control: prepare exclude for printer trace

T new memory block 0x8000000104022160

S spool kernel/ddic check: Ok

S using table TSP02FX for frontend printing

S 5 spool work process(es) found

S frontend print via spool service enabled

S printer list size is 999

S printer type list size is 50

S queue size (profile) = 999

S hostspool list size = 9990

S option list size is 30

S found processing queue enabled

S found spool memory service RSPO-RCLOCKS at 0xc0000001f0f47070

S doing lock recovery

S setting server cache root

S found spool memory service RSPO-SERVERCACHE at 0xc0000001f0f48040

S using messages for server info

S size of spec char cache entry: 297032 bytes (timeout 100 sec)

S size of open spool request entry: 2272 bytes

S immediate print option for implicitely closed spool requests is disabled

A

A -PXA--

---

A PXA INITIALIZATION

A System page size: 4kb, total admin_size: 35440kb, dir_size: 17632kb.

A Attached to PXA (address 0xc000000019ada000, size 800000K, 2 fragments of 382280K )

A abap/pxa = shared unprotect gen_remote

A PXA INITIALIZATION FINISHED

A -PXA--

---

A

A ABAP ShmAdm attached (addr=0xc000000054247000 leng=20955136 end=0xc000000055643000)

A >> Shm MMADM area (addr=0xc00000005473f220 leng=242176 end=0xc00000005477a420)

A >> Shm MMDAT area (addr=0xc00000005477b000 leng=15499264 end=0xc000000055643000)

A RFC Destination> destination gpap25_PRD_00 host gpap25 system PRD systnr 0 (gpap25_PRD_00)

A RFC Options> H=gpap25,S=00,d=2

A RFC FRFC> fallback activ but this is not a central instance.

A

A RFC rfc/signon_error_log = -1

A RFC rfc/dump_connection_info = 0

A RFC rfc/dump_client_info = 0

A RFC rfc/cp_convert/ignore_error = 1

A RFC rfc/cp_convert/conversion_char = 23

A RFC rfc/wan_compress/threshold = 251

A RFC rfc/recorder_pcs not set, use defaule value: 2

A RFC rfc/delta_trc_level not set, use default value: 0

A RFC rfc/no_uuid_check not set, use default value: 0

A RFC abap/SIGCHILD_default not set, use default value: 0

A RFC rfc/bc_ignore_thcmaccp_retcode not set, use default value: 0

A RFC Method> initialize RemObjDriver for ABAP Objects

M ThrCreateShObjects allocated 93538 bytes at 0xc0000000002b0000

N SsfSapSecin: putenv(SECUDIR=/usr/sap/PRD/D00/sec): ok

N SsfSapSecin: PSE /usr/sap/PRD/D00/sec/SAPSYS.pse found!

N === SSF INITIALIZATION:

N ===...SSF Security Toolkit name SAPSECULIB .

N ===...SSF trace level is 0 .

N ===...SSF library is /usr/sap/PRD/SYS/exe/run/libsapsecu.sl .

N ===...SSF hash algorithm is SHA1 .

N ===...SSF symmetric encryption algorithm is DES-CBC .

N ===...sucessfully completed.

N MskiInitLogonTicketCacheHandle: Logon Ticket cache pointer retrieved from shared memory.

N MskiInitLogonTicketCacheHandle: Workprocess runs with Logon Ticket cache.

W === ipl_Init() called

W ITSP Running against db release 620!

W ITSP Disable Kernel Web GUI functionality

W === ipl_Init() returns 2, ITSPE_DISABLED: Service is disabled (sapparam)

S

S Wed Jul 16 20:21:37 2008

S server gpap21_PRD_01 appears or changes (state 5)

S server gpap23_PRD_01 appears or changes (state 5)

S server gpap23_PRD_01 appears or changes (state 1)

S

S Wed Jul 16 20:21:44 2008

S server gpap24_PRD_01 appears or changes (state 5)

S

S Wed Jul 16 20:21:45 2008

S server gpap24_PRD_01 appears or changes (state 1)

N

N Wed Jul 16 20:22:01 2008

N login/password_change_for_SSO : 1 -> 1

B

B Wed Jul 16 20:26:03 2008

B dbmyclu : info : my major identification is 3300766469, minor one 0.

B dbmyclu : info : Time Reference is 1.12.2001 00:00:00h GMT.

B dbmyclu : info : my uuid is 487E9EC49E9C34FDE0000060B0581BED.

B dbmyclu : info : current optimistic cluster level: 0

B dbmyclu : info : pessimistic reads set to 2.

S

S Wed Jul 16 20:31:38 2008

S found spool memory service RSPO-ACTIONS at 0xc0000001f0f50488

M

M Wed Jul 16 20:58:17 2008

M ThIUsrDel: th_rollback_usrdelentry = 1

S

S Wed Jul 16 23:36:02 2008

S handle memory type is RSTSPROMMM

M

M Thu Jul 17 00:02:20 2008

M SecAudit(check_daily_file): audit file closed /usr/sap/log00/audit_20080716

M SecAudit(check_daily_file): audit file opened /usr/sap/log00/audit_20080717

C

C Thu Jul 17 03:02:39 2008

C User requested cancel of current SQL on connection 0

M program canceled

M reason = soft cancel

M user = MERTSNX

M client = 900

M terminal = AVDNL5PCN34

M report = ZIVORDLS

C SQL cancelled; calling registered function at 0x4000000000bb8468

M program canceled

M reason = soft cancel

M user = MERTSNX

M client = 900

M terminal = AVDNL5PCN34

M report = ZIVORDLS

M

M Thu Jul 17 07:17:18 2008

M *** WARNING => ThAdXDelUser: delete T58

M ThDelForMode(T58, M0, end_conv=1, errno=61)

M ***LOG R47=> ThResFree, delete (003061) [thxxmode.c 1305]

C

C Thu Jul 17 07:55:22 2008

C User requested cancel of current SQL on connection 0

M program canceled

M reason = soft cancel

M user = MUIJRMX1

M client = 900

M terminal = AVDNL5PCD31

M report = RM07DOCS

C SQL cancelled; calling registered function at 0x4000000000bb8468

M program canceled

M reason = soft cancel

M user = MUIJRMX1

M client = 900

M terminal = AVDNL5PCD31

M report = RM07DOCS

B

B Thu Jul 17 09:18:39 2008

B table logging switched on for all clients

D

D Thu Jul 17 10:05:43 2008

D *** ERROR => column nr 4 missing [diagotab.c 2513]

D *** ERROR => check table control TC_MSEL_ZUORD [diagotab.c 2514]

D *** ERROR => on dynpro SAPLMR1M 6221 [diagotab.c 2515]

D

D Thu Jul 17 10:06:39 2008

D *** ERROR => column nr 4 missing [diagotab.c 2513]

D *** ERROR => check table control TC_MSEL_ZUORD [diagotab.c 2514]

D *** ERROR => on dynpro SAPLMR1M 6221 [diagotab.c 2515]

D *** ERROR => column nr 4 missing [diagotab.c 2513]

D *** ERROR => check table control TC_MSEL_ZUORD [diagotab.c 2514]

D *** ERROR => on dynpro SAPLMR1M 6221 [diagotab.c 2515]

D

D Thu Jul 17 10:06:41 2008

D *** ERROR => column nr 4 missing [diagotab.c 2513]

D *** ERROR => check table control TC_MSEL_ZUORD [diagotab.c 2514]

D *** ERROR => on dynpro SAPLMR1M 6221 [diagotab.c 2515]

T

T Thu Jul 17 11:23:53 2008

T new memory block 0x8000000104bf0710

M

M Thu Jul 17 11:43:13 2008

M *** WARNING => PfSetGuiTime: gui time too large, discard (gui=350077/resptime=5)

[Former Member]

could you please post work process log details

Regards

George