cancel
Showing results for 
Search instead for 
Did you mean: 

Two MaxDB crashes in the last 5 days, how can I find the reason ?

Former Member
0 Kudos

Hello,

My MaxDB-Server crashed two times in the last 5 days and I have no idea why. Can you help me to find the reason for the crashes ? My MaxDB 7.6.05 is running on a Linux server and I never had such problems before.

Here are some lines from the knldiag.err file:

First crash:

2009-01-09 15:02:05 0 ERR 11330 COREHAND ABORTING due to signal 11

2009-01-09 15:02:05 0 ERR 11599 BTRACE -


> Emergency Stack Back Trace <----

2009-01-09 15:02:05 0 ERR 11599 BTRACE -


> Register Dump <----

2009-01-09 15:02:05 0 ERR 11599 BTRACE -


2009-01-09 15:02:05 0 ERR 11599 BTRACE ds es 0x6409007b 0x0000007b

2009-01-09 15:02:05 0 ERR 11599 BTRACE fs gs 0xc0100000 0x00000033

2009-01-09 15:02:05 0 ERR 11599 BTRACE trap err 0x0000000e 0x00000014

2009-01-09 15:02:05 0 ERR 11599 BTRACE efl ss 0x00010216 0x0000007b

2009-01-09 15:02:05 0 ERR 11599 BTRACE edi esi 0xb7bbe3e0 0x50042938

2009-01-09 15:02:05 0 ERR 11599 BTRACE eax ebx 0x00000001

2009-01-09 15:02:05 0 ERR 11599 BTRACE ecx edx 0xb7bbe3e0

2009-01-09 15:02:05 0 ERR 11599 BTRACE esp uesp 0x6421defc 0x6421defc

2009-01-09 15:02:05 0 ERR 11599 BTRACE ebp eip 0x0121df84 0x00000000

2009-01-09 15:02:05 0 ERR 11599 BTRACE cs cr2 0x00000073 0x00000000

2009-01-09 15:02:05 0 ERR 11599 BTRACE -


2009-01-09 15:02:05 0 ERR 11599 BTRACE cw - sw - tag 0xffff037f 0xffff0020 0xffffffff

2009-01-09 15:02:05 0 ERR 11599 BTRACE ipoff - cssel 0xb7e1a284 0x077d0073

2009-01-09 15:02:05 0 ERR 11599 BTRACE dataoff-datasel 0x6421dd7c 0x0000007b

2009-01-09 15:02:05 0 ERR 11599 BTRACE f00 [0x3c00 0x5821 0xf70a 0x91c1 - 0x4008]

2009-01-09 15:02:05 0 ERR 11599 BTRACE f01 [0x3c00 0x5821 0xf70a 0x9201 - 0x4008]

2009-01-09 15:02:05 0 ERR 11599 BTRACE f02 [0x0000 0x0000 0x0000 0xb600 - 0x4006]

2009-01-09 15:02:05 0 ERR 11599 BTRACE f03 [0x435e 0x0d79 0x35e5 0xd794 - 0x3ff9]

2009-01-09 15:02:05 0 ERR 11599 BTRACE f04 [0x435e 0x0d79 0x35e5 0xd794 - 0x3ff9]

2009-01-09 15:02:05 0 ERR 11599 BTRACE f05 [0x0000 0x0000 0x0000 0x8000 - 0x3fff]

2009-01-09 15:02:05 0 ERR 11599 BTRACE f06 [0x0000 0x0000 0x0000 0xdcc0 - 0xc028]

2009-01-09 15:02:05 0 ERR 11599 BTRACE f07 [0x0000 0x5720 0x77d2 0xc691 - 0x401e]

2009-01-09 15:02:05 0 ERR 11599 BTRACE -


2009-01-09 15:02:05 0 ERR 11599 BTRACE -


> Module List <----

2009-01-09 15:02:05 0 ERR 11599 BTRACE |.text Start |.text End | Module File Name

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0x08048000 | 0x08e62000 | /opt/sdb/7603/pgm/kernel

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0x5aa91000 | 0x5acbc000 | /opt/sdb/7603/lib/liboms.so

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7267000 | 0xb726f000 | /lib/libnss_nis-2.6.1.so

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7271000 | 0xb7284000 | /lib/libnsl-2.6.1.so

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7288000 | 0xb728e000 | /lib/libnss_compat-2.6.1.so

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7b93000 | 0xb7b9b000 | /lib/libnss_files-2.6.1.so

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7ce2000 | 0xb7e0f000 | /lib/libc-2.6.1.so

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7e0f000 | 0xb7e10000 | /lib/libc-2.6.1.so

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7e16000 | 0xb7e20000 | /lib/libgcc_s.so.1

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7e22000 | 0xb7e45000 | /lib/libm-2.6.1.so

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7e47000 | 0xb7eff000 | /usr/lib/libstdc++.so.5.0.7

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7f09000 | 0xb7f10000 | /lib/librt-2.6.1.so

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7f12000 | 0xb7f14000 | /lib/libdl-2.6.1.so

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7f16000 | 0xb7f29000 | /lib/libpthread-2.6.1.so

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7f39000 | 0xb7f53000 | /lib/ld-2.6.1.so

2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xffffe000 | 0xfffff000 | [vdso]

2009-01-09 15:02:05 0 ERR 11599 BTRACE

2009-01-09 15:02:05 0 ERR 11599 BTRACE -


> Symbolic Stack Back Trace <----

2009-01-09 15:02:05 0 ERR 11599 BTRACE -


> End of Stack Back Trace <----

2009-01-09 15:02:05 0 ERR 11330 COREHAND dump of siginfo content:

2009-01-09 15:02:05 0 ERR 11330 COREHAND signal 11 (SIGSEGV)

2009-01-09 15:02:05 0 ERR 11330 COREHAND code 1 (ILL_ILLOPC:illegal opcode)

2009-01-09 15:02:05 0 ERR 11330 COREHAND errno 0

2009-01-09 15:02:05 0 ERR 11330 COREHAND value(int) 4640

2009-01-09 15:02:05 0 ERR 11330 COREHAND value(ptr) @1220

2009-01-09 15:02:05 0 ERR 11330 COREHAND pid 0

2009-01-09 15:02:05 0 ERR 11330 COREHAND addr @0

2009-01-09 15:02:05 0 ERR 11599 BTRACE analysing LVCMem_Allocator_001

2009-01-09 15:02:05 0 ERR 11599 BTRACE

2009-01-09 15:02:05 0 ERR 11599 BTRACE no problems detected in LVCMem_Allocator_001

2009-01-09 15:02:05 0 ERR 11599 BTRACE analysing LVCMem_Allocator_002

2009-01-09 15:02:05 0 ERR 11599 BTRACE

2009-01-09 15:02:05 0 ERR 11599 BTRACE no problems detected in LVCMem_Allocator_002

2009-01-09 15:02:06 0 ERR 12006 DBCRASH Kernel exited without core and exit status 0x2f00

2009-01-09 15:02:06 0 ERR 12008 DBCRASH Kernel exited due to reentered signal handler

2009-01-09 15:02:06 ___ Stopping GMT 2009-01-09 14:02:06 7.6.05 Build 009-121-191-997

Second crash:

2009-01-13 11:03:22 0 ERR 11330 COREHAND ABORTING due to signal 11

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> Emergency Stack Back Trace <----

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> Register Dump <----

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


2009-01-13 11:03:22 0 ERR 11599 BTRACE ds es 0x6413007b 0x0000007b

2009-01-13 11:03:22 0 ERR 11599 BTRACE fs gs 0xc0100000 0x00000033

2009-01-13 11:03:22 0 ERR 11599 BTRACE trap err 0x0000000e 0x00000014

2009-01-13 11:03:22 0 ERR 11599 BTRACE efl ss 0x00010216 0x0000007b

2009-01-13 11:03:22 0 ERR 11599 BTRACE edi esi 0xb7c61400 0x5003fad0

2009-01-13 11:03:22 0 ERR 11599 BTRACE eax ebx 0x00000001

2009-01-13 11:03:22 0 ERR 11599 BTRACE ecx edx 0xb7c61400

2009-01-13 11:03:22 0 ERR 11599 BTRACE esp uesp 0x63e3eefc 0x63e3eefc

2009-01-13 11:03:22 0 ERR 11599 BTRACE ebp eip 0x01e3ef84 0x00000000

2009-01-13 11:03:22 0 ERR 11599 BTRACE cs cr2 0x00000073 0x00000000

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


2009-01-13 11:03:22 0 ERR 11599 BTRACE cw - sw - tag 0xffff037f 0xffff0020 0xffffffff

2009-01-13 11:03:22 0 ERR 11599 BTRACE ipoff - cssel 0xb7ebb284 0x077d0073

2009-01-13 11:03:22 0 ERR 11599 BTRACE dataoff-datasel 0x63e3ed7c 0x0000007b

2009-01-13 11:03:22 0 ERR 11599 BTRACE f00 [0x8800 0xc349 0x8885 0x91ff - 0x4008]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f01 [0x8800 0xc349 0x8885 0x923f - 0x4008]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f02 [0x0000 0x0000 0x0000 0xf300 - 0x4007]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f03 [0xb7b6 0xdb6d 0x6db6 0xf25b - 0x4007]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f04 [0x0000 0x0000 0x0000 0x9800 - 0x4002]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f05 [0x0000 0x0000 0x0000 0xfbd3 - 0x400e]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f06 [0x0000 0x0000 0x0000 0xa000 - 0xc023]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f07 [0x0000 0x10ec 0x76ec 0xc1c0 - 0x401d]

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> Module List <----

2009-01-13 11:03:22 0 ERR 11599 BTRACE |.text Start |.text End | Module File Name

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0x08048000 | 0x08e62000 | /opt/sdb/7603/pgm/kernel

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0x5a756000 | 0x5a981000 | /opt/sdb/7603/lib/liboms.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7308000 | 0xb7310000 | /lib/libnss_nis-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7312000 | 0xb7325000 | /lib/libnsl-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7329000 | 0xb732f000 | /lib/libnss_compat-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7c34000 | 0xb7c3c000 | /lib/libnss_files-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7d83000 | 0xb7eb0000 | /lib/libc-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7eb0000 | 0xb7eb1000 | /lib/libc-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7eb7000 | 0xb7ec1000 | /lib/libgcc_s.so.1

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7ec3000 | 0xb7ee6000 | /lib/libm-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7ee8000 | 0xb7fa0000 | /usr/lib/libstdc++.so.5.0.7

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7faa000 | 0xb7fb1000 | /lib/librt-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7fb3000 | 0xb7fb5000 | /lib/libdl-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7fb7000 | 0xb7fca000 | /lib/libpthread-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7fda000 | 0xb7ff4000 | /lib/ld-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xffffe000 | 0xfffff000 | [vdso]

2009-01-13 11:03:22 0 ERR 11599 BTRACE

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> Symbolic Stack Back Trace <----

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> End of Stack Back Trace <----

2009-01-13 11:03:22 0 ERR 11330 COREHAND dump of siginfo content:

2009-01-13 11:03:22 0 ERR 11330 COREHAND signal 11 (SIGSEGV)

2009-01-13 11:03:22 0 ERR 11330 COREHAND code 1 (ILL_ILLOPC:illegal opcode)

2009-01-13 11:03:22 0 ERR 11330 COREHAND errno 0

2009-01-13 11:03:22 0 ERR 11330 COREHAND value(int) 4640

2009-01-13 11:03:22 0 ERR 11330 COREHAND value(ptr) @1220

2009-01-13 11:03:22 0 ERR 11330 COREHAND pid 0

2009-01-13 11:03:22 0 ERR 11330 COREHAND addr @0

2009-01-13 11:03:22 0 ERR 11599 BTRACE analysing LVCMem_Allocator_001

2009-01-13 11:03:22 0 ERR 11599 BTRACE

2009-01-13 11:03:22 0 ERR 11599 BTRACE no problems detected in LVCMem_Allocator_001

2009-01-13 11:03:22 0 ERR 11599 BTRACE analysing LVCMem_Allocator_002

2009-01-13 11:03:22 0 ERR 11599 BTRACE

2009-01-13 11:03:22 0 ERR 11599 BTRACE no problems detected in LVCMem_Allocator_002

2009-01-13 11:03:23 0 ERR 12006 DBCRASH Kernel exited without core and exit status 0x2f00

2009-01-13 11:03:23 0 ERR 12008 DBCRASH Kernel exited due to reentered signal handler

2009-01-13 11:03:23 ___ Stopping GMT 2009-01-13 10:03:23 7.6.05 Build 009-121-191-997

How can I find the reason for the crash and prevent them in the future ? Or can you explain to me where the problem is ?

Bye

Claus

Accepted Solutions (1)

Accepted Solutions (1)

former_member229109
Active Contributor
0 Kudos

Hello Claus,

Please also let us know, if "Symbolic Stack Back Trace" was written in

knldiag or knldiag.err files. If it was written, please post it.

Do you have lines in knldiag.err beetween

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> Symbolic Stack Back Trace <----

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> End of Stack Back Trace <----

?

Thank you and best regards, Natalia Khlopina

Former Member
0 Kudos

Hello,

I have posted all lines from the file knldiag.err. There are no lines between

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> Symbolic Stack Back Trace <----

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> End of Stack Back Trace <----

and there are no lines before the posted ones.

I have found the following lines in the file knldiag:

2009-01-13 11:02:50 3191 11561 COMMUNIC Connecting T100 localhost 4761

2009-01-13 11:02:50 3208 12929 TASKING Task T100 started

2009-01-13 11:02:50 3208 11007 COMMUNIC wait for connection T100

2009-01-13 11:02:50 3208 11561 COMMUNIC Connected T100 localhost 4761

2009-01-13 11:02:50 3208 11560 COMMUNIC Releasing T100

2009-01-13 11:02:50 3208 12827 COMMUNIC wait for connection T100

2009-01-13 11:02:50 3208 12929 TASKING Task T127 started

2009-01-13 11:02:50 3191 11561 COMMUNIC Connecting T127 localhost 4669

2009-01-13 11:02:50 3208 11007 COMMUNIC wait for connection T127

2009-01-13 11:02:50 3208 11561 COMMUNIC Connected T127 localhost 4669

2009-01-13 11:02:50 3208 11560 COMMUNIC Releasing T127

2009-01-13 11:02:50 3208 12827 COMMUNIC wait for connection T127

2009-01-13 11:02:50 3191 11561 COMMUNIC Connecting T101 localhost 4761

2009-01-13 11:02:50 3208 12929 TASKING Task T101 started

2009-01-13 11:02:50 3208 11007 COMMUNIC wait for connection T101

2009-01-13 11:02:50 3208 11561 COMMUNIC Connected T101 localhost 4761

2009-01-13 11:02:50 3208 11560 COMMUNIC Releasing T101

2009-01-13 11:02:50 3208 12827 COMMUNIC wait for connection T101

2009-01-13 11:02:52 3191 11561 COMMUNIC Connecting T98 localhost 4669

2009-01-13 11:02:52 3208 12929 TASKING Task T98 started

2009-01-13 11:02:52 3208 11007 COMMUNIC wait for connection T98

2009-01-13 11:02:52 3208 11561 COMMUNIC Connected T98 localhost 4669

2009-01-13 11:02:54 3208 11560 COMMUNIC Releasing T98

2009-01-13 11:02:54 3208 12827 COMMUNIC wait for connection T98

2009-01-13 11:03:18 3208 12929 TASKING Task T102 started

2009-01-13 11:03:18 3208 11007 COMMUNIC wait for connection T102

2009-01-13 11:03:18 3191 11561 COMMUNIC Connecting T102 localhost 2460

2009-01-13 11:03:18 3208 11561 COMMUNIC Connected T102 localhost 2460

2009-01-13 11:03:18 3208 11560 COMMUNIC Releasing T102

2009-01-13 11:03:18 3208 12827 COMMUNIC wait for connection T102

2009-01-13 11:03:22 3191 11561 COMMUNIC Connecting T97 localhost 2460

2009-01-13 11:03:22 0 12853 DBSTATE Caught signal 11(SIGSEGV)

2009-01-13 11:03:22 0 ERR 11330 COREHAND ABORTING due to signal 11

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> Emergency Stack Back Trace <----

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> Register Dump <----

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


2009-01-13 11:03:22 0 ERR 11599 BTRACE ds es 0x6413007b 0x0000007b

2009-01-13 11:03:22 0 ERR 11599 BTRACE fs gs 0xc0100000 0x00000033

2009-01-13 11:03:22 0 ERR 11599 BTRACE trap err 0x0000000e 0x00000014

2009-01-13 11:03:22 0 ERR 11599 BTRACE efl ss 0x00010216 0x0000007b

2009-01-13 11:03:22 0 ERR 11599 BTRACE edi esi 0xb7c61400 0x5003fad0

2009-01-13 11:03:22 0 ERR 11599 BTRACE eax ebx 0x00000001

2009-01-13 11:03:22 0 ERR 11599 BTRACE ecx edx 0xb7c61400

2009-01-13 11:03:22 0 ERR 11599 BTRACE esp uesp 0x63e3eefc 0x63e3eefc

2009-01-13 11:03:22 0 ERR 11599 BTRACE ebp eip 0x01e3ef84 0x00000000

2009-01-13 11:03:22 0 ERR 11599 BTRACE cs cr2 0x00000073 0x00000000

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


2009-01-13 11:03:22 0 ERR 11599 BTRACE cw - sw - tag 0xffff037f 0xffff0020 0xffffffff

2009-01-13 11:03:22 0 ERR 11599 BTRACE ipoff - cssel 0xb7ebb284 0x077d0073

2009-01-13 11:03:22 0 ERR 11599 BTRACE dataoff-datasel 0x63e3ed7c 0x0000007b

2009-01-13 11:03:22 0 ERR 11599 BTRACE f00 [0x8800 0xc349 0x8885 0x91ff - 0x4008]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f01 [0x8800 0xc349 0x8885 0x923f - 0x4008]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f02 [0x0000 0x0000 0x0000 0xf300 - 0x4007]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f03 [0xb7b6 0xdb6d 0x6db6 0xf25b - 0x4007]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f04 [0x0000 0x0000 0x0000 0x9800 - 0x4002]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f05 [0x0000 0x0000 0x0000 0xfbd3 - 0x400e]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f06 [0x0000 0x0000 0x0000 0xa000 - 0xc023]

2009-01-13 11:03:22 0 ERR 11599 BTRACE f07 [0x0000 0x10ec 0x76ec 0xc1c0 - 0x401d]

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> Module List <----

2009-01-13 11:03:22 0 ERR 11599 BTRACE |.text Start |.text End | Module File Name

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0x08048000 | 0x08e62000 | /opt/sdb/7603/pgm/kernel

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0x5a756000 | 0x5a981000 | /opt/sdb/7603/lib/liboms.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7308000 | 0xb7310000 | /lib/libnss_nis-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7312000 | 0xb7325000 | /lib/libnsl-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7329000 | 0xb732f000 | /lib/libnss_compat-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7c34000 | 0xb7c3c000 | /lib/libnss_files-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7d83000 | 0xb7eb0000 | /lib/libc-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7eb0000 | 0xb7eb1000 | /lib/libc-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7eb7000 | 0xb7ec1000 | /lib/libgcc_s.so.1

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7ec3000 | 0xb7ee6000 | /lib/libm-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7ee8000 | 0xb7fa0000 | /usr/lib/libstdc++.so.5.0.7

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7faa000 | 0xb7fb1000 | /lib/librt-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7fb3000 | 0xb7fb5000 | /lib/libdl-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7fb7000 | 0xb7fca000 | /lib/libpthread-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7fda000 | 0xb7ff4000 | /lib/ld-2.6.1.so

2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xffffe000 | 0xfffff000 | [vdso]

2009-01-13 11:03:22 0 ERR 11599 BTRACE

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> Symbolic Stack Back Trace <----

2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> End of Stack Back Trace <----

2009-01-13 11:03:22 0 ERR 11330 COREHAND dump of siginfo content:

2009-01-13 11:03:22 0 ERR 11330 COREHAND signal 11 (SIGSEGV)

2009-01-13 11:03:22 0 ERR 11330 COREHAND code 1 (ILL_ILLOPC:illegal opcode)

2009-01-13 11:03:22 0 ERR 11330 COREHAND errno 0

2009-01-13 11:03:22 0 ERR 11330 COREHAND value(int) 4640

2009-01-13 11:03:22 0 ERR 11330 COREHAND value(ptr) @1220

2009-01-13 11:03:22 0 ERR 11330 COREHAND pid 0

2009-01-13 11:03:22 0 ERR 11330 COREHAND addr @0

2009-01-13 11:03:22 0 ERR 11599 BTRACE analysing LVCMem_Allocator_001

2009-01-13 11:03:22 0 ERR 11599 BTRACE

2009-01-13 11:03:22 0 ERR 11599 BTRACE no problems detected in LVCMem_Allocator_001

2009-01-13 11:03:22 0 ERR 11599 BTRACE analysing LVCMem_Allocator_002

2009-01-13 11:03:22 0 ERR 11599 BTRACE

2009-01-13 11:03:22 0 ERR 11599 BTRACE no problems detected in LVCMem_Allocator_002

+++++++++++++++++++++++++++++++++++++++ Kernel Exit ++++++++++++++++++++++++++++

2009-01-13 11:03:23 0 11987 dump_rte rtedump written to file 'rtedump'

2009-01-13 11:03:23 0 ERR 12006 DBCRASH Kernel exited without core and exit status 0x2f00

2009-01-13 11:03:23 0 ERR 12008 DBCRASH Kernel exited due to reentered signal handler

2009-01-13 11:03:23 0 12890 DIAGHIST Backup of diagnostic files will be forced at next restart

2009-01-13 11:03:23 0 12808 DBSTATE Flushing knltrace pages

2009-01-13 11:03:23 0 WNG 11824 COMMUNIC Releasing T97 kernel abort

2009-01-13 11:03:23 0 12696 DBSTATE Change DbState to 'OFFLINE '(29)

I have a file called "knltrace", but it doesn't seems to be a normal text file and it is 8 MB large.

I also have a file called "rtedump". It is 1 MB large and here are the first and last lines from it

ERR 11105 CONSOLE WARNING: kernel not running '<dbname>'

ERR 11105 CONSOLE WARNING: examining OLD DATA

SERVERDB: <dbname>

ERR 11105 CONSOLE WARNING: kernel not running '<dbname>'

ERR 11105 CONSOLE WARNING: examining OLD DATA

The database state is OFFLINE

Kernel Version 'Kernel 7.6.05 Build 009-121-191-997'

RTE Version 'X32/LINUX 7.6.05 Build 009-121-191-997'

ID UKT UNIX TASK APPL Current Timeout Region Wait

tid type pid state priority cnt try item

T1 6 -1 Timer -1 Vsleep 0 0 33845(s)

T2 2 -1 Logwr -1 No-Work (255) 0 0 338(s)

T3 1 -1 Tracewr -1 No-Work (255) 0 0 1(s)

T4 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T5 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

..... more lines ....

List of suspend-reasons:

========================

Total Suspends: 118491

IOWait(R)(041) : 106779 ( 90.12% ) b13get_node: await read

PagerWaitWritr : 7 ( 0.01% ) Pager_Controller::WaitForPagerWritReply

JobWait Redo : 2 ( 0.00% ) Rst_RedoManager::RedoLog

Vsuspend (227) : 878 ( 0.74% ) RedoReader waits for finished jobs

Vsuspend (228) : 1 ( 0.00% ) RedoReader waits for end of all RedoTask

NoRedoJob(231) : 1184 ( 1.00% ) Rst_RedoTrafficControl::ExecuteJobs()

SyncRedo (232) : 1358 ( 1.15% ) Rst_RedoTrafficControl::WaitForIoSeq()

LogIOwait(234) : 312 ( 0.26% ) Log_Queue::UserTaskEOTReady

SVP-wait (243) : 2 ( 0.00% ) Log_Savepoint::StartSavepointAndWait

No-Work (255) : 7968 ( 6.72% ) Task is waiting for work

Index Region Get-Cnt avg_time tot_time

Index Region Owner Get-Cnt Tas-Cnt Coll. Waits Excl Coll %

1 PAGER 450 0 4501 45 0 1000.22 %

2 CONFIG 0 0 0 0 0 0.00 %

3 CONV1 1780 0 0 0 0 0.00 %

4 CONV2 1623 0 0 0 0 0.00 %

5 CONV3 1765 0 0 0 0 0.00 %

6 CONV4 1720 0 0 0 0 0.00 %

7 CONV5 1869 0 0 0 0 0.00 %

8 CONV6 2002 0 0 0 0 0.00 %

9 CONV7 2289 0 0 0 0 0.00 %

10 CONV8 2125 0 0 0 0 0.00 %

11 CONV9 1427 0 0 0 0 0.00 %

12 CONV10 1461 0 0 0 0 0.00 %

13 CONV11 1748 0 0 0 0 0.00 %

14 CONV12 1610 0 0 0 0 0.00 %

15 CONV13 2132 0 0 0 0 0.00 %

16 CONV14 1578 0 0 0 0 0.00 %

17 CONV15 1946 0 0 0 0 0.00 %

18 CONV16 1746 0 0 0 0 0.00 %

19 CONV17 5523 0 0 0 0 0.00 %

20 CONV18 5464 0 0 0 0 0.00 %

21 CONV19 4992 0 0 0 0 0.00 %

22 CONV20 4720 0 0 0 0 0.00 %

23 CONV21 4727 0 0 0 0 0.00 %

24 CONV22 4832 0 0 0 0 0.00 %

25 CONV23 4656 0 0 0 0 0.00 %

26 CONV24 4732 0 0 0 0 0.00 %

27 CONV25 2137 0 0 0 0 0.00 %

28 CONV26 1888 0 0 0 0 0.00 %

29 CONV27 2080 0 0 0 0 0.00 %

30 CONV28 2722 0 0 0 0 0.00 %

31 CONV29 2225 0 0 0 0 0.00 %

32 CONV30 2316 0 0 0 0 0.00 %

33 CONV31 2086 0 0 0 0 0.00 %

34 CONV32 2221 0 0 0 0 0.00 %

35 CONV33 6434 0 0 0 0 0.00 %

36 CONV34 6257 0 0 0 0 0.00 %

37 CONV35 5866 0 0 0 0 0.00 %

38 CONV36 5797 0 0 0 0 0.00 %

39 CONV37 5652 0 0 0 0 0.00 %

40 CONV38 5684 0 0 0 0 0.00 %

41 CONV39 6112 0 0 0 0 0.00 %

42 CONV40 5201 0 0 0 0 0.00 %

43 CONV41 3079 0 0 0 0 0.00 %

44 CONV42 3672 0 0 0 0 0.00 %

45 CONV43 3880 0 0 0 0 0.00 %

46 CONV44 3783 0 0 0 0 0.00 %

47 CONV45 3780 0 0 0 0 0.00 %

48 CONV46 3928 0 0 0 0 0.00 %

49 CONV47 3325 0 0 0 0 0.00 %

50 CONV48 4359 0 0 0 0 0.00 %

51 DATACACH 0 0 0 0 0 0.00 %

52 DCOM 0 0 0 0 0 0.00 %

53 DIAGCACH 8150 0 0 0 0 0.00 %

54 FBM 32377 0 0 0 0 0.00 %

55 GARBAGE 76 0 0 0 0 0.00 %

56 LOCKINIT 2092506 0 0 0 0 0.00 %

57 LOCKPOOL 22509 0 0 0 0 0.00 %

58 LOCKREQ 0 0 0 0 0 0.00 %

59 LOCKWAIT 0 0 0 0 0 0.00 %

60 SAVEPOIN 11 0 0 0 0 0.00 %

61 LOGQUE1 2366 0 1213 12 0 51.27 %

62 LOGQUE2 4 0 0 0 0 0.00 %

63 LOGINFO 6 0 0 0 0 0.00 %

64 LVC_EMCY 0 0 0 0 0 0.00 %

65 MONITOR 0 0 0 0 0 0.00 %

66 SERVER 47905 0 1 0 0 0.00 %

67 SRVTASK 28852 0 8045 80 0 27.88 %

68 SURROGAT 23599 0 0 0 0 0.00 %

69 CONVINDX 194 0 0 0 0 0.00 %

70 KNLWAIT 3 0 0 0 0 0.00 %

71 TRACE 0 0 0 0 0 0.00 %

72 COMP_END 0 0 0 0 0 0.00 %

73 LOCKPAR 0 0 0 0 0 0.00 %

74 CLSTERIO 196 0 0 0 0 0.00 %

75 RANDMGEN 3886 0 0 0 0 0.00 %

76 REDOCTRL 18215 0 0 0 0 0.00 %

77 OMSMON 0 0 0 0 0 0.00 %

78 OMSUNLDV 0 0 0 0 0 0.00 %

79 OMSCDIR 0 0 0 0 0 0.00 %

80 OMSVDIR 0 0 0 0 0 0.00 %

81 OMSSHHP 0 0 0 0 0 0.00 %

82 OMSSTHP 0 0 0 0 0 0.00 %

83 OMSEMHP 0 0 0 0 0 0.00 %

84 SAVE1 2 0 0 0 0 0.00 %

85 SAVE2 2 0 0 0 0 0.00 %

86 DATA1 272327 0 5027 50 0 1.85 %

87 DATA2 62608 1 3616 36 0 5.78 %

88 DATA3 143046 0 7625 76 0 5.33 %

89 DATA4 81378 0 7629 76 0 9.37 %

90 DATA5 155192 0 5427 54 0 3.50 %

91 DATA6 116221 0 4825 48 0 4.15 %

92 DATA7 99933 0 5423 54 0 5.43 %

93 DATA8 68148 2 5422 54 0 7.96 %

94 DATA9 662958 1 7716 77 0 1.16 %

95 DATA10 61956 0 4519 45 0 7.29 %

96 DATA11 44018 2 4830 48 0 10.97 %

97 DATA12 184427 2 6020 60 0 3.26 %

98 DATA13 55285 1 6426 64 0 11.62 %

99 DATA14 67000 0 5122 51 0 7.64 %

100 DATA15 99934 0 6628 66 0 6.63 %

101 DATA16 76041 1 4223 42 0 5.55 %

102 DATA17 339025 0 4912 49 0 1.45 %

103 DATA18 85941 1 6318 63 0 7.35 %

104 DATA19 65898 3 4224 42 0 6.41 %

105 DATA20 74123 0 5714 57 0 7.71 %

106 DATA21 714412 0 5923 59 0 0.83 %

107 DATA22 78895 0 5637 56 0 7.14 %

108 DATA23 49106 0 6728 67 0 13.70 %

109 DATA24 80526 2 7124 71 0 8.85 %

110 DATA25 416603 0 3623 36 0 0.87 %

111 DATA26 78093 1 4922 49 0 6.30 %

112 DATA27 423110 0 7521 75 0 1.78 %

113 DATA28 1261798 0 5819 58 0 0.46 %

114 DATA29 97660 1 4516 45 0 4.62 %

115 DATA30 62183 0 5716 57 0 9.19 %

116 DATA31 74930 0 3814 38 0 5.09 %

117 DATA32 137588 0 2814 28 0 2.05 %

118 DATA33 421146 1 7723 77 0 1.83 %

119 DATA34 65262 0 7723 77 0 11.83 %

120 DATA35 52449 1 9575 95 0 18.26 %

121 DATA36 52982 0 6425 64 0 12.13 %

122 DATA37 96596 0 3915 39 0 4.05 %

123 DATA38 67893 0 3419 34 0 5.04 %

124 DATA39 1433041 0 3720 37 0 0.26 %

125 DATA40 100955 1 5318 53 0 5.27 %

126 DATA41 352178 0 7119 71 0 2.02 %

127 DATA42 76802 0 5028 50 0 6.55 %

128 DATA43 47429 0 5625 56 0 11.86 %

129 DATA44 62154 1 7720 77 0 12.42 %

130 DATA45 76398 1 5429 54 0 7.11 %

131 DATA46 94363 0 4820 48 0 5.11 %

132 DATA47 50856 0 4813 48 0 9.46 %

133 DATA48 78895 1 3027 30 0 3.84 %

134 TRANS1 1243826 0 0 0 0 0.00 %

135 TRANS2 877845 0 0 0 0 0.00 %

136 TRANS3 1188490 0 0 0 0 0.00 %

137 TRANS4 990013 0 0 0 0 0.00 %

138 TRANS5 933725 0 0 0 0 0.00 %

139 TRANS6 1221502 0 0 0 0 0.00 %

140 TRANS7 897280 0 0 0 0 0.00 %

141 TRANS8 1132537 0 0 0 0 0.00 %

142 TAB9 983874 0 0 0 0 0.00 %

143 TAB10 46706 0 0 0 0 0.00 %

144 TAB11 31946 0 0 0 0 0.00 %

145 TAB12 20488 0 0 0 0 0.00 %

146 TAB13 21314 0 0 0 0 0.00 %

147 TAB14 57646 0 0 0 0 0.00 %

148 TAB15 20054 0 0 0 0 0.00 %

149 TAB16 30230 0 0 0 0 0.00 %

150 ROW17 155679 0 0 0 0 0.00 %

151 ROW18 137365 0 0 0 0 0.00 %

152 ROW19 162665 0 0 0 0 0.00 %

153 ROW20 153850 0 0 0 0 0.00 %

154 ROW21 150363 0 0 0 0 0.00 %

155 ROW22 143018 0 0 0 0 0.00 %

156 ROW23 138006 0 0 0 0 0.00 %

157 ROW24 154265 0 0 0 0 0.00 %

Alone :

Count : 0 Collisions : 0

Size of code 145121 KB

Size of task stacks 87632 KB

Size of shared data 1356 KB

Used shared dyn pool 0 KB

Unused shared dyn pool 0 KB

Used shared dyn data 0 Pages

Unused shared dyn data 0 Pages

Number of existing tasks 168

no Task connected

SERVERDB: <dbname>

The SERVERDB state is OFFLINE

Console command finished (2009-01-13 11:03:23).

Please tell me if you need other lines from this file.

Where can I find the requested trace infos ?

Bye

Claus

lbreddemann
Active Contributor
0 Kudos

> I have posted all lines from the file knldiag.err. There are no lines between

>

> 2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> Symbolic Stack Back Trace <----

> 2009-01-13 11:03:22 0 ERR 11599 BTRACE -


> End of Stack Back Trace <----

>

> and there are no lines before the posted ones.

That's very unfortunate, since now we don't know what function caused the segmentation violation.

Please do check the operating system error log as well - are there any entries for this incident?

> 2009-01-13 11:03:22 0 ERR 11330 COREHAND dump of siginfo content:

> 2009-01-13 11:03:22 0 ERR 11330 COREHAND signal 11 (SIGSEGV)

> 2009-01-13 11:03:22 0 ERR 11330 COREHAND code 1 (ILL_ILLOPC:illegal opcode)

> 2009-01-13 11:03:22 0 ERR 11330 COREHAND errno 0

> 2009-01-13 11:03:22 0 ERR 11330 COREHAND value(int) 4640

> 2009-01-13 11:03:22 0 ERR 11330 COREHAND value(ptr) @1220

> 2009-01-13 11:03:22 0 ERR 11330 COREHAND pid 0

> 2009-01-13 11:03:22 0 ERR 11330 COREHAND addr @0

"Illegal opcode" errors can be caused by stack overwrites - what are the *_STACK-sizes for this instance (look for parameters that are named like "stack...")

> I have a file called "knltrace", but it doesn't seems to be a normal text file and it is 8 MB large.

That's the kernel trace file. It's a trace written in binary format.

You may be able to convert it to a readable format as described in the SDN MaxDB Wiki [MaxDB database trace|https://wiki.sdn.sap.com/wiki/x/2yg]

> I also have a file called "rtedump". It is 1 MB large and here are the first and last lines from it

This file contains a snapshot of the task states when the database crashed.

The content is similar to what you would get, when you run x_cons <DBSID> show all

>

> ID UKT UNIX TASK APPL Current Timeout Region Wait

> tid type pid state priority cnt try item

> T1 6 -1 Timer -1 Vsleep 0 0 33845(s)

> T2 2 -1 Logwr -1 No-Work (255) 0 0 338(s)

> T3 1 -1 Tracewr -1 No-Work (255) 0 0 1(s)

> T4 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

> T5 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

>

> ..... more lines ....

These "more lines" would have been interesting as they show the tasks that had been active when the error occured.

Once we know the user task(s) that were running, when the error occured, we may have a chance to check the application side logfiles to figure out, what command the user task(s) were processing.

> Please tell me if you need other lines from this file.

See above.

regards,

Lars

Former Member
0 Kudos

I have checked several system logfiles, but there are no errors/warnings/notices for the time the maxdb crashes occured.

Here are the values for all STACK parameters from my database:

MBLOCKSTACK_SIZE: 32768

DYNTASK_STACK: NO

MAXTASKSTACK: 512

MAX_SERVERTASK_STACK: 500

MAX_SPECIALTASK_STACK:500

SHOW_MAX_STACK_USE: NO

SHOW_MAX_KB_STACK_USE: NO

CALLSTACKLEVEL: 0

Here are more lines from the file "rtedump"

Kernel Version 'Kernel 7.6.05 Build 009-121-191-997'

RTE Version 'X32/LINUX 7.6.05 Build 009-121-191-997'

ID UKT UNIX TASK APPL Current Timeout Region Wait

tid type pid state priority cnt try item

T1 6 -1 Timer -1 Vsleep 0 0 33845(s)

T2 2 -1 Logwr -1 No-Work (255) 0 0 338(s)

T3 1 -1 Tracewr -1 No-Work (255) 0 0 1(s)

T4 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T5 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T6 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T7 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T8 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T9 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T10 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T11 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T12 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T13 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T14 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T15 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T16 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T17 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T18 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T19 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T20 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T21 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T22 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T23 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T24 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T25 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T26 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T27 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T28 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T29 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T30 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T31 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T32 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T33 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T34 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T35 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T36 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T37 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T38 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T39 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T40 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T41 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T42 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T43 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T44 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T45 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T46 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T47 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T48 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T49 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T50 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T51 6 -1 Pager -1 No-Work (255) 0 0 33845(s)

T54 5 -1 GarbCol -1 No-Work (255) 0 0 1(s)

T55 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T56 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T57 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T58 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T59 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T60 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T61 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T62 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T63 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T64 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T65 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T66 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T67 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T68 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T69 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T70 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T71 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T72 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T73 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T74 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T75 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T76 4 -1 Savepnt -1 No-Work (255) 0 0 118886(s)

T77 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T78 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T79 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T80 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T81 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T82 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T83 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T84 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T85 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T86 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T87 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T88 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T89 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T90 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T91 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T92 4 -1 Server -1 No-Work (255) 0 0 118886(s)

T93 3 -1 Utility 0 Inactive 0 0 1(s)

75 Tasks are in State 'Connect wait'

Special Threads:

UNIX Threads

tid name

3164 COORDINATOR

3181 CLOCK Now 1231841002 = Tue Jan 13 11:03:22 2009

3184 CONSOLE

3190 TIMER did 17631 sleeps. Now sleeping until 1231841004 for 5 s

3191 REQUESTOR

3192 DEV0

User Kernel Threads:

UNIX Thread Dispatch TaskSwitch Command Active Total Task

tid name counter counter counter Tasks Tasks cluster

3201 UKT1 2 0 0 1 1 TW

3202 UKT2 338 0 0 1 1 AL

3204 UKT3 1 0 0 0 1 UT

3205 UKT4 311007 22836 0 38 38 38*SV

3206 UKT5 4 2 0 1 3 1*GC,2*EV

3207 UKT6 38942 3373 0 49 49 TI,48*DW

3208 UKT7 2081521 5482 1913727 0 38 38*US

3209 UKT8 196767 54 165836 0 37 37*US

I/O via UKT and Device Processes:

UNIX Thread Devspace Dev Read Write Queue

tid name name index count count len max

3202 UKT2 LOG_001 4 0 364 -- (--)

3208 UKT7 DAT_0001 1 2469 0 -- (--)

3208 UKT7 DAT_0002 2 2433 0 -- (--)

3208 UKT7 DAT_0003 3 2578 0 -- (--)

3208 UKT7 LOG_001 4 8 2 -- (--)

3209 UKT8 DAT_0001 1 334 0 -- (--)

3209 UKT8 DAT_0002 2 308 0 -- (--)

3209 UKT8 DAT_0003 3 331 0 -- (--)

3210 DEV knltrace 0 0 1 0 (1)

3213 DEV DAT_0001 1 40200 465 0 (14)

3212 DEV DAT_0001 1 0 146 0 (13)

3215 DEV DAT_0002 2 41775 412 0 (20)

3214 DEV DAT_0002 2 0 195 0 (19)

3217 DEV DAT_0003 3 41131 402 0 (22)

3216 DEV DAT_0003 3 0 207 0 (22)

3219 DEV LOG_001 4 173 2 0 (1)

3218 DEV LOG_001 4 0 0 0 (0)

I/O via Device Processes:

UNIX Devspace Read avg_read Write avg_write

tid name count time count time

3210 knltrace 0 0.0000 1 0.0000

3213 DAT_0001 40200 0.0000 465 0.0000

3212 DAT_0001 0 0.0000 146 0.0000

3215 DAT_0002 41775 0.0000 412 0.0000

3214 DAT_0002 0 0.0000 195 0.0000

3217 DAT_0003 41131 0.0000 402 0.0000

3216 DAT_0003 0 0.0000 207 0.0000

3219 LOG_001 173 0.0000 2 0.0000

Devspace No. Read(s) RPages Write(s) WPages

knltrace 0 0 0 1 1

DAT_0001 1 43003 43003 611 690

DAT_0002 2 44516 44516 607 802

DAT_0003 3 44040 44040 609 710

LOG_001 4 181 1385 368 375

total I/O 131740 132944 2196 2578

-


T1 TIMEOUT ( pid = -1 ) -


dispatcher_cnt: 17413 command_cnt : 0

exclusive_cnt : 501120 self_susp_cnt : 0

dev_write_io : 1 dev_write_pg : 1

state_vwait : 0 state_vsleep : 17411 state_vsusp : 0

-


Inx Region Get-Counts Collision-Counts

Total / Task / percent Total / Task / percent

56 LOCKINIT 2092506 / 17405 / 0.83 % 0 / 0 / 0.00 %

57 LOCKPOOL 22509 / 18764 / 83.36 % 0 / 0 / 0.00 %

60 SAVEPOIN 11 / 1 / 9.09 % 0 / 0 / 0.00 %

66 SERVER 47905 / 17426 / 36.38 % 1 / 0 / 0.00 %

68 SURROGAT 23599 / 17409 / 73.77 % 0 / 0 / 0.00 %

84 SAVE1 2 / 2 /100.00 % 0 / 0 / 0.00 %

85 SAVE2 2 / 2 /100.00 % 0 / 0 / 0.00 %

86 DATA1 272327 / 16 / 0.01 % 5027 / 0 / 0.00 %

87 DATA2 62608 / 14 / 0.02 % 3616 / 0 / 0.00 %

88 DATA3 143046 / 12 / 0.01 % 7625 / 0 / 0.00 %

89 DATA4 81378 / 10 / 0.01 % 7629 / 0 / 0.00 %

90 DATA5 155192 / 8 / 0.01 % 5427 / 0 / 0.00 %

91 DATA6 116221 / 6 / 0.01 % 4825 / 0 / 0.00 %

92 DATA7 99933 / 4 / 0.00 % 5423 / 0 / 0.00 %

93 DATA8 68148 / 2 / 0.00 % 5422 / 0 / 0.00 %

105 DATA20 74123 / 1 / 0.00 % 5714 / 0 / 0.00 %

108 DATA23 49106 / 17 / 0.03 % 6728 / 0 / 0.00 %

109 DATA24 80526 / 16 / 0.02 % 7124 / 0 / 0.00 %

110 DATA25 416603 / 15 / 0.00 % 3623 / 0 / 0.00 %

111 DATA26 78093 / 15 / 0.02 % 4922 / 0 / 0.00 %

112 DATA27 423110 / 14 / 0.00 % 7521 / 0 / 0.00 %

113 DATA28 1261798 / 13 / 0.00 % 5819 / 0 / 0.00 %

114 DATA29 97660 / 12 / 0.01 % 4516 / 0 / 0.00 %

115 DATA30 62183 / 11 / 0.02 % 5716 / 0 / 0.00 %

116 DATA31 74930 / 10 / 0.01 % 3814 / 0 / 0.00 %

117 DATA32 137588 / 23 / 0.02 % 2814 / 0 / 0.00 %

118 DATA33 421146 / 22 / 0.01 % 7723 / 0 / 0.00 %

119 DATA34 65262 / 23 / 0.04 % 7723 / 0 / 0.00 %

120 DATA35 52449 / 22 / 0.04 % 9575 / 0 / 0.00 %

121 DATA36 52982 / 21 / 0.04 % 6425 / 0 / 0.00 %

122 DATA37 96596 / 20 / 0.02 % 3915 / 0 / 0.00 %

123 DATA38 67893 / 22 / 0.03 % 3419 / 0 / 0.00 %

124 DATA39 1433041 / 22 / 0.00 % 3720 / 0 / 0.00 %

125 DATA40 100955 / 23 / 0.02 % 5318 / 0 / 0.00 %

126 DATA41 352178 / 22 / 0.01 % 7119 / 0 / 0.00 %

127 DATA42 76802 / 21 / 0.03 % 5028 / 0 / 0.00 %

128 DATA43 47429 / 20 / 0.04 % 5625 / 0 / 0.00 %

129 DATA44 62154 / 20 / 0.03 % 7720 / 0 / 0.00 %

130 DATA45 76398 / 20 / 0.03 % 5429 / 0 / 0.00 %

131 DATA46 94363 / 19 / 0.02 % 4820 / 0 / 0.00 %

132 DATA47 50856 / 18 / 0.04 % 4813 / 0 / 0.00 %

133 DATA48 78895 / 17 / 0.02 % 3027 / 0 / 0.00 %

134 TRANS1 1243826 / 17405 / 1.40 % 0 / 0 / 0.00 %

135 TRANS2 877845 / 17405 / 1.98 % 0 / 0 / 0.00 %

136 TRANS3 1188490 / 17405 / 1.46 % 0 / 0 / 0.00 %

137 TRANS4 990013 / 17405 / 1.76 % 0 / 0 / 0.00 %

138 TRANS5 933725 / 17405 / 1.86 % 0 / 0 / 0.00 %

139 TRANS6 1221502 / 17405 / 1.42 % 0 / 0 / 0.00 %

140 TRANS7 897280 / 17405 / 1.94 % 0 / 0 / 0.00 %

141 TRANS8 1132537 / 17405 / 1.54 % 0 / 0 / 0.00 %

142 TAB9 983874 / 17405 / 1.77 % 0 / 0 / 0.00 %

143 TAB10 46706 / 17405 / 37.27 % 0 / 0 / 0.00 %

144 TAB11 31946 / 17405 / 54.48 % 0 / 0 / 0.00 %

145 TAB12 20488 / 17405 / 84.95 % 0 / 0 / 0.00 %

146 TAB13 21314 / 17405 / 81.66 % 0 / 0 / 0.00 %

147 TAB14 57646 / 17405 / 30.19 % 0 / 0 / 0.00 %

148 TAB15 20054 / 17405 / 86.79 % 0 / 0 / 0.00 %

149 TAB16 30230 / 17405 / 57.58 % 0 / 0 / 0.00 %

150 ROW17 155679 / 17405 / 11.18 % 0 / 0 / 0.00 %

151 ROW18 137365 / 17405 / 12.67 % 0 / 0 / 0.00 %

152 ROW19 162665 / 17405 / 10.70 % 0 / 0 / 0.00 %

153 ROW20 153850 / 17405 / 11.31 % 0 / 0 / 0.00 %

154 ROW21 150363 / 17405 / 11.58 % 0 / 0 / 0.00 %

155 ROW22 143018 / 17405 / 12.17 % 0 / 0 / 0.00 %

156 ROW23 138006 / 17405 / 12.61 % 0 / 0 / 0.00 %

157 ROW24 154265 / 17405 / 11.28 % 0 / 0 / 0.00 %

....

I think, I can't post the complete file here... its just too large.

I tried to convert the knltrace file following the instructions from the wiki, but the resulting file <dbname>.prt only contains

************************************************************************

      • KERNPROT 7.6.05 2009-01-14 21:45:19 ***

************************************************************************

nothing more

Do you have any suggestion what I should do next ?

lbreddemann
Active Contributor
0 Kudos

>

> I have checked several system logfiles, but there are no errors/warnings/notices for the time the maxdb crashes occured.

>

> Here are the values for all STACK parameters from my database:

>

> MBLOCKSTACK_SIZE: 32768

> DYNTASK_STACK: NO

> MAXTASKSTACK: 512

> MAX_SERVERTASK_STACK: 500

> MAX_SPECIALTASK_STACK:500

You may want to increase MAXTASKSTACK to 1024, just to let a bit more space to grow.

> Here are more lines from the file "rtedump"

As you may have seen - no active processes there - too bad for the analysis as we cannot tell the task that ran into the error.

> I tried to convert the knltrace file following the instructions from the wiki, but the resulting file <dbname>.prt only contains

>

> ************************************************************************

> *** KERNPROT 7.6.05 2009-01-14 21:45:19 ***

> ************************************************************************

>

> nothing more

>

> Do you have any suggestion what I should do next ?

Ok, not even the trace contained any data - there's nothing more that you could check.

If the error does not reoccur, than you're out of luck now concerning the cause of the error.

If it does reoccur, you may want to run the database with the default_trace enabled to 'catch' the failing function.

Regards,

Lars

former_member229109
Active Contributor
0 Kudos

Hello Claus,

1. "DBCRASH Kernel exited without core and exitu2026" & , unfortunately,

the "Symbolic Stack Back Trace" was not written. The knltrace and rtedump

didn't give further light on this crash. Please check if you could set the SUPPRESS_CORE

database parameter to NO for the core dump to be created during the next database crash.

< http://maxdb.sap.com/doc/7_6/7e/c3fb0e72fcf84580f7ee9fcec672b7/frameset.htm

Glossary -> Parameters -> Support Database Parameters -> SUPPRESS_CORE >

You need to be sure that you have enough space in database RUNDIRECTORy

for the core dump to be written.

If the core dump will be written, debug it & post the results.

2. Please update with output of the dbm command "param_directgetall" and please post information about the OS of the database server < 'uname -a' ? >.

Are you SAP customer?

Thank you and best regards, Natalia Khlopina

Former Member
0 Kudos

Hello,

I made the suggested settings.

The operating system of the MaxDB server is SuSE Linux 10.3 with kernel version 2.6.22.5-31-bigsmp

Here is the output for "param_directgetall"

KERNELVERSION KERNEL 7.6.05 BUILD 009-121-191-997

INSTANCE_TYPE OLTP

MCOD NO

SERVERDBFOR_SAP YES

_UNICODE NO

DEFAULT_CODE ASCII

DATE_TIME_FORMAT INTERNAL

CONTROLUSERID <username>

CONTROLPASSWORD

MAXLOGVOLUMES 2

MAXDATAVOLUMES 16

LOG_VOLUME_NAME_001 LOG_001

LOG_VOLUME_TYPE_001 F

LOG_VOLUME_SIZE_001 64000

DATA_VOLUME_NAME_0003 DAT_0003

DATA_VOLUME_NAME_0002 DAT_0002

DATA_VOLUME_NAME_0001 DAT_0001

DATA_VOLUME_TYPE_0003 F

DATA_VOLUME_TYPE_0002 F

DATA_VOLUME_TYPE_0001 F

DATA_VOLUME_SIZE_0003 13107200

DATA_VOLUME_SIZE_0002 13107200

DATA_VOLUME_SIZE_0001 13107200

DATA_VOLUME_MODE_0003 NORMAL

DATA_VOLUME_MODE_0002 NORMAL

DATA_VOLUME_MODE_0001 NORMAL

DATA_VOLUME_GROUPS 1

LOG_BACKUP_TO_PIPE NO

MAXBACKUPDEVS 2

LOG_MIRRORED NO

MAXVOLUMES 19

LOG_IO_BLOCK_COUNT 8

DATA_IO_BLOCK_COUNT 64

BACKUP_BLOCK_CNT 64

DELAYLOGWRITER 0

LOG_IO_QUEUE 50

RESTARTTIME 600

MAXCPU 2

LOCAL_REDO_LOG_BUFFER_SIZE 0

MAX_LOG_QUEUE_COUNT 0

USED_MAX_LOG_QUEUE_COUNT 2

LOG_QUEUE_COUNT 1

MAXUSERTASKS 75

TRANSRGNS 8

TABRGNS 8

OMSREGIONS 0

OMSRGNS 7

LOCKMANAGERENABLED NO

LMLOCK_REGIONS 0

LMREQUEST_REGIONS 0

LMTRANS_REGIONS 0

OMS_HEAP_LIMIT 0

OMS_HEAP_COUNT 2

OMS_HEAP_BLOCKSIZE 10000

OMS_HEAP_THRESHOLD 100

OMS_VERS_THRESHOLD 2097152

HEAP_CHECK_LEVEL 0

ROWRGNS 8

RESERVEDSERVERTASKS 21

MINSERVERTASKS 38

MAXSERVERTASKS 38

MAXGARBAGECOLL 1

_MAXTRANS 604

MAXLOCKS 6080

LOCKSUPPLY_BLOCK 100

DEADLOCK_DETECTION 4

DEADLOCK_DUMP_FILENAME

SESSION_TIMEOUT 900

OMS_STREAM_TIMEOUT 30

REQUEST_TIMEOUT 5000

IOPROCSPER_DEV 2

IOPROCSFOR_PRIO 0

IOPROCSFOR_READER 0

USEIOPROCS_ONLY NO

IOPROCSSWITCH 2

LRU_FOR_SCAN NO

PAGESIZE 8192

PACKETSIZE 131072

MINREPLYSIZE 4096

MBLOCKDATA_SIZE 32768

MBLOCKQUAL_SIZE 32768

MBLOCKSTACK_SIZE 32768

MBLOCKSTRAT_SIZE 16384

WORKSTACKSIZE 8192

WORKDATASIZE 8192

CATCACHE_MINSIZE 262144

CAT_CACHE_SUPPLY 4864

INIT_ALLOCATORSIZE 262144

ALLOW_MULTIPLE_SERVERTASK_UKTS NO

TASKCLUSTER01 tw;al;ut;2000sv,100bup;10ev,10gc;

TASKCLUSTER02 ti,100dw;38us;

TASKCLUSTER03 equalize

DYNTASK_STACK NO

MPRGN_QUEUE YES

MPRGN_DIRTY_READ DEFAULT

MPRGN_BUSY_WAIT DEFAULT

MPDISP_LOOPS 2

MPDISP_PRIO DEFAULT

MP_RGN_LOOP -1

MPRGN_PRIO DEFAULT

MAXRGN_REQUEST -1

PRIOBASE_U2U 100

PRIOBASE_IOC 80

PRIOBASE_RAV 80

PRIOBASE_REX 40

PRIOBASE_COM 10

PRIOFACTOR 80

DELAYCOMMIT NO

MAXTASKSTACK 1024

MAX_SERVERTASK_STACK 500

MAX_SPECIALTASK_STACK 500

DWIO_AREA_SIZE 50

DWIO_AREA_FLUSH 50

FBM_VOLUME_COMPRESSION 50

FBM_VOLUME_BALANCE 10

FBMLOW_IO_RATE 10

CACHE_SIZE 150000

DWLRU_TAIL_FLUSH 25

XP_DATA_CACHE_RGNS 0

DATACACHE_RGNS 48

XP_CONVERTER_REGIONS 0

CONVERTER_REGIONS 48

XP_MAXPAGER 0

MAXPAGER 48

SEQUENCE_CACHE 1

IDXFILELIST_SIZE 2048

VOLUMENO_BIT_COUNT 8

OPTIM_MAX_MERGE 500

OPTIM_INV_ONLY YES

OPTIM_CACHE NO

OPTIM_JOIN_FETCH 0

JOIN_SEARCH_LEVEL 0

JOIN_MAXTAB_LEVEL4 16

JOIN_MAXTAB_LEVEL9 5

READAHEADBLOBS 32

READAHEAD_TABLE_THRESHOLD 0

CLUSTER_WRITE_THRESHOLD 80

CLUSTERED_LOBS NO

CLUSTERCOMPRESSIONTHRESHOLD 1000

CLUSTERCOMPRESSIONFILLTHRESHOLD 10

RUNDIRECTORY /var/opt/sdb/data/wrk/<dbname>

OPMSG1 /dev/console

OPMSG2 /dev/null

_KERNELDIAGFILE knldiag

KERNELDIAGSIZE 800

_EVENTFILE knldiag.evt

_EVENTSIZE 0

_MAXEVENTTASKS 2

_MAXEVENTS 100

_KERNELTRACEFILE knltrace

TRACE_PAGES_TI 2

TRACE_PAGES_GC 20

TRACE_PAGES_LW 5

TRACE_PAGES_PG 3

TRACE_PAGES_US 10

TRACE_PAGES_UT 5

TRACE_PAGES_SV 5

TRACE_PAGES_EV 2

TRACE_PAGES_BUP 0

KERNELTRACESIZE 1121

EXTERNAL_DUMP_REQUEST NO

AKDUMP_ALLOWED YES

_KERNELDUMPFILE knldump

_RTEDUMPFILE rtedump

UTILITYPROTFILE dbm.utl

UTILITY_PROTSIZE 100

BACKUPHISTFILE dbm.knl

BACKUPMED_DEF dbm.mdf

MAXMESSAGE_FILES 0

_SHMKERNEL 9640

__PARAM_CHANGED___ 0

__PARAM_VERIFIED__ 2009-01-18 20:09:54

DIAG_HISTORY_NUM 2

DIAG_HISTORY_PATH /var/opt/sdb/data/wrk/<dbname>/DIAGHISTORY

DIAGSEM 1

SHOW_MAX_STACK_USE NO

SHOW_MAX_KB_STACK_USE NO

LOG_SEGMENT_SIZE 21333

_COMMENT

SUPPRESS_CORE NO

FORMATTING_MODE PARALLEL

FORMAT_DATAVOLUME YES

OFFICIAL_NODE

UKT_CPU_RELATIONSHIP NONE

HIRES_TIMER_TYPE CPU

LOAD_BALANCING_CHK 0

LOAD_BALANCING_DIF 10

LOAD_BALANCING_EQ 5

HS_STORAGE_DLL libhsscopy

HS_SYNC_INTERVAL 50

USE_OPEN_DIRECT YES

USE_OPEN_DIRECT_FOR_BACKUP NO

SYMBOL_DEMANGLING NO

EXPAND_COM_TRACE NO

JOIN_TABLEBUFFER 128

SET_VOLUME_LOCK YES

SHAREDSQL YES

SHAREDSQL_CLEANUPTHRESHOLD 25

SHAREDSQL_COMMANDCACHESIZE 262144

MEMORY_ALLOCATION_LIMIT 0

USE_SYSTEM_PAGE_CACHE YES

USE_COROUTINES YES

FORBID_LOAD_BALANCING YES

MIN_RETENTION_TIME 60

MAX_RETENTION_TIME 480

MAX_SINGLE_HASHTABLE_SIZE 512

MAX_HASHTABLE_MEMORY 5120

ENABLE_CHECK_INSTANCE YES

RTE_TEST_REGIONS 0

HASHED_RESULTSET YES

HASHED_RESULTSET_CACHESIZE 262144

CHECK_HASHED_RESULTSET 0

AUTO_RECREATE_BAD_INDEXES NO

AUTHENTICATION_ALLOW

AUTHENTICATION_DENY

TRACE_AK NO

TRACE_DEFAULT NO

TRACE_DELETE NO

TRACE_INDEX NO

TRACE_INSERT NO

TRACE_LOCK NO

TRACE_LONG NO

TRACE_OBJECT NO

TRACE_OBJECT_ADD NO

TRACE_OBJECT_ALTER NO

TRACE_OBJECT_FREE NO

TRACE_OBJECT_GET NO

TRACE_OPTIMIZE NO

TRACE_ORDER NO

TRACE_ORDER_STANDARD NO

TRACE_PAGES NO

TRACE_PRIMARY_TREE NO

TRACE_SELECT NO

TRACE_TIME NO

TRACE_UPDATE NO

TRACE_STOP_ERRORCODE 0

TRACE_ALLOCATOR 0

TRACE_CATALOG 0

TRACE_CLIENTKERNELCOM 0

TRACE_COMMON 0

TRACE_COMMUNICATION 0

TRACE_CONVERTER 0

TRACE_DATACHAIN 0

TRACE_DATACACHE 0

TRACE_DATAPAM 0

TRACE_DATATREE 0

TRACE_DATAINDEX 0

TRACE_DBPROC 0

TRACE_FBM 0

TRACE_FILEDIR 0

TRACE_FRAMECTRL 0

TRACE_IOMAN 0

TRACE_IPC 0

TRACE_JOIN 0

TRACE_KSQL 0

TRACE_LOGACTION 0

TRACE_LOCKMANAGER 0

TRACE_LOGHISTORY 0

TRACE_LOGPAGE 0

TRACE_LOGTRANS 0

TRACE_LOGVOLUME 0

TRACE_MEMORY 0

TRACE_MESSAGES 0

TRACE_OBJECTCONTAINER 0

TRACE_OMS_CONTAINERDIR 0

TRACE_OMS_CONTEXT 0

TRACE_OMS_ERROR 0

TRACE_OMS_FLUSHCACHE 0

TRACE_OMS_INTERFACE 0

TRACE_OMS_KEY 0

TRACE_OMS_KEYRANGE 0

TRACE_OMS_LOCK 0

TRACE_OMS_MEMORY 0

TRACE_OMS_NEWOBJ 0

TRACE_OMS_SESSION 0

TRACE_OMS_STREAM 0

TRACE_OMS_VAROBJECT 0

TRACE_OMS_VERSION 0

TRACE_PAGER 0

TRACE_RUNTIME 0

TRACE_SHAREDSQL 0

TRACE_SQLMANAGER 0

TRACE_SRVTASKS 0

TRACE_SYNCHRONISATION 0

TRACE_SYSVIEW 0

TRACE_TABLE 0

TRACE_VOLUME 0

CHECK_BACKUP NO

CHECK_DATACACHE NO

CHECK_KB_REGIONS NO

CHECK_LOCK NO

CHECK_LOCK_SUPPLY NO

CHECK_REGIONS NO

CHECK_TASK_SPECIFIC_CATALOGCACHE NO

CHECK_TRANSLIST NO

CHECK_TREE NO

CHECK_TREE_LOCKS NO

CHECK_COMMON 0

CHECK_CONVERTER 0

CHECK_DATAPAGELOG 0

CHECK_DATAINDEX 0

CHECK_FBM 0

CHECK_IOMAN 0

CHECK_LOGHISTORY 0

CHECK_LOGPAGE 0

CHECK_LOGTRANS 0

CHECK_LOGVOLUME 0

CHECK_SRVTASKS 0

OPTIMIZE_AGGREGATION YES

OPTIMIZE_FETCH_REVERSE YES

OPTIMIZE_STAR_JOIN YES

OPTIMIZE_JOIN_ONEPHASE YES

OPTIMIZE_JOIN_OUTER YES

OPTIMIZE_MIN_MAX YES

OPTIMIZE_FIRST_ROWS YES

OPTIMIZE_OPERATOR_JOIN YES

OPTIMIZE_JOIN_HASHTABLE YES

OPTIMIZE_JOIN_HASH_MINIMAL_RATIO 1

OPTIMIZE_OPERATOR_JOIN_COSTFUNC YES

OPTIMIZE_JOIN_PARALLEL_MINSIZE 1000000

OPTIMIZE_JOIN_PARALLEL_SERVERS 0

OPTIMIZE_JOIN_OPERATOR_SORT YES

OPTIMIZE_QUAL_ON_INDEX YES

DDLTRIGGER YES

SUBTREE_LOCKS NO

MONITOR_READ 2147483647

MONITOR_TIME 2147483647

MONITOR_SELECTIVITY 0

MONITOR_ROWNO 0

CALLSTACKLEVEL 0

OMS_RUN_IN_UDE_SERVER NO

OPTIMIZE_QUERYREWRITE OPERATOR

TRACE_QUERYREWRITE 0

CHECK_QUERYREWRITE 0

PROTECT_DATACACHE_MEMORY NO

FILEDIR_SPINLOCKPOOL_SIZE 10

TRANS_HISTORY_SIZE 0

TRANS_THRESHOLD_VALUE 60

ENABLE_SYSTEM_TRIGGERS YES

DBFILLINGABOVELIMIT 70L80M85M90H95H96H97H98H99H

DBFILLINGBELOWLIMIT 70L80L85L90L95L

LOGABOVELIMIT 50L75L90M95M96H97H98H99H

AUTOSAVE 1

BACKUPRESULT 1

CHECKDATA 1

EVENT 1

ADMIN 1

ONLINE 1

UPDSTATWANTED 1

OUTOFSESSIONS 3

ERROR 3

SYSTEMERROR 3

DATABASEFULL 1

LOGFULL 1

LOGSEGMENTFULL 1

STANDBY 1

USESELECTFETCH YES

USEVARIABLEINPUT NO

UPDATESTAT_PARALLEL_SERVERS 0

UPDATESTAT_SAMPLE_ALGO 1

SIMULATE_VECTORIO IF_OPEN_DIRECT_OR_RAW_DEVICE

COLUMNCOMPRESSION YES

TIME_MEASUREMENT NO

CHECK_TABLE_WIDTH NO

MAX_MESSAGE_LIST_LENGTH 100

SYMBOL_RESOLUTION YES

PREALLOCATE_IOWORKER NO

CACHE_IN_SHARED_MEMORY NO

INDEX_LEAF_CACHING 2

NO_SYNC_TO_DISK_WANTED NO

SPINLOCK_LOOP_COUNT 30000

SPINLOCK_BACKOFF_BASE 1

SPINLOCK_BACKOFF_FACTOR 2

SPINLOCK_BACKOFF_MAXIMUM 64

ROW_LOCKS_PER_TRANSACTION 50

USEUNICODECOLUMNCOMPRESSION NO

FBM_CLUSTER_MODE MIXED

I found a file called "comseg.dump" in the "DIAGHISTORY" directory. Here are the first lines from the file:

====================================================

Big Communication segment dump for UKT007 (due to Task T097)

-


big_comseg_header DUMP (size 4983832)-----

bc_size 4983832

bc_version 1

bc_comseg_cnt 38

bc_packet_cnt 38

bc_comseg_size 72

bc_packet_size 131072

bc_comseg_offset 48

bc_list_offset 2784

bc_packet_offset 3088

bc_kp_running 0

bc_common_flag 1

-


big_comseg content DUMP-----

0x00000 180B4B00 01000000 26000000 26000000 ..L.....&...&...

0x00010 48000000 00000200 30000000 D0000000 H.......0.......

0x00020 100B0000 00000000 01000000 00000000 ................

0x00030 00000000 01000000 01000000 00000200 ................

0x00040 D0000000 00000000 70230000 00000000 ........z#......

0x00050 01000000 00000000 00000000 00000000 ................

0x00060 02000000 00000000 04800200 12000404 ................

0x00070 00000000 00000000 00000000 01000000 ................

0x00080 01000000 00000200 D8000000 00000000 ................

0x00090 78230000 00000000 01000000 00000000 x#..............

0x000A0 00000000 00000000 02000000 00000000 ................

0x000B0 04800200 12800304 00000000 00000000 ................

0x000C0 00000000 01000000 01000000 00000200 ................

0x000D0 F0000000 00000000 7B230000 00000000 ........|#......

0x000E0 01000000 00000000 00000000 00000000 ................

0x000F0 02000000 00000000 04800200 12800404 ................

0x00100 00000000 00000000 00000000 01000000 ................

0x00110 01000000 00000200 F8000000 00000000 ................

0x00120 34230000 00000000 01000000 00000000 4#..............

0x00130 00000000 00000000 02000000 00000000 ................

0x00140 04800200 1200F503 00000000 00000000 ................

0x00150 00000000 01000000 01000000 00000200 ................

0x00160 000A0000 00000000 86230000 00000000 .........#......

0x00170 01000000 00000000 00000000 00000000 ................

0x00180 02000000 00000000 04800200 12000704 ................

0x00190 00000000 00000000 00000000 01000000 ................

0x001A0 01000000 00000200 080A0000 00000000 ................

0x001B0 7D230000 00000000 01000000 00000000 ~#..............

0x001C0 00000000 00000000 02000000 00000000 ................

0x001D0 04800200 12000504 00000000 00000000 ................

0x001E0 00000000 01000000 01000000 00000200 ................

0x001F0 100A0000 00000000 80230000 00000000 .........#......

0x00200 01000000 00000000 00000000 00000000 ................

0x00210 02000000 00000000 04800200 12800504 ................

0x00220 00000000 00000000 00000000 01000000 ................

0x00230 01000000 00000200 180A0000 00000000 ................

0x00240 84230000 00000000 01000000 00000000 .#..............

0x00250 00000000 00000000 02000000 00000000 ................

0x00260 04800200 12800604 00000000 00000000 ................

0x00270 00000000 01000000 01000000 00000200 ................

0x00280 200A0000 00000000 88230000 00000000 ........#......

0x00290 01000000 00000000 00000000 00000000 ................

0x002A0 02000000 00000000 04800200 12800704 ................

0x002B0 00000000 00000000 00000000 01000000 ................

0x002C0 01000000 00000200 280A0000 00000000 ........(.......

0x002D0 4F230000 00000000 01000000 00000000 O#..............

0x002E0 00000000 00000000 02000000 00000000 ................

0x002F0 04800200 1280F003 00000000 00000000 ................

0x00300 00000000 01000000 01000000 00000200 ................

0x00310 300A0000 00000000 38230000 00000000 0.......8#......

0x00320 01000000 00000000 00000000 00000000 ................

0x00330 02000000 00000000 04800200 1200F603 ................

0x00340 00000000 00000000 00000000 01000000 ................

0x00350 01000000 00000200 380A0000 00000000 ........8.......

0x00360 30230000 00000000 01000000 00000000 :#..............

0x00370 00000000 00000000 02000000 00000000 ................

0x00380 04800200 1280F603 00000000 00000000 ................

0x00390 00000000 01000000 01000000 00000200 ................

0x003A0 400A0000 00000000 3B230000 00000000 @.......<#......

0x003B0 01000000 00000000 00000000 00000000 ................

0x003C0 02000000 00000000 04800200 1200F703 ................

0x003D0 00000000 00000000 00000000 01000000 ................

0x003E0 01000000 00000200 480A0000 00000000 ........H.......

0x003F0 43230000 00000000 01000000 00000000 C#..............

0x00400 00000000 00000000 02000000 00000000 ................

0x00410 04800200 1280F703 00000000 00000000 ................

0x00420 00000000 01000000 01000000 00000200 ................

0x00430 500A0000 00000000 45230000 00000000 P.......E#......

0x00440 01000000 00000000 00000000 00000000 ................

0x00450 02000000 00000000 04800200 1200F803 ................

0x00460 00000000 00000000 00000000 01000000 ................

0x00470 01000000 00000200 580A0000 00000000 ........X.......

0x00480 49230000 00000000 01000000 00000000 I#..............

0x00490 00000000 00000000 02000000 00000000 ................

0x004A0 04800200 1200F903 00000000 00000000 ................

0x004B0 00000000 01000000 01000000 00000200 ................

0x004C0 600A0000 00000000 6D230000 00000000 `.......n#......

0x004D0 01000000 00000000 00000000 00000000 ................

0x004E0 02000000 00000000 04800200 12000104 ................

0x004F0 00000000 00000000 00000000 01000000 ................

0x00500 01000000 00000200 680A0000 00000000 ........h.......

0x00510 6B230000 00000000 01000000 00000000 l#..............

0x00520 00000000 00000000 02000000 00000000 ................

0x00530 04800200 12800004 00000000 00000000 ................

0x00540 00000000 01000000 01000000 00000200 ................

0x00550 700A0000 00000000 47230000 00000000 p.......G#......

0x00560 01000000 00000000 00000000 00000000 ................

0x00570 02000000 00000000 04800200 1280F803 ................

0x00580 00000000 00000000 00000000 01000000 ................

0x00590 01000000 00000200 780A0000 00000000 ........x.......

0x005A0 4C230000 00000000 01000000 00000000 M#..............

0x005B0 00000000 00000000 02000000 00000000 ................

0x005C0 04800200 1200F003 00000000 00000000 ................

0x005D0 00000000 01000000 01000000 00000200 ................

0x005E0 800A0000 00000000 4A230000 00000000 ........K#......

0x005F0 01000000 00000000 00000000 00000000 ................

0x00600 02000000 00000000 04800200 1280F903 ................

0x00610 00000000 00000000 00000000 01000000 ................

0x00620 01000000 00000200 880A0000 00000000 ................

0x00630 53230000 00000000 01000000 00000000 S#..............

0x00640 00000000 00000000 02000000 00000000 ................

0x00650 04800200 1280FA03 00000000 00000000 ................

0x00660 00000000 01000000 01000000 00000200 ................

0x00670 900A0000 00000000 51230000 00000000 ........Q#......

0x00680 01000000 00000000 00000000 00000000 ................

0x00690 02000000 00000000 04800200 1200FA03 ................

0x006A0 00000000 00000000 00000000 01000000 ................

0x006B0 01000000 00000200 980A0000 00000000 ................

0x006C0 55230000 00000000 01000000 00000000 U#..............

0x006D0 00000000 00000000 02000000 00000000 ................

0x006E0 04800200 1200FB03 00000000 00000000 ................

0x006F0 00000000 01000000 01000000 00000200 ................

0x00700 000A0000 00000000 57230000 00000000 ........W#......

0x00710 01000000 00000000 00000000 00000000 ................

0x00720 02000000 00000000 04800200 1280FB03 ................

0x00730 00000000 00000000 00000000 01000000 ................

0x00740 01000000 00000200 080A0000 00000000 ................

0x00750 59230000 00000000 01000000 00000000 Y#..............

0x00760 00000000 00000000 02000000 00000000 ................

0x00770 04800200 1200FC03 00000000 00000000 ................

0x00780 00000000 01000000 01000000 00000200 ................

0x00790 A00A0000 00000000 5A230000 00000000 ........[#......

0x007A0 01000000 00000000 00000000 00000000 ................

0x007B0 02000000 00000000 04800200 1280FC03 ................

0x007C0 00000000 00000000 00000000 01000000 ................

0x007D0 01000000 00000200 A80A0000 00000000 ................

0x007E0 62230000 00000000 01000000 00000000 b#..............

0x007F0 00000000 00000000 02000000 00000000 ................

0x00800 04800200 1200FD03 00000000 00000000 ................

0x00810 00000000 01000000 01000000 00000200 ................

0x00820 B00A0000 00000000 64230000 00000000 ........d#......

0x00830 01000000 00000000 00000000 00000000 ................

0x00840 02000000 00000000 04800200 1280FD03 ................

0x00850 00000000 00000000 00000000 01000000 ................

0x00860 01000000 00000200 B80A0000 00000000 ................

0x00870 66230000 00000000 01000000 00000000 f#..............

0x00880 00000000 00000000 02000000 00000000 ................

0x00890 04800200 1200FF03 00000000 00000000 ................

0x008A0 00000000 01000000 01000000 00000200 ................

0x008B0 C00A0000 00000000 68230000 00000000 ........h#......

0x008C0 01000000 00000000 00000000 00000000 ................

0x008D0 02000000 00000000 04800200 1280FF03 ................

0x008E0 00000000 00000000 00000000 01000000 ................

0x008F0 01000000 00000200 C80A0000 00000000 ................

0x00900 60230000 00000000 01000000 00000000 j#..............

0x00910 00000000 00000000 02000000 00000000 ................

0x00920 04800200 12000004 00000000 00000000 ................

0x00930 00000000 01000000 01000000 00000200 ................

0x00940 D00A0000 00000000 36230000 00000000 ........6#......

0x00950 01000000 00000000 00000000 00000000 ................

0x00960 02000000 00000000 04800200 1280F503 ................

0x00970 00000000 00000000 00000000 01000000 ................

0x00980 01000000 00000200 D80A0000 00000000 ................

0x00990 82230000 00000000 01000000 00000000 .#..............

0x009A0 00000000 00000000 02000000 00000000 ................

0x009B0 04800200 12000604 00000000 00000000 ................

0x009C0 00000000 01000000 01000000 00000200 ................

0x009D0 F00A0000 00000000 70230000 00000000 ........p#......

0x009E0 01000000 00000000 00000000 00000000 ................

0x009F0 02000000 00000000 04800200 12800104 ................

0x00A00 00000000 00000000 00000000 01000000 ................

0x00A10 01000000 00000200 F80A0000 00000000 ................

0x00A20 72230000 00000000 01000000 00000000 r#..............

0x00A30 00000000 00000000 02000000 00000000 ................

0x00A40 04800200 12000204 00000000 00000000 ................

0x00A50 00000000 01000000 01000000 00000200 ................

0x00A60 000B0000 00000000 76230000 00000000 ........v#......

0x00A70 01000000 00000000 00000000 00000000 ................

0x00A80 02000000 00000000 04800200 12000304 ................

0x00A90 00000000 00000000 00000000 01000000 ................

0x00AA0 01000000 00000200 080B0000 00000000 ................

0x00AB0 74230000 00000000 01000000 00000000 t#..............

0x00AC0 00000000 00000000 02000000 00000000 ................

0x00AD0 04800200 12800204 00000000 00000000 ................

0x00AE0 100B0000 00000000 100B0200 00000000 ................

0x00AF0 100B0400 00000000 100B0600 00000000 ................

0x00B00 100B0800 00000000 100B0000 00000000 ................

0x00B10 100B0B00 00000000 100B0D00 00000000 ................

0x00B20 100B1000 00000000 100B1200 00000000 ................

0x00B30 100B1400 00000000 100B1600 00000000 ................

0x00B40 100B1800 00000000 100B1000 00000000 ................

0x00B50 100B1B00 00000000 100B1D00 00000000 ................

0x00B60 100B2000 00000000 100B2200 00000000 .. .......".....

0x00B70 100B2400 00000000 100B2600 00000000 ..$.......&.....

0x00B80 100B2800 00000000 100B2000 00000000 ..(.......*.....

0x00B90 100B2B00 00000000 100B2D00 00000000 ..,.............

0x00BA0 100B3000 00000000 100B3200 00000000 ..0.......2.....

0x00BB0 100B3400 00000000 100B3600 00000000 ..4.......6.....

0x00BC0 100B3800 00000000 100B3000 00000000 ..8.......:.....

0x00BD0 100B3B00 00000000 100B3D00 00000000 ..<.......>.....

0x00BE0 100B4000 00000000 100B4200 00000000 ..@.......B.....

0x00BF0 100B4400 00000000 100B4600 00000000 ..D.......F.....

0x00C00 100B4800 00000000 100B4000 00000000 ..H.......J.....

0x00C10 60000000 00400000 5D000000 01000000 `....@..^.......

0x00C20 00000400 60000000 00020000 37303630 ....`.......7060

0x00C30 354F4442 60FF0100 28000000 00000100 5ODB`...(.......

0x00C40 00000000 00000000 28000000 00000000 ........(.......

0x00C50 00000100 02303030 30300000 00000000 .....00000......

0x00C60 00000000 F2000000 00000000 00000000 ................

0x00C70 03000100 00000000 15000000 28FF0100 ............(...

0x00C80 524F4B4B 4241434A 20574F52 4A205245 ROLLBACK WORK RE

0x00C90 4B454153 45FFFFFF 0B000000 08FF0100 LEASE...........

0x00CA0 000FBF5F 00003001 54002B00 FFFFFFFF ..._..:.T.,.....

0x00CB0 0B000100 00000000 07000000 D8FD0100 ................

0x00CC0 FF303839 336532FF 36376630 35323532 .0893e2.67f05252

0x00CD0 36636335 31646139 31323032 32313030 6cc51da912022100

0x00CE0 30302720 4F524445 52204259 20636DFF 00' ORDER BY cn.

0x00CF0 00000000 B4178400 000000B4 17850000 ................

0x00D00 0000B417 86000000 00B41787 00000000 ................

0x00D10 B4178800 000000B4 17890000 0000B418 ................

0x00D20 98000000 FFFFFFFF 0A000100 00000000 ................

0x00D30 0B000000 70FD0100 000FBF5F 00003001 ....p......_..:.

0x00D40 54002B00 FFFFFFFF 20202020 20202020 T.,.....

0x00D50 20202020 20202020 20202020 20202020

0x00D60 - 0x00D8F identical

0x00D90 20202020 20202020 20206465 20202020 de

0x00DA0 20202020 20202020 20202020 20202020

0x00DB0 - 0x0118F identical

0x01190 20202020 20202020 2020FFFF FFFFFFFF ......

0x011A0 0A000100 00000000 0B000000 F8F90100 ................

0x011B0 000FBF5F 00003101 54002B00 FFFFFFFF ..._..1.T.,.....

0x011C0 20202020 20202020 08005375 6D646179 ..Sunday

0x011D0 20202020 20202020 20202020 20202020

0x011E0 20200600 5065726F 20202020 20202020 ..Zero

0x011F0 04005065 726F6574 68202020 20200700 ..Zeroeth ..

0x01200 4F6D6520 20202020 20202020 03004669 One ..Fi

0x01210 72737420 20202020 20200500 54776F20 rst ..Two

0x01220 20202020 20202020 03005365 636F6D64 ..Second

0x01230 20202020 20200600 54687265 65202020 ..Three

0x01240 20202020 05005468 69726420 20202020 ..Third

0x01250 20200500 466F7572 20202020 20202020 ..Four

0x01260 0400466F 75727468 20202020 20200600 ..Fourth ..

0x01270 46697665 20202020 20202020 04004669 Five ..Fi

0x01280 66746820 20202020 20200500 53697820 fth ..Six

0x01290 20202020 20202020 03005369 78746820 ..Sixth

0x012A0 20202020 20200500 53657665 6D202020 ..Seven

0x012B0 20202020 05005365 76656D74 68202020 ..Seventh

0x012C0 20200700 45696768 74202020 20202020 ..Eight

0x012D0 05004569 67687468 20202020 20200600 ..Eighth ..

0x012E0 4D696D65 20202020 20202020 04004D69 Nine ..Ni

0x012F0 6D746820 20202020 20200500 54656D20 nth ..Ten

0x01300 20202020 20202020 03005465 6D746820 ..Tenth

0x01310 20202020 20200500 456B6576 656D2020 ..Eleven

0x01320 20202020 0600456B 6576656D 74682020 ..Eleventh

0x01330 20200800 5477656B 76652020 20202020 ..Twelve

0x01340 06005477 656B6674 68202020 20200700 ..Twelfth ..

0x01350 54686972 7465656D 20202020 08005468 Thirteen ..Th

0x01360 69727465 656D7468 20200000 466F7572 irteenth ..Four

0x01370 7465656D 20202020 0800466F 75727465 teen ..Fourte

0x01380 656D7468 20200000 46696674 65656D20 enth ..Fifteen

0x01390 20202020 07004669 66746565 6D746820 ..Fifteenth

0x013A0 20200900 53697874 65656D20 20202020 ..Sixteen

0x013B0 07005369 78746565 6D746820 20200900 ..Sixteenth ..

0x013C0 53657665 6D746565 6D202020 09005365 Seventeen ..Se

0x013D0 76656D74 65656D74 68200A00 45696768 venteenth ..Eigh

0x013E0 7465656D 20202020 08004569 67687465 teen ..Eighte

0x013F0 656D7468 20200000 4D696D65 7465656D enth ..Nineteen

0x01400 20202020 08004D69 6D657465 656D7468 ..Nineteenth

0x01410 20200000 5477656D 74792020 20202020 ..Twenty

0x01420 06005477 656D7469 65746820 20200900 ..Twentieth ..

0x01430 54686972 74792020 20202020 06005468 Thirty ..Th

0x01440 69727469 65746820 20200900 466F7572 irtieth ..Four

0x01450 74792020 20202020 0600466F 75727469 ty ..Fourti

0x01460 65746820 20200900 46696674 79202020 eth ..Fifty

0x01470 20202020 05004669 66746965 74682020 ..Fiftieth

0x01480 20200800 53697874 79202020 20202020 ..Sixty

0x01490 05005369 78746965 74682020 20200800 ..Sixtieth ..

0x014A0 53657665 6D747920 20202020 07005365 Seventy ..Se

0x014B0 76656D74 69657468 20200000 45696768 ventieth ..Eigh

0x014C0 74792020 20202020 06004569 67687469 ty ..Eighti

0x014D0 65746820 20200900 4D696D65 74792020 eth ..Ninety

0x014E0 20202020 06004D69 6D657469 65746820 ..Ninetieth

0x014F0 20200900 00000000 00000000 00000000 ..............

.... <much more>

It seems to contain some sql queries and other informations. Can I convert the file to a more readable format ? Is the content helpful ?

The company I am working for is a SAP customer.

Bye

Claus

lbreddemann
Active Contributor
0 Kudos

> The operating system of the MaxDB server is SuSE Linux 10.3 with kernel version 2.6.22.5-31-bigsmp

> I found a file called "comseg.dump" in the "DIAGHISTORY" directory. Here are the first lines from the file:

> ====================================================

> Big Communication segment dump for UKT007 (due to Task T097)

> -


big_comseg_header DUMP (size 4983832)-----

> bc_size 4983832

> bc_version 1

> bc_comseg_cnt 38

> bc_packet_cnt 38

> bc_comseg_size 72

> bc_packet_size 131072

> bc_comseg_offset 48

> bc_list_offset 2784

> bc_packet_offset 3088

> bc_kp_running 0

> bc_common_flag 1

> -


big_comseg content DUMP-----

Currently all we can see here is the content of the communication buffer - not too useful for any non-developer of MaxDB. Anyhow, we at least know that it belonged to usertask 97.

Given the information from the knldiag you already posted:

> 2009-01-13 11:03:22 3191 11561 COMMUNIC Connecting T97 localhost 2460

2009-01-13 11:03:22 0 12853 DBSTATE Caught signal 11(SIGSEGV)

It looks like the segmentation violation occured directly after the connection had been opened.

Can you confirm that the comseg.dump file has the same timestamp?

Do you know what the first statements of the application after the connect were?

> The company I am working for is a SAP customer.

Well, that's always a good thing

If the database we're talking about is the database for a SAP system, you really should open a support message.

If it is "just" the database for a Non-SAP-System, then it doesn't matter if your employer is a SAP customer (except they paid extra support for the Non-SAP-MaxDB-instance).

Anyhow, the most interesting thing was not done yet: debugging the core file (via gdb) to get the call stack of the task that ran into the segmentation violation.

Based on the "SUPPRESS_CORE=NO" setting there should have been a core dump written out.

Maybe the file was already copied to the DIAGHISTORY subfolder...!?

Unfortunately we don't know which thread crashed here, so there may be quite a number of threads that need to be checked...

regards,

Lars

Former Member
0 Kudos

Hello,

The posted comseg.dump file has the same timestamp as the second crash. I also have another comseq.dump file for the first crash.

I am the author of the application that uses the MaxDB database. It's no problem for me to check all of my queries, but I haven't found a problem yet. First executed queries are for user authentication and user object creation.

The database is used by a Non-SAP-System.

I set "SUPPRESS_CORE" to "NO" after the suggestion from Natalia. When the crashes occured its value was "YES".

Bye

Claus

lbreddemann
Active Contributor
0 Kudos

> The posted comseg.dump file has the same timestamp as the second crash.

Ok, so that is at least something we know...

> I am the author of the application that uses the MaxDB database. It's no problem for me to check all of my queries, but I haven't found a problem yet. First executed queries are for user authentication and user object creation.

Hmm... of course there should not be any possibility for user statements to cause a segmentation violation of the database server, therefore it's not likely that you can see the problem right away.

Anyhow, I propose to setup a tracing for those first statements (including information from the sessions view - select * from sessions where own='YES' to make it possible to identify the usertask later on.).

> The database is used by a Non-SAP-System.

Bummer! Now we've to stick to the forum for further investigation.

Maybe you can provide some more details about your application.

What client do you use? JDBC, SQLDBC, Precompiler or ODBC?

> I set "SUPPRESS_CORE" to "NO" after the suggestion from Natalia. When the crashes occured its value was "YES".

Ok, so we've to wait for the next dump...

regards,

Lars

Former Member
0 Kudos

Hello,

My application is written in PHP 5 (currently installed is version 5.2.6) and I am connection to the database through ODBC (sapdb library). I never had such database crashes before.

I checked my source code the last couple of days and tried to reproduce the crash, but I had no luck yet.

Bye

Claus

former_member229109
Active Contributor
0 Kudos

Hello Claus,

"RTE Version 'X32/LINUX 7.6.05 Build 009-121-191-997'"

-> Do you have the 32bit server?

"My application is written in PHP 5 (currently installed is version 5.2.6)

and I am connection to the database through ODBC (sapdb library).

I never had such database crashes before."

-> Do you know what applications where running during the database crash?

Please update with output of the command 'sdbregview -l' to see the

version of ODBC database package installed.

-> You posted some of the "comseg.dump" lines from "DIAGHISTORY" subdirectory.

Could you please check the rtedump concerning Task T097 & post all info on this task from rtedump.

"ROLLBACK WORK RELEASE..........." for this task. Do you know what SQL query was running?

-> There are current database parameters settings:

MAX_HASHTABLE_MEMORY 5120

HASHED_RESULTSET YES

SHAREDSQL YES

SHAREDSQL_COMMANDCACHESIZE 262144

OMS_HEAP_COUNT 2

CACHE_SIZE 150000

CHECK_TASK_SPECIFIC_CATALOGCACHE NO

MAXTASKSTACK 1024

Correct?

Questions:

Did you see that the system heap grow up during the application run?

< You could use the DB analyzer to check high memory consumption. >

Are you using joins in the SQL statements?

< Please see SAP Note No. 814704, there are some restrictions for the database parameter HASHED_RESULTSET. >

Are you using join select within clustered tables?

Thank you and best regards, Natalia Khlopina

Former Member
0 Kudos

Hello,

-> Do you have the 32bit server?

Yes, all software on the server is 32bit.

-> Do you know what applications where running during the database crash?

Except from standard OS software, only MaxDB and an Apache webserver are running.

-> Please update with output of the command 'sdbregview -l'

Here is the output:

DB Analyzer /opt/sdb/programs 7.6.05.09 32 bit valid

Server Utilities /opt/sdb/programs 7.6.05.09 32 bit valid

Synchronization Manager /opt/sdb/programs 7.6.03.07 valid

Redist Python /opt/sdb/programs 7.6.05.09 32 bit valid

Base /opt/sdb/programs 7.6.05.09 32 bit valid

JDBC /opt/sdb/programs 7.6.05.06 valid

Messages /opt/sdb/programs MSG 0.6906 valid

ODBC /opt/sdb/programs 7.6.05.09 32 bit valid

Database Kernel /opt/sdb/7603 7.6.05.09 32 bit valid

Loader /opt/sdb/programs 7.6.05.09 32 bit valid

SQLDBC /opt/sdb/programs 7.6.05.09 32 bit valid

-> Could you please check the rtedump concerning Task T097 & post all info on this task from rtedump.

These are all lines with T97 infos:

-


T97 USER ( pid = 2460 ) -


remote_node : localhost remote_pid : 2460

dispatcher_cnt: 179 command_cnt : 178

exclusive_cnt : 539859 self_susp_cnt : 0

Resume count 0 total 2403 History [ T2 T55 T55 ]

state_vwait : 0 state_vsleep : 0 state_vsusp : 0

rcv_rpl_count : 178 rcv_rpl_long : 0 avg_rcv_rpl_t : 0.0000

-


Inx Region Get-Counts Collision-Counts

Total / Task / percent Total / Task / percent

3 CONV1 1780 / 11 / 0.62 % 0 / 0 / 0.00 %

4 CONV2 1623 / 10 / 0.62 % 0 / 0 / 0.00 %

5 CONV3 1765 / 9 / 0.51 % 0 / 0 / 0.00 %

6 CONV4 1720 / 9 / 0.52 % 0 / 0 / 0.00 %

7 CONV5 1869 / 9 / 0.48 % 0 / 0 / 0.00 %

8 CONV6 2002 / 5 / 0.25 % 0 / 0 / 0.00 %

9 CONV7 2289 / 7 / 0.31 % 0 / 0 / 0.00 %

10 CONV8 2125 / 7 / 0.33 % 0 / 0 / 0.00 %

11 CONV9 1427 / 11 / 0.77 % 0 / 0 / 0.00 %

12 CONV10 1461 / 11 / 0.75 % 0 / 0 / 0.00 %

13 CONV11 1748 / 11 / 0.63 % 0 / 0 / 0.00 %

14 CONV12 1610 / 14 / 0.87 % 0 / 0 / 0.00 %

15 CONV13 2132 / 14 / 0.66 % 0 / 0 / 0.00 %

16 CONV14 1578 / 16 / 1.01 % 0 / 0 / 0.00 %

17 CONV15 1946 / 14 / 0.72 % 0 / 0 / 0.00 %

18 CONV16 1746 / 13 / 0.74 % 0 / 0 / 0.00 %

19 CONV17 5523 / 17 / 0.31 % 0 / 0 / 0.00 %

20 CONV18 5464 / 14 / 0.26 % 0 / 0 / 0.00 %

21 CONV19 4992 / 16 / 0.32 % 0 / 0 / 0.00 %

22 CONV20 4720 / 16 / 0.34 % 0 / 0 / 0.00 %

23 CONV21 4727 / 13 / 0.28 % 0 / 0 / 0.00 %

24 CONV22 4832 / 13 / 0.27 % 0 / 0 / 0.00 %

25 CONV23 4656 / 12 / 0.26 % 0 / 0 / 0.00 %

26 CONV24 4732 / 10 / 0.21 % 0 / 0 / 0.00 %

27 CONV25 2137 / 7 / 0.33 % 0 / 0 / 0.00 %

28 CONV26 1888 / 6 / 0.32 % 0 / 0 / 0.00 %

29 CONV27 2080 / 8 / 0.38 % 0 / 0 / 0.00 %

30 CONV28 2722 / 8 / 0.29 % 0 / 0 / 0.00 %

31 CONV29 2225 / 9 / 0.40 % 0 / 0 / 0.00 %

32 CONV30 2316 / 9 / 0.39 % 0 / 0 / 0.00 %

33 CONV31 2086 / 10 / 0.48 % 0 / 0 / 0.00 %

34 CONV32 2221 / 14 / 0.63 % 0 / 0 / 0.00 %

35 CONV33 6434 / 14 / 0.22 % 0 / 0 / 0.00 %

36 CONV34 6257 / 16 / 0.26 % 0 / 0 / 0.00 %

37 CONV35 5866 / 22 / 0.38 % 0 / 0 / 0.00 %

38 CONV36 5797 / 16 / 0.28 % 0 / 0 / 0.00 %

39 CONV37 5652 / 15 / 0.27 % 0 / 0 / 0.00 %

40 CONV38 5684 / 18 / 0.32 % 0 / 0 / 0.00 %

41 CONV39 6112 / 21 / 0.34 % 0 / 0 / 0.00 %

42 CONV40 5201 / 14 / 0.27 % 0 / 0 / 0.00 %

43 CONV41 3079 / 12 / 0.39 % 0 / 0 / 0.00 %

44 CONV42 3672 / 13 / 0.35 % 0 / 0 / 0.00 %

45 CONV43 3880 / 17 / 0.44 % 0 / 0 / 0.00 %

46 CONV44 3783 / 10 / 0.26 % 0 / 0 / 0.00 %

47 CONV45 3780 / 12 / 0.32 % 0 / 0 / 0.00 %

48 CONV46 3928 / 10 / 0.25 % 0 / 0 / 0.00 %

49 CONV47 3325 / 10 / 0.30 % 0 / 0 / 0.00 %

50 CONV48 4359 / 12 / 0.28 % 0 / 0 / 0.00 %

53 DIAGCACH 8150 / 208 / 2.55 % 0 / 0 / 0.00 %

56 LOCKINIT 2092506 / 47831 / 2.29 % 0 / 0 / 0.00 %

57 LOCKPOOL 22509 / 34 / 0.15 % 0 / 0 / 0.00 %

61 LOGQUE1 2366 / 70 / 2.96 % 1213 / 0 / 0.00 %

66 SERVER 47905 / 197 / 0.41 % 1 / 0 / 0.00 %

67 SRVTASK 28852 / 197 / 0.68 % 8045 / 0 / 0.00 %

68 SURROGAT 23599 / 86 / 0.36 % 0 / 0 / 0.00 %

75 RANDMGEN 3886 / 102 / 2.62 % 0 / 0 / 0.00 %

86 DATA1 272327 / 4692 / 1.72 % 5027 / 0 / 0.00 %

87 DATA2 62608 / 899 / 1.44 % 3616 / 0 / 0.00 %

88 DATA3 143046 / 3842 / 2.69 % 7625 / 0 / 0.00 %

89 DATA4 81378 / 2037 / 2.50 % 7629 / 0 / 0.00 %

90 DATA5 155192 / 2420 / 1.56 % 5427 / 0 / 0.00 %

91 DATA6 116221 / 1992 / 1.71 % 4825 / 0 / 0.00 %

92 DATA7 99933 / 1850 / 1.85 % 5423 / 0 / 0.00 %

93 DATA8 68148 / 1253 / 1.84 % 5422 / 0 / 0.00 %

94 DATA9 662958 / 10648 / 1.61 % 7716 / 0 / 0.00 %

95 DATA10 61956 / 848 / 1.37 % 4519 / 0 / 0.00 %

96 DATA11 44018 / 597 / 1.36 % 4830 / 0 / 0.00 %

97 DATA12 184427 / 3626 / 1.97 % 6020 / 0 / 0.00 %

98 DATA13 55285 / 918 / 1.66 % 6426 / 0 / 0.00 %

99 DATA14 67000 / 1187 / 1.77 % 5122 / 0 / 0.00 %

100 DATA15 99934 / 2071 / 2.07 % 6628 / 0 / 0.00 %

101 DATA16 76041 / 1467 / 1.93 % 4223 / 0 / 0.00 %

102 DATA17 339025 / 3381 / 1.00 % 4912 / 0 / 0.00 %

103 DATA18 85941 / 1357 / 1.58 % 6318 / 0 / 0.00 %

104 DATA19 65898 / 1217 / 1.85 % 4224 / 0 / 0.00 %

105 DATA20 74123 / 1275 / 1.72 % 5714 / 0 / 0.00 %

106 DATA21 714412 / 15681 / 2.19 % 5923 / 0 / 0.00 %

107 DATA22 78895 / 1404 / 1.78 % 5637 / 0 / 0.00 %

108 DATA23 49106 / 1021 / 2.08 % 6728 / 0 / 0.00 %

109 DATA24 80526 / 1030 / 1.28 % 7124 / 0 / 0.00 %

110 DATA25 416603 / 2589 / 0.62 % 3623 / 0 / 0.00 %

111 DATA26 78093 / 1087 / 1.39 % 4922 / 0 / 0.00 %

112 DATA27 423110 / 11916 / 2.82 % 7521 / 0 / 0.00 %

113 DATA28 1261798 / 23844 / 1.89 % 5819 / 0 / 0.00 %

114 DATA29 97660 / 1183 / 1.21 % 4516 / 0 / 0.00 %

115 DATA30 62183 / 1333 / 2.14 % 5716 / 0 / 0.00 %

116 DATA31 74930 / 1189 / 1.59 % 3814 / 0 / 0.00 %

117 DATA32 137588 / 1756 / 1.28 % 2814 / 0 / 0.00 %

118 DATA33 421146 / 27101 / 6.44 % 7723 / 0 / 0.00 %

119 DATA34 65262 / 899 / 1.38 % 7723 / 0 / 0.00 %

120 DATA35 52449 / 761 / 1.45 % 9575 / 0 / 0.00 %

121 DATA36 52982 / 881 / 1.66 % 6425 / 0 / 0.00 %

122 DATA37 96596 / 1380 / 1.43 % 3915 / 0 / 0.00 %

123 DATA38 67893 / 1071 / 1.58 % 3419 / 0 / 0.00 %

124 DATA39 1433041 / 27690 / 1.93 % 3720 / 0 / 0.00 %

125 DATA40 100955 / 1453 / 1.44 % 5318 / 0 / 0.00 %

126 DATA41 352178 / 2321 / 0.66 % 7119 / 0 / 0.00 %

127 DATA42 76802 / 882 / 1.15 % 5028 / 0 / 0.00 %

128 DATA43 47429 / 8219 / 17.33 % 5625 / 0 / 0.00 %

129 DATA44 62154 / 951 / 1.53 % 7720 / 0 / 0.00 %

130 DATA45 76398 / 849 / 1.11 % 5429 / 0 / 0.00 %

131 DATA46 94363 / 2048 / 2.17 % 4820 / 0 / 0.00 %

132 DATA47 50856 / 1334 / 2.62 % 4813 / 0 / 0.00 %

133 DATA48 78895 / 1481 / 1.88 % 3027 / 0 / 0.00 %

134 TRANS1 1243826 / 1647 / 0.13 % 0 / 0 / 0.00 %

135 TRANS2 877845 / 51366 / 5.85 % 0 / 0 / 0.00 %

136 TRANS3 1188490 / 728 / 0.06 % 0 / 0 / 0.00 %

137 TRANS4 990013 / 84371 / 8.52 % 0 / 0 / 0.00 %

138 TRANS5 933725 / 2343 / 0.25 % 0 / 0 / 0.00 %

139 TRANS6 1221502 / 40227 / 3.29 % 0 / 0 / 0.00 %

140 TRANS7 897280 / 2063 / 0.23 % 0 / 0 / 0.00 %

141 TRANS8 1132537 / 8990 / 0.79 % 0 / 0 / 0.00 %

142 TAB9 983874 / 19662 / 2.00 % 0 / 0 / 0.00 %

143 TAB10 46706 / 471 / 1.01 % 0 / 0 / 0.00 %

144 TAB11 31946 / 356 / 1.11 % 0 / 0 / 0.00 %

145 TAB12 20488 / 44 / 0.21 % 0 / 0 / 0.00 %

146 TAB13 21314 / 73 / 0.34 % 0 / 0 / 0.00 %

147 TAB14 57646 / 1013 / 1.76 % 0 / 0 / 0.00 %

148 TAB15 20054 / 48 / 0.24 % 0 / 0 / 0.00 %

149 TAB16 30230 / 375 / 1.24 % 0 / 0 / 0.00 %

150 ROW17 155679 / 2771 / 1.78 % 0 / 0 / 0.00 %

151 ROW18 137365 / 2642 / 1.92 % 0 / 0 / 0.00 %

152 ROW19 162665 / 3108 / 1.91 % 0 / 0 / 0.00 %

153 ROW20 153850 / 2715 / 1.76 % 0 / 0 / 0.00 %

154 ROW21 150363 / 2708 / 1.80 % 0 / 0 / 0.00 %

155 ROW22 143018 / 2720 / 1.90 % 0 / 0 / 0.00 %

156 ROW23 138006 / 2448 / 1.77 % 0 / 0 / 0.00 %

157 ROW24 154265 / 2764 / 1.79 % 0 / 0 / 0.00 %

Total counter statistics:

=========================

total_disp_calls : 510484 total_commands : 130530

total_state_vwait : 0 total_state_vsuspend: 36690

total_state_vsleep : 17486

total_user_read : 988 total_user_write : 0

total_self_io : 1352 total_dev_io : 124933

total_reg_access : 22756709 begexcl_tas_coll. : 18

total_reg_collision : 280962 endexcl_tas_coll. : 6

total_reg_wait : 2798 total_self_susp_cnt : 16

total_symbol_resolution_locks: 1

-


Task U2U UKT COM

-


....

T97 0 2 178

....

Task T97

task type / state USER / Inactive

stack start - end @0x63dbf000 - @0x63e3f000

stack size 524288 (0x00080000)

guard area start - end @0x00000000 - @0x00000000

last / max dispatch stack pointer @0x63e3edcc / @0x63e14bcc

current / all command max stack usage 112436 / 112436

-> Do you know what SQL query was running?

I am not sure, yet. But I am trying to find out.

-> There are current database parameters settings:

... <see post above> ...

Yes, these are the current database settings.

-> Are you using joins in the SQL statements?

Yes, I am using JOINS.

-> Please see SAP Note No. 814704, there are some restrictions for the database parameter HASHED_RESULTSET.

Do I need a login for the SAP Service Marketplace to access the note or is there another way to read it ?

-> Are you using join select within clustered tables?

I am not 100% sure what you mean with "clustered tables".

-> Did you see that the system heap grow up during the application run? You could use the DB analyzer to check high memory consumption.

I have enabled the Database Analyzer and I will check the values ....

Bye

Claus

former_member229109
Active Contributor
0 Kudos

Hello Claus,

Thank you for additional information.

1)"Do I need a login for the SAP Service Marketplace to access the note or is there another way to read it ?"

-> Yes.

"Do you know what SQL query was running? - I am not sure, yet. But I am trying to find out."

-> Please post it, if you will find

2) Please see the SAP note Note 1040431 - FAQ: MaxDB BW Feature Pack

& http://maxdb.sap.com/doc/7_7/default.htm < Maxdb Library > -> Glossary -> Cluster

3) Was database crashed with core dump?

Regards, Natalia Khlopina

Answers (1)

Answers (1)

markus_doehr2
Active Contributor
0 Kudos

Please post a few lines more before the SIGSEGV... the actual error is not visible (just the consequence of it - the crash).

Markus