on 01-13-2009 6:47 PM
Hello,
My MaxDB-Server crashed two times in the last 5 days and I have no idea why. Can you help me to find the reason for the crashes ? My MaxDB 7.6.05 is running on a Linux server and I never had such problems before.
Here are some lines from the knldiag.err file:
First crash:
2009-01-09 15:02:05 0 ERR 11330 COREHAND ABORTING due to signal 11
2009-01-09 15:02:05 0 ERR 11599 BTRACE -
> Emergency Stack Back Trace <----
2009-01-09 15:02:05 0 ERR 11599 BTRACE -
> Register Dump <----
2009-01-09 15:02:05 0 ERR 11599 BTRACE -
2009-01-09 15:02:05 0 ERR 11599 BTRACE ds es 0x6409007b 0x0000007b
2009-01-09 15:02:05 0 ERR 11599 BTRACE fs gs 0xc0100000 0x00000033
2009-01-09 15:02:05 0 ERR 11599 BTRACE trap err 0x0000000e 0x00000014
2009-01-09 15:02:05 0 ERR 11599 BTRACE efl ss 0x00010216 0x0000007b
2009-01-09 15:02:05 0 ERR 11599 BTRACE edi esi 0xb7bbe3e0 0x50042938
2009-01-09 15:02:05 0 ERR 11599 BTRACE eax ebx 0x00000001
2009-01-09 15:02:05 0 ERR 11599 BTRACE ecx edx 0xb7bbe3e0
2009-01-09 15:02:05 0 ERR 11599 BTRACE esp uesp 0x6421defc 0x6421defc
2009-01-09 15:02:05 0 ERR 11599 BTRACE ebp eip 0x0121df84 0x00000000
2009-01-09 15:02:05 0 ERR 11599 BTRACE cs cr2 0x00000073 0x00000000
2009-01-09 15:02:05 0 ERR 11599 BTRACE -
2009-01-09 15:02:05 0 ERR 11599 BTRACE cw - sw - tag 0xffff037f 0xffff0020 0xffffffff
2009-01-09 15:02:05 0 ERR 11599 BTRACE ipoff - cssel 0xb7e1a284 0x077d0073
2009-01-09 15:02:05 0 ERR 11599 BTRACE dataoff-datasel 0x6421dd7c 0x0000007b
2009-01-09 15:02:05 0 ERR 11599 BTRACE f00 [0x3c00 0x5821 0xf70a 0x91c1 - 0x4008]
2009-01-09 15:02:05 0 ERR 11599 BTRACE f01 [0x3c00 0x5821 0xf70a 0x9201 - 0x4008]
2009-01-09 15:02:05 0 ERR 11599 BTRACE f02 [0x0000 0x0000 0x0000 0xb600 - 0x4006]
2009-01-09 15:02:05 0 ERR 11599 BTRACE f03 [0x435e 0x0d79 0x35e5 0xd794 - 0x3ff9]
2009-01-09 15:02:05 0 ERR 11599 BTRACE f04 [0x435e 0x0d79 0x35e5 0xd794 - 0x3ff9]
2009-01-09 15:02:05 0 ERR 11599 BTRACE f05 [0x0000 0x0000 0x0000 0x8000 - 0x3fff]
2009-01-09 15:02:05 0 ERR 11599 BTRACE f06 [0x0000 0x0000 0x0000 0xdcc0 - 0xc028]
2009-01-09 15:02:05 0 ERR 11599 BTRACE f07 [0x0000 0x5720 0x77d2 0xc691 - 0x401e]
2009-01-09 15:02:05 0 ERR 11599 BTRACE -
2009-01-09 15:02:05 0 ERR 11599 BTRACE -
> Module List <----
2009-01-09 15:02:05 0 ERR 11599 BTRACE |.text Start |.text End | Module File Name
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0x08048000 | 0x08e62000 | /opt/sdb/7603/pgm/kernel
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0x5aa91000 | 0x5acbc000 | /opt/sdb/7603/lib/liboms.so
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7267000 | 0xb726f000 | /lib/libnss_nis-2.6.1.so
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7271000 | 0xb7284000 | /lib/libnsl-2.6.1.so
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7288000 | 0xb728e000 | /lib/libnss_compat-2.6.1.so
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7b93000 | 0xb7b9b000 | /lib/libnss_files-2.6.1.so
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7ce2000 | 0xb7e0f000 | /lib/libc-2.6.1.so
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7e0f000 | 0xb7e10000 | /lib/libc-2.6.1.so
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7e16000 | 0xb7e20000 | /lib/libgcc_s.so.1
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7e22000 | 0xb7e45000 | /lib/libm-2.6.1.so
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7e47000 | 0xb7eff000 | /usr/lib/libstdc++.so.5.0.7
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7f09000 | 0xb7f10000 | /lib/librt-2.6.1.so
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7f12000 | 0xb7f14000 | /lib/libdl-2.6.1.so
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7f16000 | 0xb7f29000 | /lib/libpthread-2.6.1.so
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xb7f39000 | 0xb7f53000 | /lib/ld-2.6.1.so
2009-01-09 15:02:05 0 ERR 11599 BTRACE | 0xffffe000 | 0xfffff000 | [vdso]
2009-01-09 15:02:05 0 ERR 11599 BTRACE
2009-01-09 15:02:05 0 ERR 11599 BTRACE -
> Symbolic Stack Back Trace <----
2009-01-09 15:02:05 0 ERR 11599 BTRACE -
> End of Stack Back Trace <----
2009-01-09 15:02:05 0 ERR 11330 COREHAND dump of siginfo content:
2009-01-09 15:02:05 0 ERR 11330 COREHAND signal 11 (SIGSEGV)
2009-01-09 15:02:05 0 ERR 11330 COREHAND code 1 (ILL_ILLOPC:illegal opcode)
2009-01-09 15:02:05 0 ERR 11330 COREHAND errno 0
2009-01-09 15:02:05 0 ERR 11330 COREHAND value(int) 4640
2009-01-09 15:02:05 0 ERR 11330 COREHAND value(ptr) @1220
2009-01-09 15:02:05 0 ERR 11330 COREHAND pid 0
2009-01-09 15:02:05 0 ERR 11330 COREHAND addr @0
2009-01-09 15:02:05 0 ERR 11599 BTRACE analysing LVCMem_Allocator_001
2009-01-09 15:02:05 0 ERR 11599 BTRACE
2009-01-09 15:02:05 0 ERR 11599 BTRACE no problems detected in LVCMem_Allocator_001
2009-01-09 15:02:05 0 ERR 11599 BTRACE analysing LVCMem_Allocator_002
2009-01-09 15:02:05 0 ERR 11599 BTRACE
2009-01-09 15:02:05 0 ERR 11599 BTRACE no problems detected in LVCMem_Allocator_002
2009-01-09 15:02:06 0 ERR 12006 DBCRASH Kernel exited without core and exit status 0x2f00
2009-01-09 15:02:06 0 ERR 12008 DBCRASH Kernel exited due to reentered signal handler
2009-01-09 15:02:06 ___ Stopping GMT 2009-01-09 14:02:06 7.6.05 Build 009-121-191-997
Second crash:
2009-01-13 11:03:22 0 ERR 11330 COREHAND ABORTING due to signal 11
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> Emergency Stack Back Trace <----
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> Register Dump <----
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
2009-01-13 11:03:22 0 ERR 11599 BTRACE ds es 0x6413007b 0x0000007b
2009-01-13 11:03:22 0 ERR 11599 BTRACE fs gs 0xc0100000 0x00000033
2009-01-13 11:03:22 0 ERR 11599 BTRACE trap err 0x0000000e 0x00000014
2009-01-13 11:03:22 0 ERR 11599 BTRACE efl ss 0x00010216 0x0000007b
2009-01-13 11:03:22 0 ERR 11599 BTRACE edi esi 0xb7c61400 0x5003fad0
2009-01-13 11:03:22 0 ERR 11599 BTRACE eax ebx 0x00000001
2009-01-13 11:03:22 0 ERR 11599 BTRACE ecx edx 0xb7c61400
2009-01-13 11:03:22 0 ERR 11599 BTRACE esp uesp 0x63e3eefc 0x63e3eefc
2009-01-13 11:03:22 0 ERR 11599 BTRACE ebp eip 0x01e3ef84 0x00000000
2009-01-13 11:03:22 0 ERR 11599 BTRACE cs cr2 0x00000073 0x00000000
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
2009-01-13 11:03:22 0 ERR 11599 BTRACE cw - sw - tag 0xffff037f 0xffff0020 0xffffffff
2009-01-13 11:03:22 0 ERR 11599 BTRACE ipoff - cssel 0xb7ebb284 0x077d0073
2009-01-13 11:03:22 0 ERR 11599 BTRACE dataoff-datasel 0x63e3ed7c 0x0000007b
2009-01-13 11:03:22 0 ERR 11599 BTRACE f00 [0x8800 0xc349 0x8885 0x91ff - 0x4008]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f01 [0x8800 0xc349 0x8885 0x923f - 0x4008]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f02 [0x0000 0x0000 0x0000 0xf300 - 0x4007]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f03 [0xb7b6 0xdb6d 0x6db6 0xf25b - 0x4007]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f04 [0x0000 0x0000 0x0000 0x9800 - 0x4002]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f05 [0x0000 0x0000 0x0000 0xfbd3 - 0x400e]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f06 [0x0000 0x0000 0x0000 0xa000 - 0xc023]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f07 [0x0000 0x10ec 0x76ec 0xc1c0 - 0x401d]
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> Module List <----
2009-01-13 11:03:22 0 ERR 11599 BTRACE |.text Start |.text End | Module File Name
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0x08048000 | 0x08e62000 | /opt/sdb/7603/pgm/kernel
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0x5a756000 | 0x5a981000 | /opt/sdb/7603/lib/liboms.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7308000 | 0xb7310000 | /lib/libnss_nis-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7312000 | 0xb7325000 | /lib/libnsl-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7329000 | 0xb732f000 | /lib/libnss_compat-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7c34000 | 0xb7c3c000 | /lib/libnss_files-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7d83000 | 0xb7eb0000 | /lib/libc-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7eb0000 | 0xb7eb1000 | /lib/libc-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7eb7000 | 0xb7ec1000 | /lib/libgcc_s.so.1
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7ec3000 | 0xb7ee6000 | /lib/libm-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7ee8000 | 0xb7fa0000 | /usr/lib/libstdc++.so.5.0.7
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7faa000 | 0xb7fb1000 | /lib/librt-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7fb3000 | 0xb7fb5000 | /lib/libdl-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7fb7000 | 0xb7fca000 | /lib/libpthread-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7fda000 | 0xb7ff4000 | /lib/ld-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xffffe000 | 0xfffff000 | [vdso]
2009-01-13 11:03:22 0 ERR 11599 BTRACE
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> Symbolic Stack Back Trace <----
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> End of Stack Back Trace <----
2009-01-13 11:03:22 0 ERR 11330 COREHAND dump of siginfo content:
2009-01-13 11:03:22 0 ERR 11330 COREHAND signal 11 (SIGSEGV)
2009-01-13 11:03:22 0 ERR 11330 COREHAND code 1 (ILL_ILLOPC:illegal opcode)
2009-01-13 11:03:22 0 ERR 11330 COREHAND errno 0
2009-01-13 11:03:22 0 ERR 11330 COREHAND value(int) 4640
2009-01-13 11:03:22 0 ERR 11330 COREHAND value(ptr) @1220
2009-01-13 11:03:22 0 ERR 11330 COREHAND pid 0
2009-01-13 11:03:22 0 ERR 11330 COREHAND addr @0
2009-01-13 11:03:22 0 ERR 11599 BTRACE analysing LVCMem_Allocator_001
2009-01-13 11:03:22 0 ERR 11599 BTRACE
2009-01-13 11:03:22 0 ERR 11599 BTRACE no problems detected in LVCMem_Allocator_001
2009-01-13 11:03:22 0 ERR 11599 BTRACE analysing LVCMem_Allocator_002
2009-01-13 11:03:22 0 ERR 11599 BTRACE
2009-01-13 11:03:22 0 ERR 11599 BTRACE no problems detected in LVCMem_Allocator_002
2009-01-13 11:03:23 0 ERR 12006 DBCRASH Kernel exited without core and exit status 0x2f00
2009-01-13 11:03:23 0 ERR 12008 DBCRASH Kernel exited due to reentered signal handler
2009-01-13 11:03:23 ___ Stopping GMT 2009-01-13 10:03:23 7.6.05 Build 009-121-191-997
How can I find the reason for the crash and prevent them in the future ? Or can you explain to me where the problem is ?
Bye
Claus
Hello Claus,
Please also let us know, if "Symbolic Stack Back Trace" was written in
knldiag or knldiag.err files. If it was written, please post it.
Do you have lines in knldiag.err beetween
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> Symbolic Stack Back Trace <----
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> End of Stack Back Trace <----
?
Thank you and best regards, Natalia Khlopina
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hello,
I have posted all lines from the file knldiag.err. There are no lines between
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> Symbolic Stack Back Trace <----
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> End of Stack Back Trace <----
and there are no lines before the posted ones.
I have found the following lines in the file knldiag:
2009-01-13 11:02:50 3191 11561 COMMUNIC Connecting T100 localhost 4761
2009-01-13 11:02:50 3208 12929 TASKING Task T100 started
2009-01-13 11:02:50 3208 11007 COMMUNIC wait for connection T100
2009-01-13 11:02:50 3208 11561 COMMUNIC Connected T100 localhost 4761
2009-01-13 11:02:50 3208 11560 COMMUNIC Releasing T100
2009-01-13 11:02:50 3208 12827 COMMUNIC wait for connection T100
2009-01-13 11:02:50 3208 12929 TASKING Task T127 started
2009-01-13 11:02:50 3191 11561 COMMUNIC Connecting T127 localhost 4669
2009-01-13 11:02:50 3208 11007 COMMUNIC wait for connection T127
2009-01-13 11:02:50 3208 11561 COMMUNIC Connected T127 localhost 4669
2009-01-13 11:02:50 3208 11560 COMMUNIC Releasing T127
2009-01-13 11:02:50 3208 12827 COMMUNIC wait for connection T127
2009-01-13 11:02:50 3191 11561 COMMUNIC Connecting T101 localhost 4761
2009-01-13 11:02:50 3208 12929 TASKING Task T101 started
2009-01-13 11:02:50 3208 11007 COMMUNIC wait for connection T101
2009-01-13 11:02:50 3208 11561 COMMUNIC Connected T101 localhost 4761
2009-01-13 11:02:50 3208 11560 COMMUNIC Releasing T101
2009-01-13 11:02:50 3208 12827 COMMUNIC wait for connection T101
2009-01-13 11:02:52 3191 11561 COMMUNIC Connecting T98 localhost 4669
2009-01-13 11:02:52 3208 12929 TASKING Task T98 started
2009-01-13 11:02:52 3208 11007 COMMUNIC wait for connection T98
2009-01-13 11:02:52 3208 11561 COMMUNIC Connected T98 localhost 4669
2009-01-13 11:02:54 3208 11560 COMMUNIC Releasing T98
2009-01-13 11:02:54 3208 12827 COMMUNIC wait for connection T98
2009-01-13 11:03:18 3208 12929 TASKING Task T102 started
2009-01-13 11:03:18 3208 11007 COMMUNIC wait for connection T102
2009-01-13 11:03:18 3191 11561 COMMUNIC Connecting T102 localhost 2460
2009-01-13 11:03:18 3208 11561 COMMUNIC Connected T102 localhost 2460
2009-01-13 11:03:18 3208 11560 COMMUNIC Releasing T102
2009-01-13 11:03:18 3208 12827 COMMUNIC wait for connection T102
2009-01-13 11:03:22 3191 11561 COMMUNIC Connecting T97 localhost 2460
2009-01-13 11:03:22 0 12853 DBSTATE Caught signal 11(SIGSEGV)
2009-01-13 11:03:22 0 ERR 11330 COREHAND ABORTING due to signal 11
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> Emergency Stack Back Trace <----
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> Register Dump <----
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
2009-01-13 11:03:22 0 ERR 11599 BTRACE ds es 0x6413007b 0x0000007b
2009-01-13 11:03:22 0 ERR 11599 BTRACE fs gs 0xc0100000 0x00000033
2009-01-13 11:03:22 0 ERR 11599 BTRACE trap err 0x0000000e 0x00000014
2009-01-13 11:03:22 0 ERR 11599 BTRACE efl ss 0x00010216 0x0000007b
2009-01-13 11:03:22 0 ERR 11599 BTRACE edi esi 0xb7c61400 0x5003fad0
2009-01-13 11:03:22 0 ERR 11599 BTRACE eax ebx 0x00000001
2009-01-13 11:03:22 0 ERR 11599 BTRACE ecx edx 0xb7c61400
2009-01-13 11:03:22 0 ERR 11599 BTRACE esp uesp 0x63e3eefc 0x63e3eefc
2009-01-13 11:03:22 0 ERR 11599 BTRACE ebp eip 0x01e3ef84 0x00000000
2009-01-13 11:03:22 0 ERR 11599 BTRACE cs cr2 0x00000073 0x00000000
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
2009-01-13 11:03:22 0 ERR 11599 BTRACE cw - sw - tag 0xffff037f 0xffff0020 0xffffffff
2009-01-13 11:03:22 0 ERR 11599 BTRACE ipoff - cssel 0xb7ebb284 0x077d0073
2009-01-13 11:03:22 0 ERR 11599 BTRACE dataoff-datasel 0x63e3ed7c 0x0000007b
2009-01-13 11:03:22 0 ERR 11599 BTRACE f00 [0x8800 0xc349 0x8885 0x91ff - 0x4008]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f01 [0x8800 0xc349 0x8885 0x923f - 0x4008]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f02 [0x0000 0x0000 0x0000 0xf300 - 0x4007]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f03 [0xb7b6 0xdb6d 0x6db6 0xf25b - 0x4007]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f04 [0x0000 0x0000 0x0000 0x9800 - 0x4002]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f05 [0x0000 0x0000 0x0000 0xfbd3 - 0x400e]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f06 [0x0000 0x0000 0x0000 0xa000 - 0xc023]
2009-01-13 11:03:22 0 ERR 11599 BTRACE f07 [0x0000 0x10ec 0x76ec 0xc1c0 - 0x401d]
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> Module List <----
2009-01-13 11:03:22 0 ERR 11599 BTRACE |.text Start |.text End | Module File Name
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0x08048000 | 0x08e62000 | /opt/sdb/7603/pgm/kernel
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0x5a756000 | 0x5a981000 | /opt/sdb/7603/lib/liboms.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7308000 | 0xb7310000 | /lib/libnss_nis-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7312000 | 0xb7325000 | /lib/libnsl-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7329000 | 0xb732f000 | /lib/libnss_compat-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7c34000 | 0xb7c3c000 | /lib/libnss_files-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7d83000 | 0xb7eb0000 | /lib/libc-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7eb0000 | 0xb7eb1000 | /lib/libc-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7eb7000 | 0xb7ec1000 | /lib/libgcc_s.so.1
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7ec3000 | 0xb7ee6000 | /lib/libm-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7ee8000 | 0xb7fa0000 | /usr/lib/libstdc++.so.5.0.7
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7faa000 | 0xb7fb1000 | /lib/librt-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7fb3000 | 0xb7fb5000 | /lib/libdl-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7fb7000 | 0xb7fca000 | /lib/libpthread-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xb7fda000 | 0xb7ff4000 | /lib/ld-2.6.1.so
2009-01-13 11:03:22 0 ERR 11599 BTRACE | 0xffffe000 | 0xfffff000 | [vdso]
2009-01-13 11:03:22 0 ERR 11599 BTRACE
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> Symbolic Stack Back Trace <----
2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> End of Stack Back Trace <----
2009-01-13 11:03:22 0 ERR 11330 COREHAND dump of siginfo content:
2009-01-13 11:03:22 0 ERR 11330 COREHAND signal 11 (SIGSEGV)
2009-01-13 11:03:22 0 ERR 11330 COREHAND code 1 (ILL_ILLOPC:illegal opcode)
2009-01-13 11:03:22 0 ERR 11330 COREHAND errno 0
2009-01-13 11:03:22 0 ERR 11330 COREHAND value(int) 4640
2009-01-13 11:03:22 0 ERR 11330 COREHAND value(ptr) @1220
2009-01-13 11:03:22 0 ERR 11330 COREHAND pid 0
2009-01-13 11:03:22 0 ERR 11330 COREHAND addr @0
2009-01-13 11:03:22 0 ERR 11599 BTRACE analysing LVCMem_Allocator_001
2009-01-13 11:03:22 0 ERR 11599 BTRACE
2009-01-13 11:03:22 0 ERR 11599 BTRACE no problems detected in LVCMem_Allocator_001
2009-01-13 11:03:22 0 ERR 11599 BTRACE analysing LVCMem_Allocator_002
2009-01-13 11:03:22 0 ERR 11599 BTRACE
2009-01-13 11:03:22 0 ERR 11599 BTRACE no problems detected in LVCMem_Allocator_002
+++++++++++++++++++++++++++++++++++++++ Kernel Exit ++++++++++++++++++++++++++++
2009-01-13 11:03:23 0 11987 dump_rte rtedump written to file 'rtedump'
2009-01-13 11:03:23 0 ERR 12006 DBCRASH Kernel exited without core and exit status 0x2f00
2009-01-13 11:03:23 0 ERR 12008 DBCRASH Kernel exited due to reentered signal handler
2009-01-13 11:03:23 0 12890 DIAGHIST Backup of diagnostic files will be forced at next restart
2009-01-13 11:03:23 0 12808 DBSTATE Flushing knltrace pages
2009-01-13 11:03:23 0 WNG 11824 COMMUNIC Releasing T97 kernel abort
2009-01-13 11:03:23 0 12696 DBSTATE Change DbState to 'OFFLINE '(29)
I have a file called "knltrace", but it doesn't seems to be a normal text file and it is 8 MB large.
I also have a file called "rtedump". It is 1 MB large and here are the first and last lines from it
ERR 11105 CONSOLE WARNING: kernel not running '<dbname>'
ERR 11105 CONSOLE WARNING: examining OLD DATA
SERVERDB: <dbname>
ERR 11105 CONSOLE WARNING: kernel not running '<dbname>'
ERR 11105 CONSOLE WARNING: examining OLD DATA
The database state is OFFLINE
Kernel Version 'Kernel 7.6.05 Build 009-121-191-997'
RTE Version 'X32/LINUX 7.6.05 Build 009-121-191-997'
ID UKT UNIX TASK APPL Current Timeout Region Wait
tid type pid state priority cnt try item
T1 6 -1 Timer -1 Vsleep 0 0 33845(s)
T2 2 -1 Logwr -1 No-Work (255) 0 0 338(s)
T3 1 -1 Tracewr -1 No-Work (255) 0 0 1(s)
T4 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T5 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
..... more lines ....
List of suspend-reasons:
========================
Total Suspends: 118491
IOWait(R)(041) : 106779 ( 90.12% ) b13get_node: await read
PagerWaitWritr : 7 ( 0.01% ) Pager_Controller::WaitForPagerWritReply
JobWait Redo : 2 ( 0.00% ) Rst_RedoManager::RedoLog
Vsuspend (227) : 878 ( 0.74% ) RedoReader waits for finished jobs
Vsuspend (228) : 1 ( 0.00% ) RedoReader waits for end of all RedoTask
NoRedoJob(231) : 1184 ( 1.00% ) Rst_RedoTrafficControl::ExecuteJobs()
SyncRedo (232) : 1358 ( 1.15% ) Rst_RedoTrafficControl::WaitForIoSeq()
LogIOwait(234) : 312 ( 0.26% ) Log_Queue::UserTaskEOTReady
SVP-wait (243) : 2 ( 0.00% ) Log_Savepoint::StartSavepointAndWait
No-Work (255) : 7968 ( 6.72% ) Task is waiting for work
Index Region Get-Cnt avg_time tot_time
Index Region Owner Get-Cnt Tas-Cnt Coll. Waits Excl Coll %
1 PAGER 450 0 4501 45 0 1000.22 %
2 CONFIG 0 0 0 0 0 0.00 %
3 CONV1 1780 0 0 0 0 0.00 %
4 CONV2 1623 0 0 0 0 0.00 %
5 CONV3 1765 0 0 0 0 0.00 %
6 CONV4 1720 0 0 0 0 0.00 %
7 CONV5 1869 0 0 0 0 0.00 %
8 CONV6 2002 0 0 0 0 0.00 %
9 CONV7 2289 0 0 0 0 0.00 %
10 CONV8 2125 0 0 0 0 0.00 %
11 CONV9 1427 0 0 0 0 0.00 %
12 CONV10 1461 0 0 0 0 0.00 %
13 CONV11 1748 0 0 0 0 0.00 %
14 CONV12 1610 0 0 0 0 0.00 %
15 CONV13 2132 0 0 0 0 0.00 %
16 CONV14 1578 0 0 0 0 0.00 %
17 CONV15 1946 0 0 0 0 0.00 %
18 CONV16 1746 0 0 0 0 0.00 %
19 CONV17 5523 0 0 0 0 0.00 %
20 CONV18 5464 0 0 0 0 0.00 %
21 CONV19 4992 0 0 0 0 0.00 %
22 CONV20 4720 0 0 0 0 0.00 %
23 CONV21 4727 0 0 0 0 0.00 %
24 CONV22 4832 0 0 0 0 0.00 %
25 CONV23 4656 0 0 0 0 0.00 %
26 CONV24 4732 0 0 0 0 0.00 %
27 CONV25 2137 0 0 0 0 0.00 %
28 CONV26 1888 0 0 0 0 0.00 %
29 CONV27 2080 0 0 0 0 0.00 %
30 CONV28 2722 0 0 0 0 0.00 %
31 CONV29 2225 0 0 0 0 0.00 %
32 CONV30 2316 0 0 0 0 0.00 %
33 CONV31 2086 0 0 0 0 0.00 %
34 CONV32 2221 0 0 0 0 0.00 %
35 CONV33 6434 0 0 0 0 0.00 %
36 CONV34 6257 0 0 0 0 0.00 %
37 CONV35 5866 0 0 0 0 0.00 %
38 CONV36 5797 0 0 0 0 0.00 %
39 CONV37 5652 0 0 0 0 0.00 %
40 CONV38 5684 0 0 0 0 0.00 %
41 CONV39 6112 0 0 0 0 0.00 %
42 CONV40 5201 0 0 0 0 0.00 %
43 CONV41 3079 0 0 0 0 0.00 %
44 CONV42 3672 0 0 0 0 0.00 %
45 CONV43 3880 0 0 0 0 0.00 %
46 CONV44 3783 0 0 0 0 0.00 %
47 CONV45 3780 0 0 0 0 0.00 %
48 CONV46 3928 0 0 0 0 0.00 %
49 CONV47 3325 0 0 0 0 0.00 %
50 CONV48 4359 0 0 0 0 0.00 %
51 DATACACH 0 0 0 0 0 0.00 %
52 DCOM 0 0 0 0 0 0.00 %
53 DIAGCACH 8150 0 0 0 0 0.00 %
54 FBM 32377 0 0 0 0 0.00 %
55 GARBAGE 76 0 0 0 0 0.00 %
56 LOCKINIT 2092506 0 0 0 0 0.00 %
57 LOCKPOOL 22509 0 0 0 0 0.00 %
58 LOCKREQ 0 0 0 0 0 0.00 %
59 LOCKWAIT 0 0 0 0 0 0.00 %
60 SAVEPOIN 11 0 0 0 0 0.00 %
61 LOGQUE1 2366 0 1213 12 0 51.27 %
62 LOGQUE2 4 0 0 0 0 0.00 %
63 LOGINFO 6 0 0 0 0 0.00 %
64 LVC_EMCY 0 0 0 0 0 0.00 %
65 MONITOR 0 0 0 0 0 0.00 %
66 SERVER 47905 0 1 0 0 0.00 %
67 SRVTASK 28852 0 8045 80 0 27.88 %
68 SURROGAT 23599 0 0 0 0 0.00 %
69 CONVINDX 194 0 0 0 0 0.00 %
70 KNLWAIT 3 0 0 0 0 0.00 %
71 TRACE 0 0 0 0 0 0.00 %
72 COMP_END 0 0 0 0 0 0.00 %
73 LOCKPAR 0 0 0 0 0 0.00 %
74 CLSTERIO 196 0 0 0 0 0.00 %
75 RANDMGEN 3886 0 0 0 0 0.00 %
76 REDOCTRL 18215 0 0 0 0 0.00 %
77 OMSMON 0 0 0 0 0 0.00 %
78 OMSUNLDV 0 0 0 0 0 0.00 %
79 OMSCDIR 0 0 0 0 0 0.00 %
80 OMSVDIR 0 0 0 0 0 0.00 %
81 OMSSHHP 0 0 0 0 0 0.00 %
82 OMSSTHP 0 0 0 0 0 0.00 %
83 OMSEMHP 0 0 0 0 0 0.00 %
84 SAVE1 2 0 0 0 0 0.00 %
85 SAVE2 2 0 0 0 0 0.00 %
86 DATA1 272327 0 5027 50 0 1.85 %
87 DATA2 62608 1 3616 36 0 5.78 %
88 DATA3 143046 0 7625 76 0 5.33 %
89 DATA4 81378 0 7629 76 0 9.37 %
90 DATA5 155192 0 5427 54 0 3.50 %
91 DATA6 116221 0 4825 48 0 4.15 %
92 DATA7 99933 0 5423 54 0 5.43 %
93 DATA8 68148 2 5422 54 0 7.96 %
94 DATA9 662958 1 7716 77 0 1.16 %
95 DATA10 61956 0 4519 45 0 7.29 %
96 DATA11 44018 2 4830 48 0 10.97 %
97 DATA12 184427 2 6020 60 0 3.26 %
98 DATA13 55285 1 6426 64 0 11.62 %
99 DATA14 67000 0 5122 51 0 7.64 %
100 DATA15 99934 0 6628 66 0 6.63 %
101 DATA16 76041 1 4223 42 0 5.55 %
102 DATA17 339025 0 4912 49 0 1.45 %
103 DATA18 85941 1 6318 63 0 7.35 %
104 DATA19 65898 3 4224 42 0 6.41 %
105 DATA20 74123 0 5714 57 0 7.71 %
106 DATA21 714412 0 5923 59 0 0.83 %
107 DATA22 78895 0 5637 56 0 7.14 %
108 DATA23 49106 0 6728 67 0 13.70 %
109 DATA24 80526 2 7124 71 0 8.85 %
110 DATA25 416603 0 3623 36 0 0.87 %
111 DATA26 78093 1 4922 49 0 6.30 %
112 DATA27 423110 0 7521 75 0 1.78 %
113 DATA28 1261798 0 5819 58 0 0.46 %
114 DATA29 97660 1 4516 45 0 4.62 %
115 DATA30 62183 0 5716 57 0 9.19 %
116 DATA31 74930 0 3814 38 0 5.09 %
117 DATA32 137588 0 2814 28 0 2.05 %
118 DATA33 421146 1 7723 77 0 1.83 %
119 DATA34 65262 0 7723 77 0 11.83 %
120 DATA35 52449 1 9575 95 0 18.26 %
121 DATA36 52982 0 6425 64 0 12.13 %
122 DATA37 96596 0 3915 39 0 4.05 %
123 DATA38 67893 0 3419 34 0 5.04 %
124 DATA39 1433041 0 3720 37 0 0.26 %
125 DATA40 100955 1 5318 53 0 5.27 %
126 DATA41 352178 0 7119 71 0 2.02 %
127 DATA42 76802 0 5028 50 0 6.55 %
128 DATA43 47429 0 5625 56 0 11.86 %
129 DATA44 62154 1 7720 77 0 12.42 %
130 DATA45 76398 1 5429 54 0 7.11 %
131 DATA46 94363 0 4820 48 0 5.11 %
132 DATA47 50856 0 4813 48 0 9.46 %
133 DATA48 78895 1 3027 30 0 3.84 %
134 TRANS1 1243826 0 0 0 0 0.00 %
135 TRANS2 877845 0 0 0 0 0.00 %
136 TRANS3 1188490 0 0 0 0 0.00 %
137 TRANS4 990013 0 0 0 0 0.00 %
138 TRANS5 933725 0 0 0 0 0.00 %
139 TRANS6 1221502 0 0 0 0 0.00 %
140 TRANS7 897280 0 0 0 0 0.00 %
141 TRANS8 1132537 0 0 0 0 0.00 %
142 TAB9 983874 0 0 0 0 0.00 %
143 TAB10 46706 0 0 0 0 0.00 %
144 TAB11 31946 0 0 0 0 0.00 %
145 TAB12 20488 0 0 0 0 0.00 %
146 TAB13 21314 0 0 0 0 0.00 %
147 TAB14 57646 0 0 0 0 0.00 %
148 TAB15 20054 0 0 0 0 0.00 %
149 TAB16 30230 0 0 0 0 0.00 %
150 ROW17 155679 0 0 0 0 0.00 %
151 ROW18 137365 0 0 0 0 0.00 %
152 ROW19 162665 0 0 0 0 0.00 %
153 ROW20 153850 0 0 0 0 0.00 %
154 ROW21 150363 0 0 0 0 0.00 %
155 ROW22 143018 0 0 0 0 0.00 %
156 ROW23 138006 0 0 0 0 0.00 %
157 ROW24 154265 0 0 0 0 0.00 %
Alone :
Count : 0 Collisions : 0
Size of code 145121 KB
Size of task stacks 87632 KB
Size of shared data 1356 KB
Used shared dyn pool 0 KB
Unused shared dyn pool 0 KB
Used shared dyn data 0 Pages
Unused shared dyn data 0 Pages
Number of existing tasks 168
no Task connected
SERVERDB: <dbname>
The SERVERDB state is OFFLINE
Console command finished (2009-01-13 11:03:23).
Please tell me if you need other lines from this file.
Where can I find the requested trace infos ?
Bye
Claus
> I have posted all lines from the file knldiag.err. There are no lines between
>
> 2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> Symbolic Stack Back Trace <----
> 2009-01-13 11:03:22 0 ERR 11599 BTRACE -
> End of Stack Back Trace <----
>
> and there are no lines before the posted ones.
That's very unfortunate, since now we don't know what function caused the segmentation violation.
Please do check the operating system error log as well - are there any entries for this incident?
> 2009-01-13 11:03:22 0 ERR 11330 COREHAND dump of siginfo content:
> 2009-01-13 11:03:22 0 ERR 11330 COREHAND signal 11 (SIGSEGV)
> 2009-01-13 11:03:22 0 ERR 11330 COREHAND code 1 (ILL_ILLOPC:illegal opcode)
> 2009-01-13 11:03:22 0 ERR 11330 COREHAND errno 0
> 2009-01-13 11:03:22 0 ERR 11330 COREHAND value(int) 4640
> 2009-01-13 11:03:22 0 ERR 11330 COREHAND value(ptr) @1220
> 2009-01-13 11:03:22 0 ERR 11330 COREHAND pid 0
> 2009-01-13 11:03:22 0 ERR 11330 COREHAND addr @0
"Illegal opcode" errors can be caused by stack overwrites - what are the *_STACK-sizes for this instance (look for parameters that are named like "stack...")
> I have a file called "knltrace", but it doesn't seems to be a normal text file and it is 8 MB large.
That's the kernel trace file. It's a trace written in binary format.
You may be able to convert it to a readable format as described in the SDN MaxDB Wiki [MaxDB database trace|https://wiki.sdn.sap.com/wiki/x/2yg]
> I also have a file called "rtedump". It is 1 MB large and here are the first and last lines from it
This file contains a snapshot of the task states when the database crashed.
The content is similar to what you would get, when you run x_cons <DBSID> show all
>
> ID UKT UNIX TASK APPL Current Timeout Region Wait
> tid type pid state priority cnt try item
> T1 6 -1 Timer -1 Vsleep 0 0 33845(s)
> T2 2 -1 Logwr -1 No-Work (255) 0 0 338(s)
> T3 1 -1 Tracewr -1 No-Work (255) 0 0 1(s)
> T4 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
> T5 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
>
> ..... more lines ....
These "more lines" would have been interesting as they show the tasks that had been active when the error occured.
Once we know the user task(s) that were running, when the error occured, we may have a chance to check the application side logfiles to figure out, what command the user task(s) were processing.
> Please tell me if you need other lines from this file.
See above.
regards,
Lars
I have checked several system logfiles, but there are no errors/warnings/notices for the time the maxdb crashes occured.
Here are the values for all STACK parameters from my database:
MBLOCKSTACK_SIZE: 32768
DYNTASK_STACK: NO
MAXTASKSTACK: 512
MAX_SERVERTASK_STACK: 500
MAX_SPECIALTASK_STACK:500
SHOW_MAX_STACK_USE: NO
SHOW_MAX_KB_STACK_USE: NO
CALLSTACKLEVEL: 0
Here are more lines from the file "rtedump"
Kernel Version 'Kernel 7.6.05 Build 009-121-191-997'
RTE Version 'X32/LINUX 7.6.05 Build 009-121-191-997'
ID UKT UNIX TASK APPL Current Timeout Region Wait
tid type pid state priority cnt try item
T1 6 -1 Timer -1 Vsleep 0 0 33845(s)
T2 2 -1 Logwr -1 No-Work (255) 0 0 338(s)
T3 1 -1 Tracewr -1 No-Work (255) 0 0 1(s)
T4 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T5 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T6 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T7 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T8 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T9 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T10 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T11 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T12 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T13 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T14 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T15 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T16 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T17 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T18 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T19 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T20 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T21 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T22 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T23 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T24 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T25 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T26 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T27 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T28 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T29 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T30 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T31 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T32 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T33 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T34 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T35 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T36 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T37 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T38 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T39 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T40 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T41 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T42 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T43 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T44 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T45 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T46 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T47 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T48 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T49 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T50 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T51 6 -1 Pager -1 No-Work (255) 0 0 33845(s)
T54 5 -1 GarbCol -1 No-Work (255) 0 0 1(s)
T55 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T56 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T57 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T58 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T59 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T60 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T61 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T62 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T63 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T64 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T65 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T66 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T67 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T68 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T69 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T70 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T71 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T72 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T73 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T74 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T75 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T76 4 -1 Savepnt -1 No-Work (255) 0 0 118886(s)
T77 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T78 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T79 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T80 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T81 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T82 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T83 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T84 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T85 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T86 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T87 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T88 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T89 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T90 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T91 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T92 4 -1 Server -1 No-Work (255) 0 0 118886(s)
T93 3 -1 Utility 0 Inactive 0 0 1(s)
75 Tasks are in State 'Connect wait'
Special Threads:
UNIX Threads
tid name
3164 COORDINATOR
3181 CLOCK Now 1231841002 = Tue Jan 13 11:03:22 2009
3184 CONSOLE
3190 TIMER did 17631 sleeps. Now sleeping until 1231841004 for 5 s
3191 REQUESTOR
3192 DEV0
User Kernel Threads:
UNIX Thread Dispatch TaskSwitch Command Active Total Task
tid name counter counter counter Tasks Tasks cluster
3201 UKT1 2 0 0 1 1 TW
3202 UKT2 338 0 0 1 1 AL
3204 UKT3 1 0 0 0 1 UT
3205 UKT4 311007 22836 0 38 38 38*SV
3206 UKT5 4 2 0 1 3 1*GC,2*EV
3207 UKT6 38942 3373 0 49 49 TI,48*DW
3208 UKT7 2081521 5482 1913727 0 38 38*US
3209 UKT8 196767 54 165836 0 37 37*US
I/O via UKT and Device Processes:
UNIX Thread Devspace Dev Read Write Queue
tid name name index count count len max
3202 UKT2 LOG_001 4 0 364 -- (--)
3208 UKT7 DAT_0001 1 2469 0 -- (--)
3208 UKT7 DAT_0002 2 2433 0 -- (--)
3208 UKT7 DAT_0003 3 2578 0 -- (--)
3208 UKT7 LOG_001 4 8 2 -- (--)
3209 UKT8 DAT_0001 1 334 0 -- (--)
3209 UKT8 DAT_0002 2 308 0 -- (--)
3209 UKT8 DAT_0003 3 331 0 -- (--)
3210 DEV knltrace 0 0 1 0 (1)
3213 DEV DAT_0001 1 40200 465 0 (14)
3212 DEV DAT_0001 1 0 146 0 (13)
3215 DEV DAT_0002 2 41775 412 0 (20)
3214 DEV DAT_0002 2 0 195 0 (19)
3217 DEV DAT_0003 3 41131 402 0 (22)
3216 DEV DAT_0003 3 0 207 0 (22)
3219 DEV LOG_001 4 173 2 0 (1)
3218 DEV LOG_001 4 0 0 0 (0)
I/O via Device Processes:
UNIX Devspace Read avg_read Write avg_write
tid name count time count time
3210 knltrace 0 0.0000 1 0.0000
3213 DAT_0001 40200 0.0000 465 0.0000
3212 DAT_0001 0 0.0000 146 0.0000
3215 DAT_0002 41775 0.0000 412 0.0000
3214 DAT_0002 0 0.0000 195 0.0000
3217 DAT_0003 41131 0.0000 402 0.0000
3216 DAT_0003 0 0.0000 207 0.0000
3219 LOG_001 173 0.0000 2 0.0000
Devspace No. Read(s) RPages Write(s) WPages
knltrace 0 0 0 1 1
DAT_0001 1 43003 43003 611 690
DAT_0002 2 44516 44516 607 802
DAT_0003 3 44040 44040 609 710
LOG_001 4 181 1385 368 375
total I/O 131740 132944 2196 2578
-
T1 TIMEOUT ( pid = -1 ) -
dispatcher_cnt: 17413 command_cnt : 0
exclusive_cnt : 501120 self_susp_cnt : 0
dev_write_io : 1 dev_write_pg : 1
state_vwait : 0 state_vsleep : 17411 state_vsusp : 0
-
Inx Region Get-Counts Collision-Counts
Total / Task / percent Total / Task / percent
56 LOCKINIT 2092506 / 17405 / 0.83 % 0 / 0 / 0.00 %
57 LOCKPOOL 22509 / 18764 / 83.36 % 0 / 0 / 0.00 %
60 SAVEPOIN 11 / 1 / 9.09 % 0 / 0 / 0.00 %
66 SERVER 47905 / 17426 / 36.38 % 1 / 0 / 0.00 %
68 SURROGAT 23599 / 17409 / 73.77 % 0 / 0 / 0.00 %
84 SAVE1 2 / 2 /100.00 % 0 / 0 / 0.00 %
85 SAVE2 2 / 2 /100.00 % 0 / 0 / 0.00 %
86 DATA1 272327 / 16 / 0.01 % 5027 / 0 / 0.00 %
87 DATA2 62608 / 14 / 0.02 % 3616 / 0 / 0.00 %
88 DATA3 143046 / 12 / 0.01 % 7625 / 0 / 0.00 %
89 DATA4 81378 / 10 / 0.01 % 7629 / 0 / 0.00 %
90 DATA5 155192 / 8 / 0.01 % 5427 / 0 / 0.00 %
91 DATA6 116221 / 6 / 0.01 % 4825 / 0 / 0.00 %
92 DATA7 99933 / 4 / 0.00 % 5423 / 0 / 0.00 %
93 DATA8 68148 / 2 / 0.00 % 5422 / 0 / 0.00 %
105 DATA20 74123 / 1 / 0.00 % 5714 / 0 / 0.00 %
108 DATA23 49106 / 17 / 0.03 % 6728 / 0 / 0.00 %
109 DATA24 80526 / 16 / 0.02 % 7124 / 0 / 0.00 %
110 DATA25 416603 / 15 / 0.00 % 3623 / 0 / 0.00 %
111 DATA26 78093 / 15 / 0.02 % 4922 / 0 / 0.00 %
112 DATA27 423110 / 14 / 0.00 % 7521 / 0 / 0.00 %
113 DATA28 1261798 / 13 / 0.00 % 5819 / 0 / 0.00 %
114 DATA29 97660 / 12 / 0.01 % 4516 / 0 / 0.00 %
115 DATA30 62183 / 11 / 0.02 % 5716 / 0 / 0.00 %
116 DATA31 74930 / 10 / 0.01 % 3814 / 0 / 0.00 %
117 DATA32 137588 / 23 / 0.02 % 2814 / 0 / 0.00 %
118 DATA33 421146 / 22 / 0.01 % 7723 / 0 / 0.00 %
119 DATA34 65262 / 23 / 0.04 % 7723 / 0 / 0.00 %
120 DATA35 52449 / 22 / 0.04 % 9575 / 0 / 0.00 %
121 DATA36 52982 / 21 / 0.04 % 6425 / 0 / 0.00 %
122 DATA37 96596 / 20 / 0.02 % 3915 / 0 / 0.00 %
123 DATA38 67893 / 22 / 0.03 % 3419 / 0 / 0.00 %
124 DATA39 1433041 / 22 / 0.00 % 3720 / 0 / 0.00 %
125 DATA40 100955 / 23 / 0.02 % 5318 / 0 / 0.00 %
126 DATA41 352178 / 22 / 0.01 % 7119 / 0 / 0.00 %
127 DATA42 76802 / 21 / 0.03 % 5028 / 0 / 0.00 %
128 DATA43 47429 / 20 / 0.04 % 5625 / 0 / 0.00 %
129 DATA44 62154 / 20 / 0.03 % 7720 / 0 / 0.00 %
130 DATA45 76398 / 20 / 0.03 % 5429 / 0 / 0.00 %
131 DATA46 94363 / 19 / 0.02 % 4820 / 0 / 0.00 %
132 DATA47 50856 / 18 / 0.04 % 4813 / 0 / 0.00 %
133 DATA48 78895 / 17 / 0.02 % 3027 / 0 / 0.00 %
134 TRANS1 1243826 / 17405 / 1.40 % 0 / 0 / 0.00 %
135 TRANS2 877845 / 17405 / 1.98 % 0 / 0 / 0.00 %
136 TRANS3 1188490 / 17405 / 1.46 % 0 / 0 / 0.00 %
137 TRANS4 990013 / 17405 / 1.76 % 0 / 0 / 0.00 %
138 TRANS5 933725 / 17405 / 1.86 % 0 / 0 / 0.00 %
139 TRANS6 1221502 / 17405 / 1.42 % 0 / 0 / 0.00 %
140 TRANS7 897280 / 17405 / 1.94 % 0 / 0 / 0.00 %
141 TRANS8 1132537 / 17405 / 1.54 % 0 / 0 / 0.00 %
142 TAB9 983874 / 17405 / 1.77 % 0 / 0 / 0.00 %
143 TAB10 46706 / 17405 / 37.27 % 0 / 0 / 0.00 %
144 TAB11 31946 / 17405 / 54.48 % 0 / 0 / 0.00 %
145 TAB12 20488 / 17405 / 84.95 % 0 / 0 / 0.00 %
146 TAB13 21314 / 17405 / 81.66 % 0 / 0 / 0.00 %
147 TAB14 57646 / 17405 / 30.19 % 0 / 0 / 0.00 %
148 TAB15 20054 / 17405 / 86.79 % 0 / 0 / 0.00 %
149 TAB16 30230 / 17405 / 57.58 % 0 / 0 / 0.00 %
150 ROW17 155679 / 17405 / 11.18 % 0 / 0 / 0.00 %
151 ROW18 137365 / 17405 / 12.67 % 0 / 0 / 0.00 %
152 ROW19 162665 / 17405 / 10.70 % 0 / 0 / 0.00 %
153 ROW20 153850 / 17405 / 11.31 % 0 / 0 / 0.00 %
154 ROW21 150363 / 17405 / 11.58 % 0 / 0 / 0.00 %
155 ROW22 143018 / 17405 / 12.17 % 0 / 0 / 0.00 %
156 ROW23 138006 / 17405 / 12.61 % 0 / 0 / 0.00 %
157 ROW24 154265 / 17405 / 11.28 % 0 / 0 / 0.00 %
....
I think, I can't post the complete file here... its just too large.
I tried to convert the knltrace file following the instructions from the wiki, but the resulting file <dbname>.prt only contains
************************************************************************
KERNPROT 7.6.05 2009-01-14 21:45:19 ***
************************************************************************
nothing more
Do you have any suggestion what I should do next ?
>
> I have checked several system logfiles, but there are no errors/warnings/notices for the time the maxdb crashes occured.
>
> Here are the values for all STACK parameters from my database:
>
> MBLOCKSTACK_SIZE: 32768
> DYNTASK_STACK: NO
> MAXTASKSTACK: 512
> MAX_SERVERTASK_STACK: 500
> MAX_SPECIALTASK_STACK:500
You may want to increase MAXTASKSTACK to 1024, just to let a bit more space to grow.
> Here are more lines from the file "rtedump"
As you may have seen - no active processes there - too bad for the analysis as we cannot tell the task that ran into the error.
> I tried to convert the knltrace file following the instructions from the wiki, but the resulting file <dbname>.prt only contains
>
> ************************************************************************
> *** KERNPROT 7.6.05 2009-01-14 21:45:19 ***
> ************************************************************************
>
> nothing more
>
> Do you have any suggestion what I should do next ?
Ok, not even the trace contained any data - there's nothing more that you could check.
If the error does not reoccur, than you're out of luck now concerning the cause of the error.
If it does reoccur, you may want to run the database with the default_trace enabled to 'catch' the failing function.
Regards,
Lars
Hello Claus,
1. "DBCRASH Kernel exited without core and exitu2026" & , unfortunately,
the "Symbolic Stack Back Trace" was not written. The knltrace and rtedump
didn't give further light on this crash. Please check if you could set the SUPPRESS_CORE
database parameter to NO for the core dump to be created during the next database crash.
< http://maxdb.sap.com/doc/7_6/7e/c3fb0e72fcf84580f7ee9fcec672b7/frameset.htm
Glossary -> Parameters -> Support Database Parameters -> SUPPRESS_CORE >
You need to be sure that you have enough space in database RUNDIRECTORy
for the core dump to be written.
If the core dump will be written, debug it & post the results.
2. Please update with output of the dbm command "param_directgetall" and please post information about the OS of the database server < 'uname -a' ? >.
Are you SAP customer?
Thank you and best regards, Natalia Khlopina
Hello,
I made the suggested settings.
The operating system of the MaxDB server is SuSE Linux 10.3 with kernel version 2.6.22.5-31-bigsmp
Here is the output for "param_directgetall"
KERNELVERSION KERNEL 7.6.05 BUILD 009-121-191-997
INSTANCE_TYPE OLTP
MCOD NO
SERVERDBFOR_SAP YES
_UNICODE NO
DEFAULT_CODE ASCII
DATE_TIME_FORMAT INTERNAL
CONTROLUSERID <username>
CONTROLPASSWORD
MAXLOGVOLUMES 2
MAXDATAVOLUMES 16
LOG_VOLUME_NAME_001 LOG_001
LOG_VOLUME_TYPE_001 F
LOG_VOLUME_SIZE_001 64000
DATA_VOLUME_NAME_0003 DAT_0003
DATA_VOLUME_NAME_0002 DAT_0002
DATA_VOLUME_NAME_0001 DAT_0001
DATA_VOLUME_TYPE_0003 F
DATA_VOLUME_TYPE_0002 F
DATA_VOLUME_TYPE_0001 F
DATA_VOLUME_SIZE_0003 13107200
DATA_VOLUME_SIZE_0002 13107200
DATA_VOLUME_SIZE_0001 13107200
DATA_VOLUME_MODE_0003 NORMAL
DATA_VOLUME_MODE_0002 NORMAL
DATA_VOLUME_MODE_0001 NORMAL
DATA_VOLUME_GROUPS 1
LOG_BACKUP_TO_PIPE NO
MAXBACKUPDEVS 2
LOG_MIRRORED NO
MAXVOLUMES 19
LOG_IO_BLOCK_COUNT 8
DATA_IO_BLOCK_COUNT 64
BACKUP_BLOCK_CNT 64
DELAYLOGWRITER 0
LOG_IO_QUEUE 50
RESTARTTIME 600
MAXCPU 2
LOCAL_REDO_LOG_BUFFER_SIZE 0
MAX_LOG_QUEUE_COUNT 0
USED_MAX_LOG_QUEUE_COUNT 2
LOG_QUEUE_COUNT 1
MAXUSERTASKS 75
TRANSRGNS 8
TABRGNS 8
OMSREGIONS 0
OMSRGNS 7
LOCKMANAGERENABLED NO
LMLOCK_REGIONS 0
LMREQUEST_REGIONS 0
LMTRANS_REGIONS 0
OMS_HEAP_LIMIT 0
OMS_HEAP_COUNT 2
OMS_HEAP_BLOCKSIZE 10000
OMS_HEAP_THRESHOLD 100
OMS_VERS_THRESHOLD 2097152
HEAP_CHECK_LEVEL 0
ROWRGNS 8
RESERVEDSERVERTASKS 21
MINSERVERTASKS 38
MAXSERVERTASKS 38
MAXGARBAGECOLL 1
_MAXTRANS 604
MAXLOCKS 6080
LOCKSUPPLY_BLOCK 100
DEADLOCK_DETECTION 4
DEADLOCK_DUMP_FILENAME
SESSION_TIMEOUT 900
OMS_STREAM_TIMEOUT 30
REQUEST_TIMEOUT 5000
IOPROCSPER_DEV 2
IOPROCSFOR_PRIO 0
IOPROCSFOR_READER 0
USEIOPROCS_ONLY NO
IOPROCSSWITCH 2
LRU_FOR_SCAN NO
PAGESIZE 8192
PACKETSIZE 131072
MINREPLYSIZE 4096
MBLOCKDATA_SIZE 32768
MBLOCKQUAL_SIZE 32768
MBLOCKSTACK_SIZE 32768
MBLOCKSTRAT_SIZE 16384
WORKSTACKSIZE 8192
WORKDATASIZE 8192
CATCACHE_MINSIZE 262144
CAT_CACHE_SUPPLY 4864
INIT_ALLOCATORSIZE 262144
ALLOW_MULTIPLE_SERVERTASK_UKTS NO
TASKCLUSTER01 tw;al;ut;2000sv,100bup;10ev,10gc;
TASKCLUSTER02 ti,100dw;38us;
TASKCLUSTER03 equalize
DYNTASK_STACK NO
MPRGN_QUEUE YES
MPRGN_DIRTY_READ DEFAULT
MPRGN_BUSY_WAIT DEFAULT
MPDISP_LOOPS 2
MPDISP_PRIO DEFAULT
MP_RGN_LOOP -1
MPRGN_PRIO DEFAULT
MAXRGN_REQUEST -1
PRIOBASE_U2U 100
PRIOBASE_IOC 80
PRIOBASE_RAV 80
PRIOBASE_REX 40
PRIOBASE_COM 10
PRIOFACTOR 80
DELAYCOMMIT NO
MAXTASKSTACK 1024
MAX_SERVERTASK_STACK 500
MAX_SPECIALTASK_STACK 500
DWIO_AREA_SIZE 50
DWIO_AREA_FLUSH 50
FBM_VOLUME_COMPRESSION 50
FBM_VOLUME_BALANCE 10
FBMLOW_IO_RATE 10
CACHE_SIZE 150000
DWLRU_TAIL_FLUSH 25
XP_DATA_CACHE_RGNS 0
DATACACHE_RGNS 48
XP_CONVERTER_REGIONS 0
CONVERTER_REGIONS 48
XP_MAXPAGER 0
MAXPAGER 48
SEQUENCE_CACHE 1
IDXFILELIST_SIZE 2048
VOLUMENO_BIT_COUNT 8
OPTIM_MAX_MERGE 500
OPTIM_INV_ONLY YES
OPTIM_CACHE NO
OPTIM_JOIN_FETCH 0
JOIN_SEARCH_LEVEL 0
JOIN_MAXTAB_LEVEL4 16
JOIN_MAXTAB_LEVEL9 5
READAHEADBLOBS 32
READAHEAD_TABLE_THRESHOLD 0
CLUSTER_WRITE_THRESHOLD 80
CLUSTERED_LOBS NO
CLUSTERCOMPRESSIONTHRESHOLD 1000
CLUSTERCOMPRESSIONFILLTHRESHOLD 10
RUNDIRECTORY /var/opt/sdb/data/wrk/<dbname>
OPMSG1 /dev/console
OPMSG2 /dev/null
_KERNELDIAGFILE knldiag
KERNELDIAGSIZE 800
_EVENTFILE knldiag.evt
_EVENTSIZE 0
_MAXEVENTTASKS 2
_MAXEVENTS 100
_KERNELTRACEFILE knltrace
TRACE_PAGES_TI 2
TRACE_PAGES_GC 20
TRACE_PAGES_LW 5
TRACE_PAGES_PG 3
TRACE_PAGES_US 10
TRACE_PAGES_UT 5
TRACE_PAGES_SV 5
TRACE_PAGES_EV 2
TRACE_PAGES_BUP 0
KERNELTRACESIZE 1121
EXTERNAL_DUMP_REQUEST NO
AKDUMP_ALLOWED YES
_KERNELDUMPFILE knldump
_RTEDUMPFILE rtedump
UTILITYPROTFILE dbm.utl
UTILITY_PROTSIZE 100
BACKUPHISTFILE dbm.knl
BACKUPMED_DEF dbm.mdf
MAXMESSAGE_FILES 0
_SHMKERNEL 9640
__PARAM_CHANGED___ 0
__PARAM_VERIFIED__ 2009-01-18 20:09:54
DIAG_HISTORY_NUM 2
DIAG_HISTORY_PATH /var/opt/sdb/data/wrk/<dbname>/DIAGHISTORY
DIAGSEM 1
SHOW_MAX_STACK_USE NO
SHOW_MAX_KB_STACK_USE NO
LOG_SEGMENT_SIZE 21333
_COMMENT
SUPPRESS_CORE NO
FORMATTING_MODE PARALLEL
FORMAT_DATAVOLUME YES
OFFICIAL_NODE
UKT_CPU_RELATIONSHIP NONE
HIRES_TIMER_TYPE CPU
LOAD_BALANCING_CHK 0
LOAD_BALANCING_DIF 10
LOAD_BALANCING_EQ 5
HS_STORAGE_DLL libhsscopy
HS_SYNC_INTERVAL 50
USE_OPEN_DIRECT YES
USE_OPEN_DIRECT_FOR_BACKUP NO
SYMBOL_DEMANGLING NO
EXPAND_COM_TRACE NO
JOIN_TABLEBUFFER 128
SET_VOLUME_LOCK YES
SHAREDSQL YES
SHAREDSQL_CLEANUPTHRESHOLD 25
SHAREDSQL_COMMANDCACHESIZE 262144
MEMORY_ALLOCATION_LIMIT 0
USE_SYSTEM_PAGE_CACHE YES
USE_COROUTINES YES
FORBID_LOAD_BALANCING YES
MIN_RETENTION_TIME 60
MAX_RETENTION_TIME 480
MAX_SINGLE_HASHTABLE_SIZE 512
MAX_HASHTABLE_MEMORY 5120
ENABLE_CHECK_INSTANCE YES
RTE_TEST_REGIONS 0
HASHED_RESULTSET YES
HASHED_RESULTSET_CACHESIZE 262144
CHECK_HASHED_RESULTSET 0
AUTO_RECREATE_BAD_INDEXES NO
AUTHENTICATION_ALLOW
AUTHENTICATION_DENY
TRACE_AK NO
TRACE_DEFAULT NO
TRACE_DELETE NO
TRACE_INDEX NO
TRACE_INSERT NO
TRACE_LOCK NO
TRACE_LONG NO
TRACE_OBJECT NO
TRACE_OBJECT_ADD NO
TRACE_OBJECT_ALTER NO
TRACE_OBJECT_FREE NO
TRACE_OBJECT_GET NO
TRACE_OPTIMIZE NO
TRACE_ORDER NO
TRACE_ORDER_STANDARD NO
TRACE_PAGES NO
TRACE_PRIMARY_TREE NO
TRACE_SELECT NO
TRACE_TIME NO
TRACE_UPDATE NO
TRACE_STOP_ERRORCODE 0
TRACE_ALLOCATOR 0
TRACE_CATALOG 0
TRACE_CLIENTKERNELCOM 0
TRACE_COMMON 0
TRACE_COMMUNICATION 0
TRACE_CONVERTER 0
TRACE_DATACHAIN 0
TRACE_DATACACHE 0
TRACE_DATAPAM 0
TRACE_DATATREE 0
TRACE_DATAINDEX 0
TRACE_DBPROC 0
TRACE_FBM 0
TRACE_FILEDIR 0
TRACE_FRAMECTRL 0
TRACE_IOMAN 0
TRACE_IPC 0
TRACE_JOIN 0
TRACE_KSQL 0
TRACE_LOGACTION 0
TRACE_LOCKMANAGER 0
TRACE_LOGHISTORY 0
TRACE_LOGPAGE 0
TRACE_LOGTRANS 0
TRACE_LOGVOLUME 0
TRACE_MEMORY 0
TRACE_MESSAGES 0
TRACE_OBJECTCONTAINER 0
TRACE_OMS_CONTAINERDIR 0
TRACE_OMS_CONTEXT 0
TRACE_OMS_ERROR 0
TRACE_OMS_FLUSHCACHE 0
TRACE_OMS_INTERFACE 0
TRACE_OMS_KEY 0
TRACE_OMS_KEYRANGE 0
TRACE_OMS_LOCK 0
TRACE_OMS_MEMORY 0
TRACE_OMS_NEWOBJ 0
TRACE_OMS_SESSION 0
TRACE_OMS_STREAM 0
TRACE_OMS_VAROBJECT 0
TRACE_OMS_VERSION 0
TRACE_PAGER 0
TRACE_RUNTIME 0
TRACE_SHAREDSQL 0
TRACE_SQLMANAGER 0
TRACE_SRVTASKS 0
TRACE_SYNCHRONISATION 0
TRACE_SYSVIEW 0
TRACE_TABLE 0
TRACE_VOLUME 0
CHECK_BACKUP NO
CHECK_DATACACHE NO
CHECK_KB_REGIONS NO
CHECK_LOCK NO
CHECK_LOCK_SUPPLY NO
CHECK_REGIONS NO
CHECK_TASK_SPECIFIC_CATALOGCACHE NO
CHECK_TRANSLIST NO
CHECK_TREE NO
CHECK_TREE_LOCKS NO
CHECK_COMMON 0
CHECK_CONVERTER 0
CHECK_DATAPAGELOG 0
CHECK_DATAINDEX 0
CHECK_FBM 0
CHECK_IOMAN 0
CHECK_LOGHISTORY 0
CHECK_LOGPAGE 0
CHECK_LOGTRANS 0
CHECK_LOGVOLUME 0
CHECK_SRVTASKS 0
OPTIMIZE_AGGREGATION YES
OPTIMIZE_FETCH_REVERSE YES
OPTIMIZE_STAR_JOIN YES
OPTIMIZE_JOIN_ONEPHASE YES
OPTIMIZE_JOIN_OUTER YES
OPTIMIZE_MIN_MAX YES
OPTIMIZE_FIRST_ROWS YES
OPTIMIZE_OPERATOR_JOIN YES
OPTIMIZE_JOIN_HASHTABLE YES
OPTIMIZE_JOIN_HASH_MINIMAL_RATIO 1
OPTIMIZE_OPERATOR_JOIN_COSTFUNC YES
OPTIMIZE_JOIN_PARALLEL_MINSIZE 1000000
OPTIMIZE_JOIN_PARALLEL_SERVERS 0
OPTIMIZE_JOIN_OPERATOR_SORT YES
OPTIMIZE_QUAL_ON_INDEX YES
DDLTRIGGER YES
SUBTREE_LOCKS NO
MONITOR_READ 2147483647
MONITOR_TIME 2147483647
MONITOR_SELECTIVITY 0
MONITOR_ROWNO 0
CALLSTACKLEVEL 0
OMS_RUN_IN_UDE_SERVER NO
OPTIMIZE_QUERYREWRITE OPERATOR
TRACE_QUERYREWRITE 0
CHECK_QUERYREWRITE 0
PROTECT_DATACACHE_MEMORY NO
FILEDIR_SPINLOCKPOOL_SIZE 10
TRANS_HISTORY_SIZE 0
TRANS_THRESHOLD_VALUE 60
ENABLE_SYSTEM_TRIGGERS YES
DBFILLINGABOVELIMIT 70L80M85M90H95H96H97H98H99H
DBFILLINGBELOWLIMIT 70L80L85L90L95L
LOGABOVELIMIT 50L75L90M95M96H97H98H99H
AUTOSAVE 1
BACKUPRESULT 1
CHECKDATA 1
EVENT 1
ADMIN 1
ONLINE 1
UPDSTATWANTED 1
OUTOFSESSIONS 3
ERROR 3
SYSTEMERROR 3
DATABASEFULL 1
LOGFULL 1
LOGSEGMENTFULL 1
STANDBY 1
USESELECTFETCH YES
USEVARIABLEINPUT NO
UPDATESTAT_PARALLEL_SERVERS 0
UPDATESTAT_SAMPLE_ALGO 1
SIMULATE_VECTORIO IF_OPEN_DIRECT_OR_RAW_DEVICE
COLUMNCOMPRESSION YES
TIME_MEASUREMENT NO
CHECK_TABLE_WIDTH NO
MAX_MESSAGE_LIST_LENGTH 100
SYMBOL_RESOLUTION YES
PREALLOCATE_IOWORKER NO
CACHE_IN_SHARED_MEMORY NO
INDEX_LEAF_CACHING 2
NO_SYNC_TO_DISK_WANTED NO
SPINLOCK_LOOP_COUNT 30000
SPINLOCK_BACKOFF_BASE 1
SPINLOCK_BACKOFF_FACTOR 2
SPINLOCK_BACKOFF_MAXIMUM 64
ROW_LOCKS_PER_TRANSACTION 50
USEUNICODECOLUMNCOMPRESSION NO
FBM_CLUSTER_MODE MIXED
I found a file called "comseg.dump" in the "DIAGHISTORY" directory. Here are the first lines from the file:
====================================================
Big Communication segment dump for UKT007 (due to Task T097)
-
big_comseg_header DUMP (size 4983832)-----
bc_size 4983832
bc_version 1
bc_comseg_cnt 38
bc_packet_cnt 38
bc_comseg_size 72
bc_packet_size 131072
bc_comseg_offset 48
bc_list_offset 2784
bc_packet_offset 3088
bc_kp_running 0
bc_common_flag 1
-
big_comseg content DUMP-----
0x00000 180B4B00 01000000 26000000 26000000 ..L.....&...&...
0x00010 48000000 00000200 30000000 D0000000 H.......0.......
0x00020 100B0000 00000000 01000000 00000000 ................
0x00030 00000000 01000000 01000000 00000200 ................
0x00040 D0000000 00000000 70230000 00000000 ........z#......
0x00050 01000000 00000000 00000000 00000000 ................
0x00060 02000000 00000000 04800200 12000404 ................
0x00070 00000000 00000000 00000000 01000000 ................
0x00080 01000000 00000200 D8000000 00000000 ................
0x00090 78230000 00000000 01000000 00000000 x#..............
0x000A0 00000000 00000000 02000000 00000000 ................
0x000B0 04800200 12800304 00000000 00000000 ................
0x000C0 00000000 01000000 01000000 00000200 ................
0x000D0 F0000000 00000000 7B230000 00000000 ........|#......
0x000E0 01000000 00000000 00000000 00000000 ................
0x000F0 02000000 00000000 04800200 12800404 ................
0x00100 00000000 00000000 00000000 01000000 ................
0x00110 01000000 00000200 F8000000 00000000 ................
0x00120 34230000 00000000 01000000 00000000 4#..............
0x00130 00000000 00000000 02000000 00000000 ................
0x00140 04800200 1200F503 00000000 00000000 ................
0x00150 00000000 01000000 01000000 00000200 ................
0x00160 000A0000 00000000 86230000 00000000 .........#......
0x00170 01000000 00000000 00000000 00000000 ................
0x00180 02000000 00000000 04800200 12000704 ................
0x00190 00000000 00000000 00000000 01000000 ................
0x001A0 01000000 00000200 080A0000 00000000 ................
0x001B0 7D230000 00000000 01000000 00000000 ~#..............
0x001C0 00000000 00000000 02000000 00000000 ................
0x001D0 04800200 12000504 00000000 00000000 ................
0x001E0 00000000 01000000 01000000 00000200 ................
0x001F0 100A0000 00000000 80230000 00000000 .........#......
0x00200 01000000 00000000 00000000 00000000 ................
0x00210 02000000 00000000 04800200 12800504 ................
0x00220 00000000 00000000 00000000 01000000 ................
0x00230 01000000 00000200 180A0000 00000000 ................
0x00240 84230000 00000000 01000000 00000000 .#..............
0x00250 00000000 00000000 02000000 00000000 ................
0x00260 04800200 12800604 00000000 00000000 ................
0x00270 00000000 01000000 01000000 00000200 ................
0x00280 200A0000 00000000 88230000 00000000 ........#......
0x00290 01000000 00000000 00000000 00000000 ................
0x002A0 02000000 00000000 04800200 12800704 ................
0x002B0 00000000 00000000 00000000 01000000 ................
0x002C0 01000000 00000200 280A0000 00000000 ........(.......
0x002D0 4F230000 00000000 01000000 00000000 O#..............
0x002E0 00000000 00000000 02000000 00000000 ................
0x002F0 04800200 1280F003 00000000 00000000 ................
0x00300 00000000 01000000 01000000 00000200 ................
0x00310 300A0000 00000000 38230000 00000000 0.......8#......
0x00320 01000000 00000000 00000000 00000000 ................
0x00330 02000000 00000000 04800200 1200F603 ................
0x00340 00000000 00000000 00000000 01000000 ................
0x00350 01000000 00000200 380A0000 00000000 ........8.......
0x00360 30230000 00000000 01000000 00000000 :#..............
0x00370 00000000 00000000 02000000 00000000 ................
0x00380 04800200 1280F603 00000000 00000000 ................
0x00390 00000000 01000000 01000000 00000200 ................
0x003A0 400A0000 00000000 3B230000 00000000 @.......<#......
0x003B0 01000000 00000000 00000000 00000000 ................
0x003C0 02000000 00000000 04800200 1200F703 ................
0x003D0 00000000 00000000 00000000 01000000 ................
0x003E0 01000000 00000200 480A0000 00000000 ........H.......
0x003F0 43230000 00000000 01000000 00000000 C#..............
0x00400 00000000 00000000 02000000 00000000 ................
0x00410 04800200 1280F703 00000000 00000000 ................
0x00420 00000000 01000000 01000000 00000200 ................
0x00430 500A0000 00000000 45230000 00000000 P.......E#......
0x00440 01000000 00000000 00000000 00000000 ................
0x00450 02000000 00000000 04800200 1200F803 ................
0x00460 00000000 00000000 00000000 01000000 ................
0x00470 01000000 00000200 580A0000 00000000 ........X.......
0x00480 49230000 00000000 01000000 00000000 I#..............
0x00490 00000000 00000000 02000000 00000000 ................
0x004A0 04800200 1200F903 00000000 00000000 ................
0x004B0 00000000 01000000 01000000 00000200 ................
0x004C0 600A0000 00000000 6D230000 00000000 `.......n#......
0x004D0 01000000 00000000 00000000 00000000 ................
0x004E0 02000000 00000000 04800200 12000104 ................
0x004F0 00000000 00000000 00000000 01000000 ................
0x00500 01000000 00000200 680A0000 00000000 ........h.......
0x00510 6B230000 00000000 01000000 00000000 l#..............
0x00520 00000000 00000000 02000000 00000000 ................
0x00530 04800200 12800004 00000000 00000000 ................
0x00540 00000000 01000000 01000000 00000200 ................
0x00550 700A0000 00000000 47230000 00000000 p.......G#......
0x00560 01000000 00000000 00000000 00000000 ................
0x00570 02000000 00000000 04800200 1280F803 ................
0x00580 00000000 00000000 00000000 01000000 ................
0x00590 01000000 00000200 780A0000 00000000 ........x.......
0x005A0 4C230000 00000000 01000000 00000000 M#..............
0x005B0 00000000 00000000 02000000 00000000 ................
0x005C0 04800200 1200F003 00000000 00000000 ................
0x005D0 00000000 01000000 01000000 00000200 ................
0x005E0 800A0000 00000000 4A230000 00000000 ........K#......
0x005F0 01000000 00000000 00000000 00000000 ................
0x00600 02000000 00000000 04800200 1280F903 ................
0x00610 00000000 00000000 00000000 01000000 ................
0x00620 01000000 00000200 880A0000 00000000 ................
0x00630 53230000 00000000 01000000 00000000 S#..............
0x00640 00000000 00000000 02000000 00000000 ................
0x00650 04800200 1280FA03 00000000 00000000 ................
0x00660 00000000 01000000 01000000 00000200 ................
0x00670 900A0000 00000000 51230000 00000000 ........Q#......
0x00680 01000000 00000000 00000000 00000000 ................
0x00690 02000000 00000000 04800200 1200FA03 ................
0x006A0 00000000 00000000 00000000 01000000 ................
0x006B0 01000000 00000200 980A0000 00000000 ................
0x006C0 55230000 00000000 01000000 00000000 U#..............
0x006D0 00000000 00000000 02000000 00000000 ................
0x006E0 04800200 1200FB03 00000000 00000000 ................
0x006F0 00000000 01000000 01000000 00000200 ................
0x00700 000A0000 00000000 57230000 00000000 ........W#......
0x00710 01000000 00000000 00000000 00000000 ................
0x00720 02000000 00000000 04800200 1280FB03 ................
0x00730 00000000 00000000 00000000 01000000 ................
0x00740 01000000 00000200 080A0000 00000000 ................
0x00750 59230000 00000000 01000000 00000000 Y#..............
0x00760 00000000 00000000 02000000 00000000 ................
0x00770 04800200 1200FC03 00000000 00000000 ................
0x00780 00000000 01000000 01000000 00000200 ................
0x00790 A00A0000 00000000 5A230000 00000000 ........[#......
0x007A0 01000000 00000000 00000000 00000000 ................
0x007B0 02000000 00000000 04800200 1280FC03 ................
0x007C0 00000000 00000000 00000000 01000000 ................
0x007D0 01000000 00000200 A80A0000 00000000 ................
0x007E0 62230000 00000000 01000000 00000000 b#..............
0x007F0 00000000 00000000 02000000 00000000 ................
0x00800 04800200 1200FD03 00000000 00000000 ................
0x00810 00000000 01000000 01000000 00000200 ................
0x00820 B00A0000 00000000 64230000 00000000 ........d#......
0x00830 01000000 00000000 00000000 00000000 ................
0x00840 02000000 00000000 04800200 1280FD03 ................
0x00850 00000000 00000000 00000000 01000000 ................
0x00860 01000000 00000200 B80A0000 00000000 ................
0x00870 66230000 00000000 01000000 00000000 f#..............
0x00880 00000000 00000000 02000000 00000000 ................
0x00890 04800200 1200FF03 00000000 00000000 ................
0x008A0 00000000 01000000 01000000 00000200 ................
0x008B0 C00A0000 00000000 68230000 00000000 ........h#......
0x008C0 01000000 00000000 00000000 00000000 ................
0x008D0 02000000 00000000 04800200 1280FF03 ................
0x008E0 00000000 00000000 00000000 01000000 ................
0x008F0 01000000 00000200 C80A0000 00000000 ................
0x00900 60230000 00000000 01000000 00000000 j#..............
0x00910 00000000 00000000 02000000 00000000 ................
0x00920 04800200 12000004 00000000 00000000 ................
0x00930 00000000 01000000 01000000 00000200 ................
0x00940 D00A0000 00000000 36230000 00000000 ........6#......
0x00950 01000000 00000000 00000000 00000000 ................
0x00960 02000000 00000000 04800200 1280F503 ................
0x00970 00000000 00000000 00000000 01000000 ................
0x00980 01000000 00000200 D80A0000 00000000 ................
0x00990 82230000 00000000 01000000 00000000 .#..............
0x009A0 00000000 00000000 02000000 00000000 ................
0x009B0 04800200 12000604 00000000 00000000 ................
0x009C0 00000000 01000000 01000000 00000200 ................
0x009D0 F00A0000 00000000 70230000 00000000 ........p#......
0x009E0 01000000 00000000 00000000 00000000 ................
0x009F0 02000000 00000000 04800200 12800104 ................
0x00A00 00000000 00000000 00000000 01000000 ................
0x00A10 01000000 00000200 F80A0000 00000000 ................
0x00A20 72230000 00000000 01000000 00000000 r#..............
0x00A30 00000000 00000000 02000000 00000000 ................
0x00A40 04800200 12000204 00000000 00000000 ................
0x00A50 00000000 01000000 01000000 00000200 ................
0x00A60 000B0000 00000000 76230000 00000000 ........v#......
0x00A70 01000000 00000000 00000000 00000000 ................
0x00A80 02000000 00000000 04800200 12000304 ................
0x00A90 00000000 00000000 00000000 01000000 ................
0x00AA0 01000000 00000200 080B0000 00000000 ................
0x00AB0 74230000 00000000 01000000 00000000 t#..............
0x00AC0 00000000 00000000 02000000 00000000 ................
0x00AD0 04800200 12800204 00000000 00000000 ................
0x00AE0 100B0000 00000000 100B0200 00000000 ................
0x00AF0 100B0400 00000000 100B0600 00000000 ................
0x00B00 100B0800 00000000 100B0000 00000000 ................
0x00B10 100B0B00 00000000 100B0D00 00000000 ................
0x00B20 100B1000 00000000 100B1200 00000000 ................
0x00B30 100B1400 00000000 100B1600 00000000 ................
0x00B40 100B1800 00000000 100B1000 00000000 ................
0x00B50 100B1B00 00000000 100B1D00 00000000 ................
0x00B60 100B2000 00000000 100B2200 00000000 .. .......".....
0x00B70 100B2400 00000000 100B2600 00000000 ..$.......&.....
0x00B80 100B2800 00000000 100B2000 00000000 ..(.......*.....
0x00B90 100B2B00 00000000 100B2D00 00000000 ..,.............
0x00BA0 100B3000 00000000 100B3200 00000000 ..0.......2.....
0x00BB0 100B3400 00000000 100B3600 00000000 ..4.......6.....
0x00BC0 100B3800 00000000 100B3000 00000000 ..8.......:.....
0x00BD0 100B3B00 00000000 100B3D00 00000000 ..<.......>.....
0x00BE0 100B4000 00000000 100B4200 00000000 ..@.......B.....
0x00BF0 100B4400 00000000 100B4600 00000000 ..D.......F.....
0x00C00 100B4800 00000000 100B4000 00000000 ..H.......J.....
0x00C10 60000000 00400000 5D000000 01000000 `....@..^.......
0x00C20 00000400 60000000 00020000 37303630 ....`.......7060
0x00C30 354F4442 60FF0100 28000000 00000100 5ODB`...(.......
0x00C40 00000000 00000000 28000000 00000000 ........(.......
0x00C50 00000100 02303030 30300000 00000000 .....00000......
0x00C60 00000000 F2000000 00000000 00000000 ................
0x00C70 03000100 00000000 15000000 28FF0100 ............(...
0x00C80 524F4B4B 4241434A 20574F52 4A205245 ROLLBACK WORK RE
0x00C90 4B454153 45FFFFFF 0B000000 08FF0100 LEASE...........
0x00CA0 000FBF5F 00003001 54002B00 FFFFFFFF ..._..:.T.,.....
0x00CB0 0B000100 00000000 07000000 D8FD0100 ................
0x00CC0 FF303839 336532FF 36376630 35323532 .0893e2.67f05252
0x00CD0 36636335 31646139 31323032 32313030 6cc51da912022100
0x00CE0 30302720 4F524445 52204259 20636DFF 00' ORDER BY cn.
0x00CF0 00000000 B4178400 000000B4 17850000 ................
0x00D00 0000B417 86000000 00B41787 00000000 ................
0x00D10 B4178800 000000B4 17890000 0000B418 ................
0x00D20 98000000 FFFFFFFF 0A000100 00000000 ................
0x00D30 0B000000 70FD0100 000FBF5F 00003001 ....p......_..:.
0x00D40 54002B00 FFFFFFFF 20202020 20202020 T.,.....
0x00D50 20202020 20202020 20202020 20202020
0x00D60 - 0x00D8F identical
0x00D90 20202020 20202020 20206465 20202020 de
0x00DA0 20202020 20202020 20202020 20202020
0x00DB0 - 0x0118F identical
0x01190 20202020 20202020 2020FFFF FFFFFFFF ......
0x011A0 0A000100 00000000 0B000000 F8F90100 ................
0x011B0 000FBF5F 00003101 54002B00 FFFFFFFF ..._..1.T.,.....
0x011C0 20202020 20202020 08005375 6D646179 ..Sunday
0x011D0 20202020 20202020 20202020 20202020
0x011E0 20200600 5065726F 20202020 20202020 ..Zero
0x011F0 04005065 726F6574 68202020 20200700 ..Zeroeth ..
0x01200 4F6D6520 20202020 20202020 03004669 One ..Fi
0x01210 72737420 20202020 20200500 54776F20 rst ..Two
0x01220 20202020 20202020 03005365 636F6D64 ..Second
0x01230 20202020 20200600 54687265 65202020 ..Three
0x01240 20202020 05005468 69726420 20202020 ..Third
0x01250 20200500 466F7572 20202020 20202020 ..Four
0x01260 0400466F 75727468 20202020 20200600 ..Fourth ..
0x01270 46697665 20202020 20202020 04004669 Five ..Fi
0x01280 66746820 20202020 20200500 53697820 fth ..Six
0x01290 20202020 20202020 03005369 78746820 ..Sixth
0x012A0 20202020 20200500 53657665 6D202020 ..Seven
0x012B0 20202020 05005365 76656D74 68202020 ..Seventh
0x012C0 20200700 45696768 74202020 20202020 ..Eight
0x012D0 05004569 67687468 20202020 20200600 ..Eighth ..
0x012E0 4D696D65 20202020 20202020 04004D69 Nine ..Ni
0x012F0 6D746820 20202020 20200500 54656D20 nth ..Ten
0x01300 20202020 20202020 03005465 6D746820 ..Tenth
0x01310 20202020 20200500 456B6576 656D2020 ..Eleven
0x01320 20202020 0600456B 6576656D 74682020 ..Eleventh
0x01330 20200800 5477656B 76652020 20202020 ..Twelve
0x01340 06005477 656B6674 68202020 20200700 ..Twelfth ..
0x01350 54686972 7465656D 20202020 08005468 Thirteen ..Th
0x01360 69727465 656D7468 20200000 466F7572 irteenth ..Four
0x01370 7465656D 20202020 0800466F 75727465 teen ..Fourte
0x01380 656D7468 20200000 46696674 65656D20 enth ..Fifteen
0x01390 20202020 07004669 66746565 6D746820 ..Fifteenth
0x013A0 20200900 53697874 65656D20 20202020 ..Sixteen
0x013B0 07005369 78746565 6D746820 20200900 ..Sixteenth ..
0x013C0 53657665 6D746565 6D202020 09005365 Seventeen ..Se
0x013D0 76656D74 65656D74 68200A00 45696768 venteenth ..Eigh
0x013E0 7465656D 20202020 08004569 67687465 teen ..Eighte
0x013F0 656D7468 20200000 4D696D65 7465656D enth ..Nineteen
0x01400 20202020 08004D69 6D657465 656D7468 ..Nineteenth
0x01410 20200000 5477656D 74792020 20202020 ..Twenty
0x01420 06005477 656D7469 65746820 20200900 ..Twentieth ..
0x01430 54686972 74792020 20202020 06005468 Thirty ..Th
0x01440 69727469 65746820 20200900 466F7572 irtieth ..Four
0x01450 74792020 20202020 0600466F 75727469 ty ..Fourti
0x01460 65746820 20200900 46696674 79202020 eth ..Fifty
0x01470 20202020 05004669 66746965 74682020 ..Fiftieth
0x01480 20200800 53697874 79202020 20202020 ..Sixty
0x01490 05005369 78746965 74682020 20200800 ..Sixtieth ..
0x014A0 53657665 6D747920 20202020 07005365 Seventy ..Se
0x014B0 76656D74 69657468 20200000 45696768 ventieth ..Eigh
0x014C0 74792020 20202020 06004569 67687469 ty ..Eighti
0x014D0 65746820 20200900 4D696D65 74792020 eth ..Ninety
0x014E0 20202020 06004D69 6D657469 65746820 ..Ninetieth
0x014F0 20200900 00000000 00000000 00000000 ..............
.... <much more>
It seems to contain some sql queries and other informations. Can I convert the file to a more readable format ? Is the content helpful ?
The company I am working for is a SAP customer.
Bye
Claus
> The operating system of the MaxDB server is SuSE Linux 10.3 with kernel version 2.6.22.5-31-bigsmp
> I found a file called "comseg.dump" in the "DIAGHISTORY" directory. Here are the first lines from the file:
> ====================================================
> Big Communication segment dump for UKT007 (due to Task T097)
> -
big_comseg_header DUMP (size 4983832)-----
> bc_size 4983832
> bc_version 1
> bc_comseg_cnt 38
> bc_packet_cnt 38
> bc_comseg_size 72
> bc_packet_size 131072
> bc_comseg_offset 48
> bc_list_offset 2784
> bc_packet_offset 3088
> bc_kp_running 0
> bc_common_flag 1
> -
big_comseg content DUMP-----
Currently all we can see here is the content of the communication buffer - not too useful for any non-developer of MaxDB. Anyhow, we at least know that it belonged to usertask 97.
Given the information from the knldiag you already posted:
> 2009-01-13 11:03:22 3191 11561 COMMUNIC Connecting T97 localhost 2460
2009-01-13 11:03:22 0 12853 DBSTATE Caught signal 11(SIGSEGV)
It looks like the segmentation violation occured directly after the connection had been opened.
Can you confirm that the comseg.dump file has the same timestamp?
Do you know what the first statements of the application after the connect were?
> The company I am working for is a SAP customer.
Well, that's always a good thing
If the database we're talking about is the database for a SAP system, you really should open a support message.
If it is "just" the database for a Non-SAP-System, then it doesn't matter if your employer is a SAP customer (except they paid extra support for the Non-SAP-MaxDB-instance).
Anyhow, the most interesting thing was not done yet: debugging the core file (via gdb) to get the call stack of the task that ran into the segmentation violation.
Based on the "SUPPRESS_CORE=NO" setting there should have been a core dump written out.
Maybe the file was already copied to the DIAGHISTORY subfolder...!?
Unfortunately we don't know which thread crashed here, so there may be quite a number of threads that need to be checked...
regards,
Lars
Hello,
The posted comseg.dump file has the same timestamp as the second crash. I also have another comseq.dump file for the first crash.
I am the author of the application that uses the MaxDB database. It's no problem for me to check all of my queries, but I haven't found a problem yet. First executed queries are for user authentication and user object creation.
The database is used by a Non-SAP-System.
I set "SUPPRESS_CORE" to "NO" after the suggestion from Natalia. When the crashes occured its value was "YES".
Bye
Claus
> The posted comseg.dump file has the same timestamp as the second crash.
Ok, so that is at least something we know...
> I am the author of the application that uses the MaxDB database. It's no problem for me to check all of my queries, but I haven't found a problem yet. First executed queries are for user authentication and user object creation.
Hmm... of course there should not be any possibility for user statements to cause a segmentation violation of the database server, therefore it's not likely that you can see the problem right away.
Anyhow, I propose to setup a tracing for those first statements (including information from the sessions view - select * from sessions where own='YES' to make it possible to identify the usertask later on.).
> The database is used by a Non-SAP-System.
Bummer! Now we've to stick to the forum for further investigation.
Maybe you can provide some more details about your application.
What client do you use? JDBC, SQLDBC, Precompiler or ODBC?
> I set "SUPPRESS_CORE" to "NO" after the suggestion from Natalia. When the crashes occured its value was "YES".
Ok, so we've to wait for the next dump...
regards,
Lars
Hello,
My application is written in PHP 5 (currently installed is version 5.2.6) and I am connection to the database through ODBC (sapdb library). I never had such database crashes before.
I checked my source code the last couple of days and tried to reproduce the crash, but I had no luck yet.
Bye
Claus
Hello Claus,
"RTE Version 'X32/LINUX 7.6.05 Build 009-121-191-997'"
-> Do you have the 32bit server?
"My application is written in PHP 5 (currently installed is version 5.2.6)
and I am connection to the database through ODBC (sapdb library).
I never had such database crashes before."
-> Do you know what applications where running during the database crash?
Please update with output of the command 'sdbregview -l' to see the
version of ODBC database package installed.
-> You posted some of the "comseg.dump" lines from "DIAGHISTORY" subdirectory.
Could you please check the rtedump concerning Task T097 & post all info on this task from rtedump.
"ROLLBACK WORK RELEASE..........." for this task. Do you know what SQL query was running?
-> There are current database parameters settings:
MAX_HASHTABLE_MEMORY 5120
HASHED_RESULTSET YES
SHAREDSQL YES
SHAREDSQL_COMMANDCACHESIZE 262144
OMS_HEAP_COUNT 2
CACHE_SIZE 150000
CHECK_TASK_SPECIFIC_CATALOGCACHE NO
MAXTASKSTACK 1024
Correct?
Questions:
Did you see that the system heap grow up during the application run?
< You could use the DB analyzer to check high memory consumption. >
Are you using joins in the SQL statements?
< Please see SAP Note No. 814704, there are some restrictions for the database parameter HASHED_RESULTSET. >
Are you using join select within clustered tables?
Thank you and best regards, Natalia Khlopina
Hello,
-> Do you have the 32bit server?
Yes, all software on the server is 32bit.
-> Do you know what applications where running during the database crash?
Except from standard OS software, only MaxDB and an Apache webserver are running.
-> Please update with output of the command 'sdbregview -l'
Here is the output:
DB Analyzer /opt/sdb/programs 7.6.05.09 32 bit valid
Server Utilities /opt/sdb/programs 7.6.05.09 32 bit valid
Synchronization Manager /opt/sdb/programs 7.6.03.07 valid
Redist Python /opt/sdb/programs 7.6.05.09 32 bit valid
Base /opt/sdb/programs 7.6.05.09 32 bit valid
JDBC /opt/sdb/programs 7.6.05.06 valid
Messages /opt/sdb/programs MSG 0.6906 valid
ODBC /opt/sdb/programs 7.6.05.09 32 bit valid
Database Kernel /opt/sdb/7603 7.6.05.09 32 bit valid
Loader /opt/sdb/programs 7.6.05.09 32 bit valid
SQLDBC /opt/sdb/programs 7.6.05.09 32 bit valid
-> Could you please check the rtedump concerning Task T097 & post all info on this task from rtedump.
These are all lines with T97 infos:
-
T97 USER ( pid = 2460 ) -
remote_node : localhost remote_pid : 2460
dispatcher_cnt: 179 command_cnt : 178
exclusive_cnt : 539859 self_susp_cnt : 0
Resume count 0 total 2403 History [ T2 T55 T55 ]
state_vwait : 0 state_vsleep : 0 state_vsusp : 0
rcv_rpl_count : 178 rcv_rpl_long : 0 avg_rcv_rpl_t : 0.0000
-
Inx Region Get-Counts Collision-Counts
Total / Task / percent Total / Task / percent
3 CONV1 1780 / 11 / 0.62 % 0 / 0 / 0.00 %
4 CONV2 1623 / 10 / 0.62 % 0 / 0 / 0.00 %
5 CONV3 1765 / 9 / 0.51 % 0 / 0 / 0.00 %
6 CONV4 1720 / 9 / 0.52 % 0 / 0 / 0.00 %
7 CONV5 1869 / 9 / 0.48 % 0 / 0 / 0.00 %
8 CONV6 2002 / 5 / 0.25 % 0 / 0 / 0.00 %
9 CONV7 2289 / 7 / 0.31 % 0 / 0 / 0.00 %
10 CONV8 2125 / 7 / 0.33 % 0 / 0 / 0.00 %
11 CONV9 1427 / 11 / 0.77 % 0 / 0 / 0.00 %
12 CONV10 1461 / 11 / 0.75 % 0 / 0 / 0.00 %
13 CONV11 1748 / 11 / 0.63 % 0 / 0 / 0.00 %
14 CONV12 1610 / 14 / 0.87 % 0 / 0 / 0.00 %
15 CONV13 2132 / 14 / 0.66 % 0 / 0 / 0.00 %
16 CONV14 1578 / 16 / 1.01 % 0 / 0 / 0.00 %
17 CONV15 1946 / 14 / 0.72 % 0 / 0 / 0.00 %
18 CONV16 1746 / 13 / 0.74 % 0 / 0 / 0.00 %
19 CONV17 5523 / 17 / 0.31 % 0 / 0 / 0.00 %
20 CONV18 5464 / 14 / 0.26 % 0 / 0 / 0.00 %
21 CONV19 4992 / 16 / 0.32 % 0 / 0 / 0.00 %
22 CONV20 4720 / 16 / 0.34 % 0 / 0 / 0.00 %
23 CONV21 4727 / 13 / 0.28 % 0 / 0 / 0.00 %
24 CONV22 4832 / 13 / 0.27 % 0 / 0 / 0.00 %
25 CONV23 4656 / 12 / 0.26 % 0 / 0 / 0.00 %
26 CONV24 4732 / 10 / 0.21 % 0 / 0 / 0.00 %
27 CONV25 2137 / 7 / 0.33 % 0 / 0 / 0.00 %
28 CONV26 1888 / 6 / 0.32 % 0 / 0 / 0.00 %
29 CONV27 2080 / 8 / 0.38 % 0 / 0 / 0.00 %
30 CONV28 2722 / 8 / 0.29 % 0 / 0 / 0.00 %
31 CONV29 2225 / 9 / 0.40 % 0 / 0 / 0.00 %
32 CONV30 2316 / 9 / 0.39 % 0 / 0 / 0.00 %
33 CONV31 2086 / 10 / 0.48 % 0 / 0 / 0.00 %
34 CONV32 2221 / 14 / 0.63 % 0 / 0 / 0.00 %
35 CONV33 6434 / 14 / 0.22 % 0 / 0 / 0.00 %
36 CONV34 6257 / 16 / 0.26 % 0 / 0 / 0.00 %
37 CONV35 5866 / 22 / 0.38 % 0 / 0 / 0.00 %
38 CONV36 5797 / 16 / 0.28 % 0 / 0 / 0.00 %
39 CONV37 5652 / 15 / 0.27 % 0 / 0 / 0.00 %
40 CONV38 5684 / 18 / 0.32 % 0 / 0 / 0.00 %
41 CONV39 6112 / 21 / 0.34 % 0 / 0 / 0.00 %
42 CONV40 5201 / 14 / 0.27 % 0 / 0 / 0.00 %
43 CONV41 3079 / 12 / 0.39 % 0 / 0 / 0.00 %
44 CONV42 3672 / 13 / 0.35 % 0 / 0 / 0.00 %
45 CONV43 3880 / 17 / 0.44 % 0 / 0 / 0.00 %
46 CONV44 3783 / 10 / 0.26 % 0 / 0 / 0.00 %
47 CONV45 3780 / 12 / 0.32 % 0 / 0 / 0.00 %
48 CONV46 3928 / 10 / 0.25 % 0 / 0 / 0.00 %
49 CONV47 3325 / 10 / 0.30 % 0 / 0 / 0.00 %
50 CONV48 4359 / 12 / 0.28 % 0 / 0 / 0.00 %
53 DIAGCACH 8150 / 208 / 2.55 % 0 / 0 / 0.00 %
56 LOCKINIT 2092506 / 47831 / 2.29 % 0 / 0 / 0.00 %
57 LOCKPOOL 22509 / 34 / 0.15 % 0 / 0 / 0.00 %
61 LOGQUE1 2366 / 70 / 2.96 % 1213 / 0 / 0.00 %
66 SERVER 47905 / 197 / 0.41 % 1 / 0 / 0.00 %
67 SRVTASK 28852 / 197 / 0.68 % 8045 / 0 / 0.00 %
68 SURROGAT 23599 / 86 / 0.36 % 0 / 0 / 0.00 %
75 RANDMGEN 3886 / 102 / 2.62 % 0 / 0 / 0.00 %
86 DATA1 272327 / 4692 / 1.72 % 5027 / 0 / 0.00 %
87 DATA2 62608 / 899 / 1.44 % 3616 / 0 / 0.00 %
88 DATA3 143046 / 3842 / 2.69 % 7625 / 0 / 0.00 %
89 DATA4 81378 / 2037 / 2.50 % 7629 / 0 / 0.00 %
90 DATA5 155192 / 2420 / 1.56 % 5427 / 0 / 0.00 %
91 DATA6 116221 / 1992 / 1.71 % 4825 / 0 / 0.00 %
92 DATA7 99933 / 1850 / 1.85 % 5423 / 0 / 0.00 %
93 DATA8 68148 / 1253 / 1.84 % 5422 / 0 / 0.00 %
94 DATA9 662958 / 10648 / 1.61 % 7716 / 0 / 0.00 %
95 DATA10 61956 / 848 / 1.37 % 4519 / 0 / 0.00 %
96 DATA11 44018 / 597 / 1.36 % 4830 / 0 / 0.00 %
97 DATA12 184427 / 3626 / 1.97 % 6020 / 0 / 0.00 %
98 DATA13 55285 / 918 / 1.66 % 6426 / 0 / 0.00 %
99 DATA14 67000 / 1187 / 1.77 % 5122 / 0 / 0.00 %
100 DATA15 99934 / 2071 / 2.07 % 6628 / 0 / 0.00 %
101 DATA16 76041 / 1467 / 1.93 % 4223 / 0 / 0.00 %
102 DATA17 339025 / 3381 / 1.00 % 4912 / 0 / 0.00 %
103 DATA18 85941 / 1357 / 1.58 % 6318 / 0 / 0.00 %
104 DATA19 65898 / 1217 / 1.85 % 4224 / 0 / 0.00 %
105 DATA20 74123 / 1275 / 1.72 % 5714 / 0 / 0.00 %
106 DATA21 714412 / 15681 / 2.19 % 5923 / 0 / 0.00 %
107 DATA22 78895 / 1404 / 1.78 % 5637 / 0 / 0.00 %
108 DATA23 49106 / 1021 / 2.08 % 6728 / 0 / 0.00 %
109 DATA24 80526 / 1030 / 1.28 % 7124 / 0 / 0.00 %
110 DATA25 416603 / 2589 / 0.62 % 3623 / 0 / 0.00 %
111 DATA26 78093 / 1087 / 1.39 % 4922 / 0 / 0.00 %
112 DATA27 423110 / 11916 / 2.82 % 7521 / 0 / 0.00 %
113 DATA28 1261798 / 23844 / 1.89 % 5819 / 0 / 0.00 %
114 DATA29 97660 / 1183 / 1.21 % 4516 / 0 / 0.00 %
115 DATA30 62183 / 1333 / 2.14 % 5716 / 0 / 0.00 %
116 DATA31 74930 / 1189 / 1.59 % 3814 / 0 / 0.00 %
117 DATA32 137588 / 1756 / 1.28 % 2814 / 0 / 0.00 %
118 DATA33 421146 / 27101 / 6.44 % 7723 / 0 / 0.00 %
119 DATA34 65262 / 899 / 1.38 % 7723 / 0 / 0.00 %
120 DATA35 52449 / 761 / 1.45 % 9575 / 0 / 0.00 %
121 DATA36 52982 / 881 / 1.66 % 6425 / 0 / 0.00 %
122 DATA37 96596 / 1380 / 1.43 % 3915 / 0 / 0.00 %
123 DATA38 67893 / 1071 / 1.58 % 3419 / 0 / 0.00 %
124 DATA39 1433041 / 27690 / 1.93 % 3720 / 0 / 0.00 %
125 DATA40 100955 / 1453 / 1.44 % 5318 / 0 / 0.00 %
126 DATA41 352178 / 2321 / 0.66 % 7119 / 0 / 0.00 %
127 DATA42 76802 / 882 / 1.15 % 5028 / 0 / 0.00 %
128 DATA43 47429 / 8219 / 17.33 % 5625 / 0 / 0.00 %
129 DATA44 62154 / 951 / 1.53 % 7720 / 0 / 0.00 %
130 DATA45 76398 / 849 / 1.11 % 5429 / 0 / 0.00 %
131 DATA46 94363 / 2048 / 2.17 % 4820 / 0 / 0.00 %
132 DATA47 50856 / 1334 / 2.62 % 4813 / 0 / 0.00 %
133 DATA48 78895 / 1481 / 1.88 % 3027 / 0 / 0.00 %
134 TRANS1 1243826 / 1647 / 0.13 % 0 / 0 / 0.00 %
135 TRANS2 877845 / 51366 / 5.85 % 0 / 0 / 0.00 %
136 TRANS3 1188490 / 728 / 0.06 % 0 / 0 / 0.00 %
137 TRANS4 990013 / 84371 / 8.52 % 0 / 0 / 0.00 %
138 TRANS5 933725 / 2343 / 0.25 % 0 / 0 / 0.00 %
139 TRANS6 1221502 / 40227 / 3.29 % 0 / 0 / 0.00 %
140 TRANS7 897280 / 2063 / 0.23 % 0 / 0 / 0.00 %
141 TRANS8 1132537 / 8990 / 0.79 % 0 / 0 / 0.00 %
142 TAB9 983874 / 19662 / 2.00 % 0 / 0 / 0.00 %
143 TAB10 46706 / 471 / 1.01 % 0 / 0 / 0.00 %
144 TAB11 31946 / 356 / 1.11 % 0 / 0 / 0.00 %
145 TAB12 20488 / 44 / 0.21 % 0 / 0 / 0.00 %
146 TAB13 21314 / 73 / 0.34 % 0 / 0 / 0.00 %
147 TAB14 57646 / 1013 / 1.76 % 0 / 0 / 0.00 %
148 TAB15 20054 / 48 / 0.24 % 0 / 0 / 0.00 %
149 TAB16 30230 / 375 / 1.24 % 0 / 0 / 0.00 %
150 ROW17 155679 / 2771 / 1.78 % 0 / 0 / 0.00 %
151 ROW18 137365 / 2642 / 1.92 % 0 / 0 / 0.00 %
152 ROW19 162665 / 3108 / 1.91 % 0 / 0 / 0.00 %
153 ROW20 153850 / 2715 / 1.76 % 0 / 0 / 0.00 %
154 ROW21 150363 / 2708 / 1.80 % 0 / 0 / 0.00 %
155 ROW22 143018 / 2720 / 1.90 % 0 / 0 / 0.00 %
156 ROW23 138006 / 2448 / 1.77 % 0 / 0 / 0.00 %
157 ROW24 154265 / 2764 / 1.79 % 0 / 0 / 0.00 %
Total counter statistics:
=========================
total_disp_calls : 510484 total_commands : 130530
total_state_vwait : 0 total_state_vsuspend: 36690
total_state_vsleep : 17486
total_user_read : 988 total_user_write : 0
total_self_io : 1352 total_dev_io : 124933
total_reg_access : 22756709 begexcl_tas_coll. : 18
total_reg_collision : 280962 endexcl_tas_coll. : 6
total_reg_wait : 2798 total_self_susp_cnt : 16
total_symbol_resolution_locks: 1
-
Task U2U UKT COM
-
....
T97 0 2 178
....
Task T97
task type / state USER / Inactive
stack start - end @0x63dbf000 - @0x63e3f000
stack size 524288 (0x00080000)
guard area start - end @0x00000000 - @0x00000000
last / max dispatch stack pointer @0x63e3edcc / @0x63e14bcc
current / all command max stack usage 112436 / 112436
-> Do you know what SQL query was running?
I am not sure, yet. But I am trying to find out.
-> There are current database parameters settings:
... <see post above> ...
Yes, these are the current database settings.
-> Are you using joins in the SQL statements?
Yes, I am using JOINS.
-> Please see SAP Note No. 814704, there are some restrictions for the database parameter HASHED_RESULTSET.
Do I need a login for the SAP Service Marketplace to access the note or is there another way to read it ?
-> Are you using join select within clustered tables?
I am not 100% sure what you mean with "clustered tables".
-> Did you see that the system heap grow up during the application run? You could use the DB analyzer to check high memory consumption.
I have enabled the Database Analyzer and I will check the values ....
Bye
Claus
Hello Claus,
Thank you for additional information.
1)"Do I need a login for the SAP Service Marketplace to access the note or is there another way to read it ?"
-> Yes.
"Do you know what SQL query was running? - I am not sure, yet. But I am trying to find out."
-> Please post it, if you will find
2) Please see the SAP note Note 1040431 - FAQ: MaxDB BW Feature Pack
& http://maxdb.sap.com/doc/7_7/default.htm < Maxdb Library > -> Glossary -> Cluster
3) Was database crashed with core dump?
Regards, Natalia Khlopina
Please post a few lines more before the SIGSEGV... the actual error is not visible (just the consequence of it - the crash).
Markus
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
User | Count |
---|---|
86 | |
10 | |
10 | |
9 | |
6 | |
6 | |
6 | |
5 | |
4 | |
3 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.