cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Poor restore performance with MaxDB 7.6.04.15 and HP Data Protector 6

Go to solution
Former Member

on ‎09-16-2008 3:36 PM

0 Kudos

We encounter severe problems with the MaxDB integration in Data Protector 6. While the backup is finished in two hours (LTO4), the restore takes 9-12 hours.

The source system has the following specs:

CPU: 4x QuadCore

RAM: 48 GB

Cache Size: 25 GB

db size (allocated): 550 GB

27x 30 GB raw devices, located in SAN

SLES 10 SP2

parallelism (# pipes): 14 (tried 4, 8, 28, 2 tapes...)

Target system:

CPU: 2x DualCore

RAM: 8 GB

Cache Size: 4 GB

27x 30 GB raw devices, located in SAN

SLES 10 SP2

We checked the performance of file system restores - works fine with good restore times, so we don't think it's a SAN/tape library issue (e. g. switches etc.).

Some things are quite disturbing:

x_cons <SID> show sus

SERVERDB: <SID>

List of suspend-reasons:
========================

Total Suspends: 428083

Vsuspend (203) :  426288 (  99.58% ) kb39read_wait
Vsuspend (204) :    1611 (   0.38% ) kb39write_wait
JobWait BckRec :       1 (   0.00% ) SrvTasks_BackupServer::WaitForAnyJobFini
No-Work  (255) :     183 (   0.04% ) Task is waiting for work

x_cons <SID> show tasks|grep BUP
T71    6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
T72    6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
T73    6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
T74    6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
T75    6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
T76    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T77    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T78    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T79    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T80    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T81    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T82    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T83    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T84    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T85    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T86    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T87    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T88    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T89    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
T92    6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
T109   6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
T111   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T112   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T128   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T129   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T130   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T131   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T132   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T133   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T134   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T135   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T136   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T137   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T138   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T139   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T140   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T141   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T142   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T143   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T144   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
T148   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)

I tried changing parameters a bit with no visible effort. The current parameters of the target system are:

2008-09-16 15:54:01  6300     20235 RTE       ADMIN=1
2008-09-16 15:54:01  6300     20235 RTE       _AK_DUMP_ALLOWED=YES
2008-09-16 15:54:01  6300     20235 RTE       ALLOW_MULTIPLE_SERVERTASK_UKTS=YES
2008-09-16 15:54:01  6300     20235 RTE       AUTHENTICATION_ALLOW=
2008-09-16 15:54:01  6300     20235 RTE       AUTHENTICATION_DENY=
2008-09-16 15:54:01  6300     20235 RTE       AUTOSAVE=1
2008-09-16 15:54:01  6300     20235 RTE       AUTO_RECREATE_BAD_INDEXES=YES
2008-09-16 15:54:01  6300     20235 RTE       BACKUPRESULT=1
2008-09-16 15:54:01  6300     20235 RTE       BACKUP_BLOCK_CNT=64
2008-09-16 15:54:01  6300     20235 RTE       _BACKUP_HISTFILE=dbm.knl
2008-09-16 15:54:01  6300     20235 RTE       _BACKUP_MED_DEF=dbm.mdf
2008-09-16 15:54:01  6300     20235 RTE       CACHE_IN_SHARED_MEMORY=NO
2008-09-16 15:54:01  6300     20235 RTE       CACHE_SIZE=512000
2008-09-16 15:54:01  6300     20235 RTE       CALLSTACKLEVEL=0
2008-09-16 15:54:01  6300     20235 RTE       _CAT_CACHE_MINSIZE=262144
2008-09-16 15:54:01  6300     20235 RTE       CAT_CACHE_SUPPLY=12864
2008-09-16 15:54:01  6300     20235 RTE       CHECKDATA=1
2008-09-16 15:54:01  6300     20235 RTE       CHECK_BACKUP=NO
2008-09-16 15:54:01  6300     20235 RTE       CHECK_COMMON=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_CONVERTER=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_DATACACHE=NO
2008-09-16 15:54:01  6300     20235 RTE       CHECK_DATAINDEX=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_DATAPAGELOG=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_FBM=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_HASHED_RESULTSET=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_IOMAN=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_KB_REGIONS=NO
2008-09-16 15:54:01  6300     20235 RTE       CHECK_LOCK_SUPPLY=NO
2008-09-16 15:54:01  6300     20235 RTE       CHECK_LOCK=NO
2008-09-16 15:54:01  6300     20235 RTE       CHECK_LOGHISTORY=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_LOGPAGE=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_LOGTRANS=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_LOGVOLUME=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_QUERYREWRITE=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_REGIONS=NO
2008-09-16 15:54:01  6300     20235 RTE       CHECK_SRVTASKS=0
2008-09-16 15:54:01  6300     20235 RTE       CHECK_TABLE_WIDTH=NO
2008-09-16 15:54:01  6300     20235 RTE       CHECK_TASK_SPECIFIC_CATALOGCACHE=NO
2008-09-16 15:54:01  6300     20235 RTE       CHECK_TRANSLIST=NO
2008-09-16 15:54:01  6300     20235 RTE       CHECK_TREE_LOCKS=NO
2008-09-16 15:54:01  6300     20235 RTE       CHECK_TREE=NO
2008-09-16 15:54:01  6300     20235 RTE       CLUSTERED_LOBS=NO
2008-09-16 15:54:01  6300     20235 RTE       CLUSTER_WRITE_THRESHOLD=80
2008-09-16 15:54:01  6300     20235 RTE       COLUMNCOMPRESSION=YES
2008-09-16 15:54:01  6300     20235 RTE       _COMMENT=
2008-09-16 15:54:01  6300     20235 RTE       CONTROLPASSWORD=***
2008-09-16 15:54:01  6300     20235 RTE       CONTROLUSERID=CONTROL
2008-09-16 15:54:01  6300     20235 RTE       CONVERTER_REGIONS=64
2008-09-16 15:54:01  6300     20235 RTE       DATABASEFULL=1
2008-09-16 15:54:01  6300     20235 RTE       _DATA_CACHE_RGNS=64
2008-09-16 15:54:01  6300     20235 RTE       DATA_IO_BLOCK_COUNT=64
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_GROUPS=1
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0001=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0002=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0003=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0004=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0005=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0006=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0007=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0008=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0009=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0010=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0011=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0012=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0013=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0014=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0015=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0016=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0017=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0018=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0019=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0020=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0021=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0022=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0023=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0024=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0025=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0026=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_MODE_0027=NORMAL
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0001=/dev/raw/raw1
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0002=/dev/raw/raw2
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0003=/dev/raw/raw3
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0004=/dev/raw/raw4
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0005=/dev/raw/raw5
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0006=/dev/raw/raw6
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0007=/dev/raw/raw7
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0008=/dev/raw/raw8
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0009=/dev/raw/raw9
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0010=/dev/raw/raw10
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0011=/dev/raw/raw11
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0012=/dev/raw/raw12
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0013=/dev/raw/raw13
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0014=/dev/raw/raw14
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0015=/dev/raw/raw15
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0016=/dev/raw/raw16
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0017=/dev/raw/raw17
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0018=/dev/raw/raw18
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0019=/dev/raw/raw19
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0020=/dev/raw/raw20
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0021=/dev/raw/raw21
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0022=/dev/raw/raw22
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0023=/dev/raw/raw23
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0024=/dev/raw/raw24
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0025=/dev/raw/raw25
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0026=/dev/raw/raw26
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_NAME_0027=/dev/raw/raw27
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0001=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0002=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0003=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0004=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0005=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0006=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0007=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0008=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0009=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0010=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0011=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0012=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0013=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0014=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0015=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0016=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0017=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0018=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0019=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0020=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0021=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0022=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0023=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0024=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0025=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0026=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_SIZE_0027=3932160
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0001=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0002=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0003=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0004=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0005=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0006=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0007=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0008=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0009=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0010=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0011=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0012=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0013=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0014=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0015=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0016=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0017=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0018=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0019=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0020=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0021=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0022=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0023=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0024=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0025=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0026=R
2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0027=R
2008-09-16 15:54:01  6300     20235 RTE       DATE_TIME_FORMAT=INTERNAL
2008-09-16 15:54:01  6300     20235 RTE       DBFILLINGABOVELIMIT=70L80M85M90H95H96H97H98H99H
2008-09-16 15:54:01  6300     20235 RTE       DBFILLINGBELOWLIMIT=70L80L85L90L95L
2008-09-16 15:54:01  6300     20235 RTE       DDLTRIGGER=YES
2008-09-16 15:54:01  6300     20235 RTE       DEADLOCK_DETECTION=4
2008-09-16 15:54:01  6300     20235 RTE       DEFAULT_CODE=ASCII
2008-09-16 15:54:01  6300     20235 RTE       _DELAY_COMMIT=NO
2008-09-16 15:54:01  6300     20235 RTE       _DELAY_LOGWRITER=0
2008-09-16 15:54:01  6300     20235 RTE       DIAG_HISTORY_NUM=2
2008-09-16 15:54:01  6300     20235 RTE       DIAG_HISTORY_PATH=/sapdb/data/wrk/PSR/DIAGHISTORY
2008-09-16 15:54:01  6300     20235 RTE       _DIAG_SEM=0
2008-09-16 15:54:01  6300     20235 RTE       _DW_IO_AREA_FLUSH=50
2008-09-16 15:54:01  6300     20235 RTE       _DW_IO_AREA_SIZE=50
2008-09-16 15:54:01  6300     20235 RTE       _DW_LRU_TAIL_FLUSH=25
2008-09-16 15:54:01  6300     20235 RTE       _DYN_TASK_STACK=NO
2008-09-16 15:54:01  6300     20235 RTE       ENABLE_CHECK_INSTANCE=YES
2008-09-16 15:54:01  6300     20235 RTE       ENABLE_SYSTEM_TRIGGERS=YES
2008-09-16 15:54:01  6300     20235 RTE       ERROR=3
2008-09-16 15:54:01  6300     20235 RTE       _EVENTFILE=knldiag.evt
2008-09-16 15:54:01  6300     20235 RTE       _EVENTSIZE=0
2008-09-16 15:54:01  6300     20235 RTE       EVENT=1
2008-09-16 15:54:01  6300     20235 RTE       EXPAND_COM_TRACE=NO
2008-09-16 15:54:01  6300     20235 RTE       EXTERNAL_DUMP_REQUEST=NO
2008-09-16 15:54:01  6300     20235 RTE       FBM_CLUSTER_MODE=MIXED
2008-09-16 15:54:01  6300     20235 RTE       _FBM_LOW_IO_RATE=10
2008-09-16 15:54:01  6300     20235 RTE       FBM_VOLUME_BALANCE=10
2008-09-16 15:54:01  6300     20235 RTE       FBM_VOLUME_COMPRESSION=50
2008-09-16 15:54:01  6300     20235 RTE       FILEDIR_SPINLOCKPOOL_SIZE=10
2008-09-16 15:54:01  6300     20235 RTE       FORBID_LOAD_BALANCING=YES
2008-09-16 15:54:01  6300     20235 RTE       FORMATTING_MODE=PARALLEL
2008-09-16 15:54:01  6300     20235 RTE       FORMAT_DATAVOLUME=YES
2008-09-16 15:54:01  6300     20235 RTE       HASHED_RESULTSET_CACHESIZE=262144
2008-09-16 15:54:01  6300     20235 RTE       HASHED_RESULTSET=YES
2008-09-16 15:54:01  6300     20235 RTE       HEAP_CHECK_LEVEL=0
2008-09-16 15:54:01  6300     20235 RTE       HIRES_TIMER_TYPE=CPU
2008-09-16 15:54:01  6300     20235 RTE       HS_STORAGE_DLL=libhsscopy
2008-09-16 15:54:01  6300     20235 RTE       HS_SYNC_INTERVAL=50
2008-09-16 15:54:01  6300     20235 RTE       _IDXFILE_LIST_SIZE=2048
2008-09-16 15:54:01  6300     20235 RTE       INDEX_LEAF_CACHING=2
2008-09-16 15:54:01  6300     20235 RTE       INIT_ALLOCATORSIZE=262144
2008-09-16 15:54:01  6300     20235 RTE       INSTANCE_TYPE=OLTP
2008-09-16 15:54:01  6300     20235 RTE       _IOPROCS_FOR_PRIO=0
2008-09-16 15:54:01  6300     20235 RTE       _IOPROCS_FOR_READER=1
2008-09-16 15:54:01  6300     20235 RTE       _IOPROCS_PER_DEV=2
2008-09-16 15:54:01  6300     20235 RTE       _IOPROCS_SWITCH=2
2008-09-16 15:54:01  6300     20235 RTE       JOIN_MAXTAB_LEVEL4=64
2008-09-16 15:54:01  6300     20235 RTE       JOIN_MAXTAB_LEVEL9=5
2008-09-16 15:54:01  6300     20235 RTE       JOIN_SEARCH_LEVEL=0
2008-09-16 15:54:01  6300     20235 RTE       JOIN_TABLEBUFFER=128
2008-09-16 15:54:01  6300     20235 RTE       _KERNELDIAGFILE=knldiag
2008-09-16 15:54:01  6300     20235 RTE       KERNELDIAGSIZE=800
2008-09-16 15:54:01  6300     20235 RTE       _KERNELDUMPFILE=knldump
2008-09-16 15:54:01  6300     20235 RTE       _KERNELTRACEFILE=knltrace
2008-09-16 15:54:01  6300     20235 RTE       KERNELTRACESIZE=2809
2008-09-16 15:54:01  6300     20235 RTE       KERNELVERSION=KERNEL    7.6.04   BUILD 015-123-189-221
2008-09-16 15:54:01  6300     20235 RTE       _LM_LOCK_REGIONS=0
2008-09-16 15:54:01  6300     20235 RTE       _LM_REQUEST_REGIONS=0
2008-09-16 15:54:01  6300     20235 RTE       _LM_TRANS_REGIONS=0
2008-09-16 15:54:01  6300     20235 RTE       LOAD_BALANCING_CHK=0
2008-09-16 15:54:01  6300     20235 RTE       LOAD_BALANCING_DIF=10
2008-09-16 15:54:01  6300     20235 RTE       LOAD_BALANCING_EQ=5
2008-09-16 15:54:01  6300     20235 RTE       LOCAL_REDO_LOG_BUFFER_SIZE=0
2008-09-16 15:54:01  6300     20235 RTE       _LOCKMANAGER_ENABLED=NO
2008-09-16 15:54:01  6300     20235 RTE       _LOCK_SUPPLY_BLOCK=100
2008-09-16 15:54:01  6300     20235 RTE       LOGABOVELIMIT=50L75L90M95M96H97H98H99H
2008-09-16 15:54:01  6300     20235 RTE       LOGFULL=1
2008-09-16 15:54:01  6300     20235 RTE       LOGSEGMENTFULL=1
2008-09-16 15:54:01  6300     20235 RTE       LOG_BACKUP_TO_PIPE=NO
2008-09-16 15:54:01  6300     20235 RTE       LOG_IO_BLOCK_COUNT=8
2008-09-16 15:54:01  6300     20235 RTE       LOG_IO_QUEUE=200
2008-09-16 15:54:01  6300     20235 RTE       LOG_MIRRORED=NO
2008-09-16 15:54:01  6300     20235 RTE       LOG_QUEUE_COUNT=1
2008-09-16 15:54:01  6300     20235 RTE       LOG_SEGMENT_SIZE=129024
2008-09-16 15:54:01  6300     20235 RTE       LOG_VOLUME_NAME_001=/dev/raw/raw28
2008-09-16 15:54:01  6300     20235 RTE       LOG_VOLUME_NAME_002=/dev/raw/raw29
2008-09-16 15:54:01  6300     20235 RTE       LOG_VOLUME_SIZE_001=524288
2008-09-16 15:54:01  6300     20235 RTE       LOG_VOLUME_SIZE_002=524288
2008-09-16 15:54:01  6300     20235 RTE       LOG_VOLUME_TYPE_001=R
2008-09-16 15:54:01  6300     20235 RTE       LOG_VOLUME_TYPE_002=R
2008-09-16 15:54:01  6300     20235 RTE       LRU_FOR_SCAN=NO
2008-09-16 15:54:01  6300     20235 RTE       MAXBACKUPDEVS=32
2008-09-16 15:54:01  6300     20235 RTE       MAXCPU=3
2008-09-16 15:54:01  6300     20235 RTE       MAXDATAVOLUMES=40
2008-09-16 15:54:01  6300     20235 RTE       _MAXEVENTS=100
2008-09-16 15:54:01  6300     20235 RTE       _MAXEVENTTASKS=2
2008-09-16 15:54:01  6300     20235 RTE       _MAXGARBAGE_COLL=1
2008-09-16 15:54:01  6300     20235 RTE       MAXLOCKS=1000000
2008-09-16 15:54:01  6300     20235 RTE       MAXLOGVOLUMES=4
2008-09-16 15:54:01  6300     20235 RTE       MAXPAGER=64
2008-09-16 15:54:01  6300     20235 RTE       MAXRGN_REQUEST=-1
2008-09-16 15:54:01  6300     20235 RTE       MAXSERVERTASKS=116
2008-09-16 15:54:01  6300     20235 RTE       _MAXTASK_STACK=512
2008-09-16 15:54:01  6300     20235 RTE       _MAXTRANS=1604
2008-09-16 15:54:01  6300     20235 RTE       MAXUSERTASKS=200
2008-09-16 15:54:01  6300     20235 RTE       MAXVOLUMES=45
2008-09-16 15:54:01  6300     20235 RTE       MAX_HASHTABLE_MEMORY=5120
2008-09-16 15:54:01  6300     20235 RTE       MAX_LOG_QUEUE_COUNT=0
2008-09-16 15:54:01  6300     20235 RTE       _MAX_MESSAGE_FILES=0
2008-09-16 15:54:01  6300     20235 RTE       MAX_MESSAGE_LIST_LENGTH=100
2008-09-16 15:54:01  6300     20235 RTE       MAX_RETENTION_TIME=480
2008-09-16 15:54:01  6300     20235 RTE       MAX_SERVERTASK_STACK=500
2008-09-16 15:54:01  6300     20235 RTE       MAX_SINGLE_HASHTABLE_SIZE=512
2008-09-16 15:54:01  6300     20235 RTE       MAX_SPECIALTASK_STACK=500
2008-09-16 15:54:01  6300     20235 RTE       _MBLOCK_DATA_SIZE=32768
2008-09-16 15:54:01  6300     20235 RTE       _MBLOCK_QUAL_SIZE=32768
2008-09-16 15:54:01  6300     20235 RTE       _MBLOCK_STACK_SIZE=32768
2008-09-16 15:54:01  6300     20235 RTE       _MBLOCK_STRAT_SIZE=16384
2008-09-16 15:54:01  6300     20235 RTE       MCOD=NO
2008-09-16 15:54:01  6300     20235 RTE       MEMORY_ALLOCATION_LIMIT=0
2008-09-16 15:54:01  6300     20235 RTE       _MINREPLY_SIZE=4096
2008-09-16 15:54:01  6300     20235 RTE       MINSERVERTASKS=116
2008-09-16 15:54:01  6300     20235 RTE       MIN_RETENTION_TIME=60
2008-09-16 15:54:01  6300     20235 RTE       MONITOR_READ=2147483647
2008-09-16 15:54:01  6300     20235 RTE       MONITOR_ROWNO=0
2008-09-16 15:54:01  6300     20235 RTE       MONITOR_SELECTIVITY=0
2008-09-16 15:54:01  6300     20235 RTE       MONITOR_TIME=2147483647
2008-09-16 15:54:01  6300     20235 RTE       _MP_DISP_LOOPS=2
2008-09-16 15:54:01  6300     20235 RTE       _MP_DISP_PRIO=DEFAULT
2008-09-16 15:54:01  6300     20235 RTE       _MP_RGN_BUSY_WAIT=DEFAULT
2008-09-16 15:54:01  6300     20235 RTE       _MP_RGN_DIRTY_READ=DEFAULT
2008-09-16 15:54:01  6300     20235 RTE       MP_RGN_LOOP=-1
2008-09-16 15:54:01  6300     20235 RTE       _MP_RGN_PRIO=DEFAULT
2008-09-16 15:54:01  6300     20235 RTE       _MP_RGN_QUEUE=YES
2008-09-16 15:54:01  6300     20235 RTE       NO_SYNC_TO_DISK_WANTED=NO
2008-09-16 15:54:01  6300     20235 RTE       OFFICIAL_NODE=
2008-09-16 15:54:01  6300     20235 RTE       OMS_HEAP_BLOCKSIZE=10000
2008-09-16 15:54:01  6300     20235 RTE       OMS_HEAP_COUNT=8
2008-09-16 15:54:01  6300     20235 RTE       OMS_HEAP_LIMIT=0
2008-09-16 15:54:01  6300     20235 RTE       OMS_HEAP_THRESHOLD=100
2008-09-16 15:54:01  6300     20235 RTE       _OMS_REGIONS=0
2008-09-16 15:54:01  6300     20235 RTE       _OMS_RGNS=7
2008-09-16 15:54:01  6300     20235 RTE       OMS_RUN_IN_UDE_SERVER=NO
2008-09-16 15:54:01  6300     20235 RTE       OMS_STREAM_TIMEOUT=30
2008-09-16 15:54:01  6300     20235 RTE       OMS_VERS_THRESHOLD=2097152
2008-09-16 15:54:01  6300     20235 RTE       ONLINE=1
2008-09-16 15:54:01  6300     20235 RTE       OPMSG1=/dev/console
2008-09-16 15:54:01  6300     20235 RTE       OPMSG2=/dev/null
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_AGGREGATION=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_FETCH_REVERSE=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_FIRST_ROWS=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_JOIN_HASHTABLE=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_JOIN_HASH_MINIMAL_RATIO=1
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_JOIN_ONEPHASE=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_JOIN_OPERATOR_SORT=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_JOIN_OUTER=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_JOIN_PARALLEL_MINSIZE=1000000
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_JOIN_PARALLEL_SERVERS=0
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_MIN_MAX=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_OPERATOR_JOIN_COSTFUNC=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_OPERATOR_JOIN=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_QUAL_ON_INDEX=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_QUERYREWRITE=OPERATOR
2008-09-16 15:54:01  6300     20235 RTE       OPTIMIZE_STAR_JOIN=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIM_CACHE=NO
2008-09-16 15:54:01  6300     20235 RTE       OPTIM_INV_ONLY=YES
2008-09-16 15:54:01  6300     20235 RTE       OPTIM_JOIN_FETCH=0
2008-09-16 15:54:01  6300     20235 RTE       OPTIM_MAX_MERGE=500
2008-09-16 15:54:01  6300     20235 RTE       OUTOFSESSIONS=3
2008-09-16 15:54:01  6300     20235 RTE       _PACKET_SIZE=131072
2008-09-16 15:54:01  6300     20235 RTE       _PAGE_SIZE=8192
2008-09-16 15:54:01  6300     20235 RTE       PREALLOCATE_IOWORKER=NO
2008-09-16 15:54:01  6300     20235 RTE       _PRIO_BASE_COM=10
2008-09-16 15:54:01  6300     20235 RTE       _PRIO_BASE_IOC=80
2008-09-16 15:54:01  6300     20235 RTE       _PRIO_BASE_RAV=80
2008-09-16 15:54:01  6300     20235 RTE       _PRIO_BASE_REX=40
2008-09-16 15:54:01  6300     20235 RTE       _PRIO_BASE_U2U=100
2008-09-16 15:54:01  6300     20235 RTE       _PRIO_FACTOR=80
2008-09-16 15:54:01  6300     20235 RTE       PROTECT_DATACACHE_MEMORY=NO
2008-09-16 15:54:01  6300     20235 RTE       _READAHEAD_BLOBS=32
2008-09-16 15:54:01  6300     20235 RTE       REQUEST_TIMEOUT=5000
2008-09-16 15:54:01  6300     20235 RTE       RESERVEDSERVERTASKS=75
2008-09-16 15:54:01  6300     20235 RTE       _RESTART_TIME=600
2008-09-16 15:54:01  6300     20235 RTE       ROW_LOCKS_PER_TRANSACTION=50
2008-09-16 15:54:01  6300     20235 RTE       _ROW_RGNS=8
2008-09-16 15:54:01  6300     20235 RTE       _RTEDUMPFILE=rtedump
2008-09-16 15:54:01  6300     20235 RTE       RTE_TEST_REGIONS=0
2008-09-16 15:54:01  6300     20235 RTE       RUNDIRECTORY=/sapdb/data/wrk/PSR
2008-09-16 15:54:01  6300     20235 RTE       SEQUENCE_CACHE=1
2008-09-16 15:54:01  6300     20235 RTE       _SERVERDB_FOR_SAP=YES
2008-09-16 15:54:01  6300     20235 RTE       SESSION_TIMEOUT=900
2008-09-16 15:54:01  6300     20235 RTE       SET_VOLUME_LOCK=YES
2008-09-16 15:54:01  6300     20235 RTE       SHAREDSQL_CLEANUPTHRESHOLD=25
2008-09-16 15:54:01  6300     20235 RTE       SHAREDSQL_COMMANDCACHESIZE=262144
2008-09-16 15:54:01  6300     20235 RTE       SHAREDSQL=YES
2008-09-16 15:54:01  6300     20235 RTE       _SHMKERNEL=24377
2008-09-16 15:54:01  6300     20235 RTE       SHOW_MAX_KB_STACK_USE=NO
2008-09-16 15:54:01  6300     20235 RTE       SHOW_MAX_STACK_USE=NO
2008-09-16 15:54:01  6300     20235 RTE       SIMULATE_VECTORIO=NEVER
2008-09-16 15:54:01  6300     20235 RTE       SPINLOCK_BACKOFF_BASE=1
2008-09-16 15:54:01  6300     20235 RTE       SPINLOCK_BACKOFF_FACTOR=2
2008-09-16 15:54:01  6300     20235 RTE       SPINLOCK_BACKOFF_MAXIMUM=64
2008-09-16 15:54:01  6300     20235 RTE       SPINLOCK_LOOP_COUNT=30000
2008-09-16 15:54:01  6300     20235 RTE       STANDBY=1
2008-09-16 15:54:01  6300     20235 RTE       SUBTREE_LOCKS=NO
2008-09-16 15:54:01  6300     20235 RTE       SUPPRESS_CORE=YES
2008-09-16 15:54:01  6300     20235 RTE       SYMBOL_DEMANGLING=NO
2008-09-16 15:54:01  6300     20235 RTE       SYMBOL_RESOLUTION=YES
2008-09-16 15:54:01  6300     20235 RTE       SYSTEMERROR=3
2008-09-16 15:54:01  6300     20235 RTE       _TAB_RGNS=8
2008-09-16 15:54:01  6300     20235 RTE       _TASKCLUSTER_01=tw;al;ut;100*bup;10*ev,10*gc;
2008-09-16 15:54:01  6300     20235 RTE       _TASKCLUSTER_02=ti,100*dw;67*us,39*sv;
2008-09-16 15:54:01  6300     20235 RTE       _TASKCLUSTER_03=equalize
2008-09-16 15:54:01  6300     20235 RTE       TIME_MEASUREMENT=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_AK=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_ALLOCATOR=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_CATALOG=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_CLIENTKERNELCOM=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_COMMON=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_COMMUNICATION=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_CONVERTER=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_DATACACHE=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_DATACHAIN=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_DATAINDEX=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_DATAPAM=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_DATATREE=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_DBPROC=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_DEFAULT=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_DELETE=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_FBM=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_FILEDIR=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_FRAMECTRL=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_INDEX=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_INSERT=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_IOMAN=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_IPC=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_JOIN=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_KSQL=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_LOCKMANAGER=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_LOCK=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_LOGACTION=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_LOGHISTORY=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_LOGPAGE=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_LOGTRANS=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_LOGVOLUME=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_LONG=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_MEMORY=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_MESSAGES=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OBJECTCONTAINER=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OBJECT_ADD=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OBJECT_ALTER=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OBJECT_FREE=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OBJECT_GET=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OBJECT=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_CONTAINERDIR=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_CONTEXT=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_ERROR=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_FLUSHCACHE=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_INTERFACE=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_KEYRANGE=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_KEY=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_LOCK=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_MEMORY=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_NEWOBJ=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_SESSION=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_STREAM=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_VAROBJECT=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OMS_VERSION=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_OPTIMIZE=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_ORDER_STANDARD=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_ORDER=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_PAGER=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_PAGES_BUP=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_PAGES_EV=2
2008-09-16 15:54:01  6300     20235 RTE       TRACE_PAGES_GC=20
2008-09-16 15:54:01  6300     20235 RTE       TRACE_PAGES_LW=5
2008-09-16 15:54:01  6300     20235 RTE       TRACE_PAGES_PG=3
2008-09-16 15:54:01  6300     20235 RTE       TRACE_PAGES_SV=5
2008-09-16 15:54:01  6300     20235 RTE       TRACE_PAGES_TI=2
2008-09-16 15:54:01  6300     20235 RTE       TRACE_PAGES_US=10
2008-09-16 15:54:01  6300     20235 RTE       TRACE_PAGES_UT=5
2008-09-16 15:54:01  6300     20235 RTE       TRACE_PAGES=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_PRIMARY_TREE=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_QUERYREWRITE=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_RUNTIME=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_SELECT=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_SHAREDSQL=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_SQLMANAGER=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_SRVTASKS=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_STOP_ERRORCODE=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_SYNCHRONISATION=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_SYSVIEW=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_TABLE=0
2008-09-16 15:54:01  6300     20235 RTE       TRACE_TIME=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_UPDATE=NO
2008-09-16 15:54:01  6300     20235 RTE       TRACE_VOLUME=0
2008-09-16 15:54:01  6300     20235 RTE       TRANS_HISTORY_SIZE=0
2008-09-16 15:54:01  6300     20235 RTE       _TRANS_RGNS=8
2008-09-16 15:54:01  6300     20235 RTE       TRANS_THRESHOLD_VALUE=60
2008-09-16 15:54:01  6300     20235 RTE       UKT_CPU_RELATIONSHIP=NONE
2008-09-16 15:54:01  6300     20235 RTE       _UNICODE=YES
2008-09-16 15:54:01  6300     20235 RTE       UPDATESTAT_PARALLEL_SERVERS=0
2008-09-16 15:54:01  6300     20235 RTE       UPDATESTAT_SAMPLE_ALGO=1
2008-09-16 15:54:01  6300     20235 RTE       UPDSTATWANTED=1
2008-09-16 15:54:01  6300     20235 RTE       USED_MAX_LOG_QUEUE_COUNT=3
2008-09-16 15:54:01  6300     20235 RTE       USESELECTFETCH=YES
2008-09-16 15:54:01  6300     20235 RTE       USEUNICODECOLUMNCOMPRESSION=NO
2008-09-16 15:54:01  6300     20235 RTE       USEVARIABLEINPUT=NO
2008-09-16 15:54:01  6300     20235 RTE       USE_COROUTINES=YES
2008-09-16 15:54:01  6300     20235 RTE       _USE_IOPROCS_ONLY=NO
2008-09-16 15:54:01  6300     20235 RTE       USE_OPEN_DIRECT_FOR_BACKUP=YES
2008-09-16 15:54:01  6300     20235 RTE       USE_OPEN_DIRECT=YES
2008-09-16 15:54:01  6300     20235 RTE       USE_SYSTEM_PAGE_CACHE=YES
2008-09-16 15:54:01  6300     20235 RTE       _UTILITY_PROTFILE=dbm.utl
2008-09-16 15:54:01  6300     20235 RTE       UTILITY_PROTSIZE=100
2008-09-16 15:54:01  6300     20235 RTE       VOLUMENO_BIT_COUNT=8
2008-09-16 15:54:01  6300     20235 RTE       _WORKDATA_SIZE=8192
2008-09-16 15:54:01  6300     20235 RTE       _WORKSTACK_SIZE=8192
2008-09-16 15:54:01  6300     20235 RTE       XP_CONVERTER_REGIONS=0
2008-09-16 15:54:01  6300     20235 RTE       XP_DATA_CACHE_RGNS=0
2008-09-16 15:54:01  6300     20235 RTE       XP_MAXPAGER=0

Show replies
Show replies
Answer

Accepted Solutions (1)

Accepted Solutions (1)

markus_doehr2
Active Contributor
‎09-16-2008 3:50 PM
0 Kudos

> We encounter severe problems with the MaxDB integration in Data Protector 6. While the backup is finished in two hours (LTO4), the restore takes 9-12 hours.

LTO4 drives are VERY fast. If the system or a component of it (e. g. network) is not able to transfer the data as quickly as necessary it will put the tape drive into start-stop-start mode - which will significantly slowdown the restore.

What kind of connection you use between the server and the client?

Markus

Show replies
Show replies
Former Member
‎09-16-2008 4:17 PM
0 Kudos

The tape library is connected via fibre channel. Since we normally have restore rates of at least 200 GB/s on the same target system, we don't think it's a typical hardware/network I/O issue. (E. g. we had an offline restore of 900 GB in less than 2 hours.)

Answers (1)

Answers (1)

lbreddemann
Active Contributor
‎09-16-2008 11:49 PM
0 Kudos

> Some things are quite disturbing:

>

> 

x_cons <SID> show sus
> 
> SERVERDB: <SID>
> 
> List of suspend-reasons:
> ========================
> 
> Total Suspends: 428083
> 
> Vsuspend (203) :  426288 (  99.58% ) kb39read_wait
> Vsuspend (204) :    1611 (   0.38% ) kb39write_wait
> JobWait BckRec :       1 (   0.00% ) SrvTasks_BackupServer::WaitForAnyJobFini
> No-Work  (255) :     183 (   0.04% ) Task is waiting for work

What exactly do you find disturbing with that information?

All we see here is how often a specific suspend had been triggered since the database was started. We don't see how long these suspends took and neither do we know what the suspend reason is, that would be important for your current issue.

> 

x_cons <SID> show tasks|grep BUP
> T71    6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
> T72    6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
> T73    6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
> T74    6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
> T75    6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
> T76    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T77    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T78    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T79    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T80    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T81    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T82    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T83    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T84    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T85    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T86    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T87    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T88    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T89    6     -1 BUPmed       -1 Vsuspend (203)        0 0               1027577(s)
> T92    6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
> T109   6     -1 BUPvol       -1 AsynWaitWrite         0 0               1027577(s)
> T111   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T112   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T128   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T129   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T130   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T131   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T132   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T133   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T134   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T135   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T136   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T137   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T138   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T139   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T140   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T141   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T142   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T143   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T144   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)
> T148   7     -1 BUPvol       -1 AsynWaitWrite         0 0               345248(s)

Ok, here we see that the MaxDB kernel is waiting for writes to the datavolumes to get finished. As we've only one snapshot here, we cannot tell anything more from it. You either should perform several snapshots in a row, or (better!) use the DBAnalyzer with a short sample interval, say 60 seconds.

Also you should enable the time measurement, so that we can have some I/O related timing information.

> I tried changing parameters a bit with no visible effort. The current parameters of the target system are:

What parameters did you change? Why? And to what values did you set them?

> 

> 2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0001=R
> 2008-09-16 15:54:01  6300     20235 RTE       DATA_VOLUME_TYPE_0002=R

Ok, since you use RAW devices (good choice!) there shouldn't be any issues with the I/O on the OS level.

What's left is: how are the RAW devices physically stored?

Could it be that writing to your RAW devices is pretty expensive?

Ah - before I forget: if you're a SAP customer this should be investigated in a support message!

Best regards,

Lars

Show replies
Show replies
Former Member
‎09-17-2008 9:40 AM
0 Kudos

The last changes I made were SIMULATE_VECTORIO = NEVER (was IF_OPEN_DIRECT_OR_RAW_DEVICE), ALLOW_MULTIPLE_SERVERTASK_UKTS = YES (since it's a shadow database, we don't need good user performance, only when we switch) and IOPROCSFOR_READER = 1.

Talking of DB analyzer: How can I switch on this feature when database is in admin mode? I get the error

ERROR 4: Cannot connect to database.
-4001 [SAP AG][LIBSQLOD SO][MaxDB] Unable to connect to data source;-4001 POS(1) Unknown user name/password combination in operational state ADMIN

I tried os user, superdba and control.

x_cons shows the same data all the time, high kb39read_wait rates and most BUP tasks with AsynWaitWrite.

The raw devices of the source system are stored on a XP10k (7 LUNs, striped, RAID5), the target system is stored on a EVA 4k (RAID5). Unfortunately we can't change to RAID0/1 right now.

Yes, we are SAP customers, I will open a message as soon as we analyzed some more details. Last restore took 6 hours, so "hope dies at last"!

Ask a Question