on 03-21-2010 8:18 AM
Dear SDN followers,
Here is the scenirio:
SAP :SAP NW EHP1 in win system
DB: ORACLE 10 in AIX
Distributed Hetrogenous system.
I had run SGEN in 000 client and after 58% completd job monitor, after that the SAP screen got hanged.Then I had stopped SAP instance and when I try to start SAP MMC it starts for 2 mnts and then DISP+work.exe stopped and SAP is not working.I am adding here DEVELOPER TRACE, file.could nt post dev_ms and dev_wo for maxium words limitation in SDN
-
trc file: "dev_disp", trc level: 1, release: "701"
-
sysno 00
sid BWD
systemid 562 (PC with Windows NT)
relno 7010
patchlevel 0
patchno 32
intno 20020600
make: multithreaded, Unicode, 64 bit, optimized
pid 356
Sat Mar 20 18:39:57 2010
kernel runs with dp version 241000(ext=110000) (@(#) DPLIB-INT-VERSION-241000-UC)
length of sys_adm_ext is 576 bytes
SWITCH TRC-HIDE on ***
***LOG Q00=> DpSapEnvInit, DPStart (00 356) [dpxxdisp.c 1286]
shared lib "dw_xml.dll" version 32 successfully loaded
shared lib "dw_xtc.dll" version 32 successfully loaded
shared lib "dw_stl.dll" version 32 successfully loaded
shared lib "dw_gui.dll" version 32 successfully loaded
shared lib "dw_mdm.dll" version 32 successfully loaded
rdisp/softcancel_sequence : -> 0,5,-1
use internal message server connection to port 3900
Sat Mar 20 18:40:03 2010
WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 5 seconds
***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 5529]
Sat Mar 20 18:40:04 2010
rdisp/queue_size_check_value : -> off
ThTaskStatus: rdisp/reset_online_during_debug 0
EmInit: MmSetImplementation( 2 ).
MM global diagnostic options set: 0
<ES> client 0 initializing ....
<ES> InitFreeList
<ES> block size is 4096 kByte.
<ES> Info: em/initial_size_MB( 12286MB) not multiple of em/blocksize_KB( 4096KB)
<ES> Info: em/initial_size_MB rounded up to 12288MB
Using implementation view
<EsNT> Using memory model view.
<EsNT> Memory Reset disabled as NT default
<ES> 3071 blocks reserved for free list.
ES initialized.
rdisp/http_min_wait_dia_wp : 1 -> 1
***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1681]
***LOG Q0K=> DpMsAttach, mscon ( SVHQBWD02) [dpxxdisp.c 12483]
DpStartStopMsg: send start message (myname is >SVHQBWD02_BWD_00 <)
DpStartStopMsg: start msg sent
CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.
Sat Mar 20 18:40:05 2010
CCMS: start to initalize 3.X shared alert area (first segment).
DpMsgAdmin: Set release to 7010, patchlevel 0
MBUF state PREPARED
MBUF component UP
DpMBufHwIdSet: set Hardware-ID
***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1048]
DpMsgAdmin: Set patchno for this platform to 32
Release check o.K.
Sat Mar 20 18:40:44 2010
my types changed after wp death/restart 0xbf --> 0xbe
my types changed after wp death/restart 0xbe --> 0xbc
my types changed after wp death/restart 0xbc --> 0xb8
my types changed after wp death/restart 0xb8 --> 0xb0
my types changed after wp death/restart 0xb0 --> 0xa0
my types changed after wp death/restart 0xa0 --> 0x80
DP_FATAL_ERROR => DpWPCheck: no more work processes
DISPATCHER EMERGENCY SHUTDOWN ***
increase tracelevel of WPs
NiWait: sleep (10000ms) ...
NiISelect: timeout 10000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:40:54 2010
NiISelect: TIMEOUT occured (10000ms)
dump system status
max_rq_id 12
wake_evt_udp_now 0
wake events total 8, udp 6 ( 75%), shm 2 ( 25%)
since last update total 8, udp 6 ( 75%), shm 2 ( 25%)
Dump of tm_adm structure: Sat Mar 20 15:40:54 2010
=========================
Term uid man user term lastop mod wp ta a/i (modes)
Workprocess Comm. Area Blocks Sat Mar 20 15:40:54 2010
=============================
Slots: 300, Used: 1, Max: 0
--------
+
id | owner | pid | eyecatcher |
--------
+
0 | DISPATCHER | -1 | WPCAAD000 |
NiWait: sleep (5000ms) ...
NiISelect: timeout 5000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:40:59 2010
NiISelect: TIMEOUT occured (5000ms)
DpHalt: shutdown server >SVHQBWD02_BWD_00 < (normal)
DpJ2eeDisableRestart
DpModState: buffer in state MBUF_PREPARED
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIModState: change state to SHUTDOWN
DpModState: change server state from STARTING to SHUTDOWN
Switch off Shared memory profiling
ShmProtect( 57, 3 )
ShmProtect(SHM_PROFILE, SHM_PROT_RW
ShmProtect( 57, 1 )
ShmProtect(SHM_PROFILE, SHM_PROT_RD
DpWakeUpWps: wake up all wp's
Stop work processes
Stop gateway
killing process (3508) (SOFT_KILL)
Stop icman
killing process (2884) (SOFT_KILL)
Terminate gui connections
wait for end of work processes
wait for end of gateway
[DpProcDied] Process lives (PID:3508 HANDLE:408)
waiting for termination of gateway ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:41:00 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died (PID:3508 HANDLE:408)
wait for end of icman
[DpProcDied] Process lives (PID:2884 HANDLE:572)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:41:01 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:2884 HANDLE:572)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:41:02 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:2884 HANDLE:572)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:41:03 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:2884 HANDLE:572)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:41:04 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:2884 HANDLE:572)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:41:05 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:2884 HANDLE:572)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:41:06 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:2884 HANDLE:572)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:41:07 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:2884 HANDLE:572)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:41:08 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:2884 HANDLE:572)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:41:09 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:2884 HANDLE:572)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:41:10 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:2884 HANDLE:572)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=897
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Sat Mar 20 18:41:11 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died (PID:2884 HANDLE:572)
DpStartStopMsg: send stop message (myname is >SVHQBWD02_BWD_00 <)
DpStartStopMsg: Write AD_STARTSTOP message with type= 0, name=SVHQBWD02_BWD_00 , sapsysnr= 0, hostname=SVHQBWD02
AdGetSelfIdentRecord: > <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0
DpConvertRequest: net size = 189 bytes
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=562,pac=1,MESG_IO)
MsINiWrite: sent 562 bytes
send msg (len 110+452) to name -, type 4, key -
DpStartStopMsg: stop msg sent
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 2 recv would block (errno=EAGAIN)
NiIRead: read for hdl 2 timed out (0ms)
DpHalt: no more messages from the message server
DpHalt: send keepalive to synchronize with the message server
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=114,pac=1,MESG_IO)
MsINiWrite: sent 114 bytes
send msg (len 110+4) to name MSG_SERVER, type 0, key -
MsSndName: MS_NOOP ok
Send 4 bytes to MSG_SERVER
NiIRead: hdl 2 recv would block (errno=EAGAIN)
NiIPeek: peek successful for hdl 2 (r)
NiIRead: hdl 2 received data (rcd=114,pac=1,MESG_IO)
NiBufIIn: NIBUF len=114
NiBufIIn: packet complete for hdl 2
NiBufReceive starting
MsINiRead: received 114 bytes
MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -
Received 4 bytes from MSG_SERVER
Received opcode MS_NOOP from msg_server, reply MSOP_OK
MsOpReceive: ok
MsSendKeepalive : keepalive sent to message server
NiIRead: hdl 2 recv would block (errno=EAGAIN)
Sat Mar 20 18:41:12 2010
NiIPeek: peek for hdl 2 timed out (r; 1000ms)
NiIRead: read for hdl 2 timed out (1000ms)
DpHalt: no more messages from the message server
DpHalt: sync with message server o.k.
detach from message server
***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 12829]
NiBufSend starting
NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIDetach: send logout to msg_server
MsIDetach: call exit function
DpMsShutdownHook called
NiBufISelUpdate: new MODE -- (r-) for hdl 2 in set0
SiSelNSet: set events of sock 424 to: ---
NiBufISelRemove: remove hdl 2 from set0
SiSelNRemove: removed sock 424 (pos=2)
SiSelNRemove: removed sock 424
NiSelIRemove: removed hdl 2
MBUF state OFF
AdGetSelfIdentRecord: > <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/17
LOCK WP ca_blk 1
make DISP owner of wp_ca_blk 1
DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 15)
MBUF component DOWN
NiICloseHandle: shutdown and close hdl 2 / sock 424
NiBufIClose: clear extension for hdl 2
MsIDetach: detach MS-system
cleanup EM
EsCleanup ....
EmCleanup() -> 0
Es2Cleanup: Cleanup ES2
***LOG Q05=> DpHalt, DPStop ( 356) [dpxxdisp.c 11045]
Good Bye .....
Database: Database error 257 at CON
Database: > ORA-00257: archiver error. Connect internal only, until free
______________________________________________________________________________________________
Please help.
Regards,
Manas
Solved with SDN reply.Thanks
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi,
Database: Database error 257 at CON
Database: > ORA-00257: archiver error.
Its pointing to Archive Stuck issue. Free some space in the directory of the offline redo logs.
Please move the old or all Archive log files from ORAARCH / SAPARCH directory to other safe location as backup copies and Restart ur DB Instance and SAP Instance step by step.
If this directory is full on the operating system or some problem occurs with it, then the Oracle does not allow overwriting and hence the database is stopped until the archiving process can be restarted successfully.
Sufficient space should be allocated for ORAARCH or SAPARCH directory.
As an alternative, You can disable Archive log mode during SGEN operation. But make sure that you will have to perform immediate offline backup of Database before or after disabling/enabling Archive Log Mode to have guaranteed DB recovery.
Regards,
Bhavik G. Shroff
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi manas,
While SGEN is running, It is needed to monitor two things
1. Make sure archive directory is not full i.e /oracle/,SID>/oraarch
2. make sure tablespaces are not full, particulalrly PSAP<SID>700, you can check using Brtools
Thanks and Regards
Purna
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
User | Count |
---|---|
78 | |
9 | |
9 | |
7 | |
7 | |
6 | |
6 | |
5 | |
5 | |
4 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.