Netweaver instance

[Former Member]

Hi

My netweaver 7.01 instance starts then dies.

work+dips turns yellow (Running but dialog queue at standstill).

See dev_w0 file (i cant find any errors)

Thanks in advance

Abu S.

---------------------------------------------------

trc file: "dev_w0", trc level: 1, release: "720"

---------------------------------------------------

*

*  ACTIVE TRACE LEVEL           1

*  ACTIVE TRACE COMPONENTS      all, MJ

*

M sysno      00

M sid        BW2

M systemid   562 (PC with Windows NT)

M relno      7200

M patchlevel 0

M patchno    300

M intno      20020600

M make       multithreaded, Unicode, 64 bit, optimized

M profile    \\got-bw**\sapmnt\BW2\SYS\profile\BW2_DVEBMGS00_got-bw**

M pid        4332

M

M  kernel runs with dp version 134000(ext=119000) (@(#) DPLIB-INT-VERSION-134000-UC)

M  length of sys_adm_ext is 588 bytes

M  ***LOG Q0Q=> tskh_init, WPStart (Workp. 0 4332) [dpxxdisp.c   1377]

I  MtxInit: 30000 0 0

M  DpSysAdmExtCreate: ABAP is active

M  DpSysAdmExtCreate: VMC (JAVA VM in WP) is not active

M  DpIPCInit2: read dp-profile-values from sys_adm_ext

M  DpShMCreate: sizeof(wp_adm)                    43024          (2264)

M  DpShMCreate: sizeof(tm_adm)                    5517056          (27448)

M  DpShMCreate: sizeof(wp_ca_adm)                    64000          (64)

M  DpShMCreate: sizeof(appc_ca_adm)          64000          (64)

M  DpCommTableSize: max/headSize/ftSize/tableSize=500/16/1384064/1384080

M  DpShMCreate: sizeof(comm_adm)                    1384080          (2744)

M  DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0

M  DpShMCreate: sizeof(slock_adm)                    0          (296)

M  DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0

M  DpShMCreate: sizeof(file_adm)                    0          (80)

M  DpShMCreate: sizeof(vmc_adm)                    0          (2152)

M  DpShMCreate: sizeof(wall_adm)                    (41664/42896/64/192)

M  DpShMCreate: sizeof(gw_adm)          48

M  DpShMCreate: sizeof(j2ee_adm)          3952

M  DpShMCreate: SHM_DP_ADM_KEY                    (addr: 000000000C600050, size: 7174928)

M  DpShMCreate: allocated sys_adm at 000000000C600060

M  DpShMCreate: allocated wp_adm_list at 000000000C603070

M  DpShMCreate: allocated wp_adm at 000000000C603260

M  DpShMCreate: allocated tm_adm_list at 000000000C60DA80

M  DpShMCreate: allocated tm_adm at 000000000C60DAD0

M  DpShMCreate: allocated wp_ca_adm at 000000000CB509E0

M  DpShMCreate: allocated appc_ca_adm at 000000000CB603F0

M  DpShMCreate: allocated comm_adm at 000000000CB6FE00

M  DpShMCreate: system runs without slock table

M  DpShMCreate: system runs without file table

M  DpShMCreate: allocated vmc_adm_list at 000000000CCC1CA0

M  DpShMCreate: system runs without vmc_adm

M  DpShMCreate: allocated gw_adm at 000000000CCC1D50

M  DpShMCreate: allocated j2ee_adm at 000000000CCC1D90

M  DpShMCreate: allocated ca_info at 000000000CCC2D10

M  DpShMCreate: allocated wall_adm at 000000000CCC2DA0

M  DpCommAttachTable: attached comm table (header=000000000CB6FE00/ft=000000000CB6FE10)

M  DpRqQInit: use protect_queue / slots_per_queue 0 / 2001 from sys_adm

M  rdisp/queue_size_check_value :  -> on,50,30,40,500,50,500,80

X  EmInit: MmSetImplementation( 2 ).

X  MM global diagnostic options set: 0

X  <ES> client 0 initializing ....

X  <ES> EsILock: use spinlock for locking

X  Using implementation view

X  <EsNT> Using memory model view.

M  <EsNT> Memory Reset disabled as NT default

X  ES initialized.

X 

X Mon Jun 17 22:19:36 2013

X  mm.dump: set maximum dump mem to 96 MB

M  DpVmcSetActive: set vmc state DP_VMC_NOT_ACTIVE

M  ThStart: taskhandler started

M  rdisp/thsend_mode : -1 -> 0

M  ThInit: initializing DIA work process W0

M 

M Mon Jun 17 22:19:39 2013

M  ThInit: running on host got-bw701-2

M 

M Mon Jun 17 22:19:41 2013

M  calling db_connect ...

B  Loading DB library 'D:\usr\sap\BW2\DVEBMGS00\exe\dbsdbslib.dll' ...

B  Library 'D:\usr\sap\BW2\DVEBMGS00\exe\dbsdbslib.dll' loaded

B  Version of 'D:\usr\sap\BW2\DVEBMGS00\exe\dbsdbslib.dll' is "720.00", patchlevel (0.212)

C 

C  DBSDBSLIB : version 720.00, patch 0.212 (Make PL 0.300)

C  MAXDB shared library (dbsdbslib) patchlevels (last 10)

C    (0.212) Call TH callback after cancel (note 1692560)

C    (0.210) Init length of tablename for describe (note 1678130)

C    (0.200) Take care of warnings during database connect (note 1600066)

C    (0.117) Define a primary key on the temp tables for R3szchk (note 1606260)

C    (0.114) Support of MaxDB 7.8 and 7.9 (note 1653058)

C    (0.103) Close all lob locators at end of the transaction (note 1626591)

C    (0.101) Fix for unknown table __TABLE_SIZES_ (R3szchk) (note 1619504)

C    (0.098) Use filesystem counter for R3szchk (note 1606260)

C    (0.092) Secondary connection to HANA (note 1481256)

C    (0.089) UPDSTAT with SAPSYSTEMNAME longer as 3 characters (note 1584921)

C 

C 

C  Loading SQLDBC client runtime ...

C 

C Mon Jun 17 22:19:42 2013

C  SQLDBC Module  : d:\sapdb\programs\pgm\libSQLDBC77.dll

C  SQLDBC SDK     : SQLDBC.H  7.7.6    BUILD 010-123-204-327

C  SQLDBC Runtime : libSQLDBC 7.7.6    BUILD 010-123-204-327

C  SQLDBC client runtime is MaxDB 7.7.6.010 CL 204327

C  SQLDBC supports new DECIMAL interface : 1

C  SQLDBC supports VARIABLE INPUT data   : 1

C  SQLDBC supports VARIABLE OUTPUT data  : 0

C  SQLDBC supports Multiple Streams      : 1

C  SQLDBC supports LOB LOCATOR KEEPALIVE : 1

C  SQLDBC supports LOB LOCATOR COPY      : 1

C  SQLDBC supports BULK SELECT with LOBS : 1

C  SQLDBC supports BATCH STREAM          : 0

C  INFO : SQLOPT= -I 0 -t 0 -S SAPR3

C  Try to connect (DEFAULT) on connection 0 ...

C  Attach to SAP DB : Kernel    7.7.06   Build 010-123-204-327

C  Database release is SAP DB 7.7.06.010

C  INFO : Database 'BW2' instance is running on 'got-bw701-2'

C  DB supports UPSERT SQL syntax : 1

C  DB supports new EXPAND syntax : 0

C  DB supports LOB locators      : 1

C  DB uses MVCC support          : 0

C  DB max. input host variables  : 2000

C  DB max. statement length      : 65535

C  UPSERT is disabled for : WBCROSSGT

C  INFO : SAP DB Packet_Size = 131072

C  INFO : SAP DB Min_Reply_Size = 4096

C  INFO : SAP DB Comm_Size = 126976

C  INFO : DBSL buffer size = 126976

C  INFO : SAP DB MaxLocks = 300000

C  INFO : Connect to DB as 'SAPBW2'

C  Command info enabled

C  Now I'm connected to MaxDB

C  00: got-bw701-2-BW2, since=20130617221942, ABAP= <unknown> (0)

B  Connection 0 opened (DBSL handle 0)

C  INFO : SAP RELEASE (DB) = 701

M  ThInit: db_connect o.k.

M  ICT: exclude compression: *.zip,*.rar,*.arj,*.z,*.gz,*.tar,*.lzh,*.cab,*.hqx,*.ace,*.jar,*.ear,*.war,*.css,*.pdf,*.gzip,*.uue,*.bz2,*.iso,*.sda,*.sar,*.gif,*.png,*.swc,*.swf

[AtulKumarJain · Accepted solution]

Hi Abu,

Please check DB is up or not ,

provide R3trans -d output

and please provide dev_disp,dev_ms trace info.

Best Regards,

atul

[Former Member · Accepted solution]

Hi Atul

1)  The Db is up

2) I get the following message when i run r3trans -d output

3) dev_disp

---------------------------------------------------

trc file: "dev_disp", trc level: 1, release: "720"

---------------------------------------------------

sysno      00

sid        BW2

systemid   562 (PC with Windows NT)

relno      7200

patchlevel 0

patchno    300

intno      20020600

make       multithreaded, Unicode, 64 bit, optimized

profile    \\got-bw**\sapmnt\BW2\SYS\profile\BW2_DVEBMGS00_got-bw**

pid        4140

kernel runs with dp version 134000(ext=119000) (@(#) DPLIB-INT-VERSION-134000-UC)

length of sys_adm_ext is 588 bytes

*** SWITCH TRC-HIDE on ***

***LOG Q00=> DpSapEnvInit, DPStart (00 4140) [dpxxdisp.c   1315]

          shared lib "dw_xml.dll" version 300 successfully loaded

          shared lib "dw_xtc.dll" version 300 successfully loaded

          shared lib "dw_stl.dll" version 300 successfully loaded

          shared lib "dw_gui.dll" version 300 successfully loaded

          shared lib "dw_mdm.dll" version 300 successfully loaded

          shared lib "dw_rndrt.dll" version 300 successfully loaded

          shared lib "dw_abp.dll" version 300 successfully loaded

          shared lib "dw_sym.dll" version 300 successfully loaded

          shared lib "dw_aci.dll" version 300 successfully loaded

rdisp/softcancel_sequence :  -> 0,5,-1

use internal message server connection to port 3900

rdisp/dynamic_wp_check : 1

rdisp/calculateLoadAverage : 1

Mon Jun 17 22:19:33 2013

*** WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 4 seconds

***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c  6423]

MtxInit: 30000 0 0

DpSysAdmExtInit: ABAP is active

DpSysAdmExtInit: VMC (JAVA VM in WP) is not active

DpIPCInit2: write dp-profile-values into sys_adm_ext

DpIPCInit2: start server >got-bw***_BW2_00                      <

DpShMCreate: sizeof(wp_adm)                    43024          (2264)

DpShMCreate: sizeof(tm_adm)                    5517056          (27448)

DpShMCreate: sizeof(wp_ca_adm)                    64000          (64)

DpShMCreate: sizeof(appc_ca_adm)          64000          (64)

DpCommTableSize: max/headSize/ftSize/tableSize=500/16/1384064/1384080

DpShMCreate: sizeof(comm_adm)                    1384080          (2744)

DpSlockTableSize: max/headSize/ftSize/fiSize/tableSize=0/0/0/0/0

DpShMCreate: sizeof(slock_adm)                    0          (296)

DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0

DpShMCreate: sizeof(file_adm)                    0          (80)

DpShMCreate: sizeof(vmc_adm)                    0          (2152)

DpShMCreate: sizeof(wall_adm)                    (41664/42896/64/192)

DpShMCreate: sizeof(gw_adm)          48

DpShMCreate: sizeof(j2ee_adm)          3952

DpShMCreate: SHM_DP_ADM_KEY                    (addr: 0000000003880050, size: 7174928)

DpShMCreate: allocated sys_adm at 0000000003880060

DpShMCreate: allocated wp_adm_list at 0000000003883070

DpShMCreate: allocated wp_adm at 0000000003883260

DpShMCreate: allocated tm_adm_list at 000000000388DA80

DpShMCreate: allocated tm_adm at 000000000388DAD0

DpShMCreate: allocated wp_ca_adm at 0000000003DD09E0

DpShMCreate: allocated appc_ca_adm at 0000000003DE03F0

DpShMCreate: allocated comm_adm at 0000000003DEFE00

DpShMCreate: system runs without slock table

DpShMCreate: system runs without file table

DpShMCreate: allocated vmc_adm_list at 0000000003F41CA0

DpShMCreate: system runs without vmc_adm

DpShMCreate: allocated gw_adm at 0000000003F41D50

DpShMCreate: allocated j2ee_adm at 0000000003F41D90

DpShMCreate: allocated ca_info at 0000000003F42D10

DpShMCreate: allocated wall_adm at 0000000003F42DA0

DpCommAttachTable: attached comm table (header=0000000003DEFE00/ft=0000000003DEFE10)

DpSysAdmIntInit: initialize sys_adm

rdisp/test_roll : roll strategy is DP_NORMAL_ROLL

dia token check not active (10 token)

MBUF state OFF

DpCommInitTable: init table for 500 entries

DpRqQInit: keep protect_queue / slots_per_queue 0 / 2001 in sys_adm

rdisp/queue_size_check_value :  -> on,50,30,40,500,50,500,80

Mon Jun 17 22:19:34 2013

EmInit: MmSetImplementation( 2 ).

MM global diagnostic options set: 0

<ES> client 0 initializing ....

<ES> EsILock: use spinlock for locking

<ES> InitFreeList

<ES> block size is 4096 kByte.

<ES> Info: em/initial_size_MB( 16382MB) not multiple of em/blocksize_KB( 4096KB)

<ES> Info: em/initial_size_MB rounded up to 16384MB

Using implementation view

<EsNT> Using memory model view.

<EsNT> Memory Reset disabled as NT default

<ES> 4095 blocks reserved for free list.

ES initialized.

mm.dump: set maximum dump mem to 96 MB

DpVmcSetActive: set vmc state DP_VMC_NOT_ACTIVE

MPI: dynamic quotas disabled.

MPI init: pipes=4000 buffers=1279 reserved=383 quota=10%

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG CPS=> DpLoopInit, ICU ( 3.4 3.4 4.1) [dpxxdisp.c   1701]

***LOG Q0K=> DpMsAttach, mscon ( got-bw701-2) [dpxxdisp.c   12520]

MBUF state LOADING

DpStartStopMsg: send start message (myname is >got-bw701-2_BW2_00                      <)

DpStartStopMsg: start msg sent

CCMS uses Shared Memory Key 73 for monitoring.

CCMS: Initalized shared memory of size 60000000 for monitoring segment.

CCMS: Checking Downtime Configuration of Monitoring Segment.

CCMS: AlMsUpload called by wp 1024.

Mon Jun 17 22:19:35 2013

CCMS: AlMsUpload successful for D:\usr\sap\BW2\DVEBMGS00\log\ALMTTREE.DAT (689 MTEs).

CCMS: start to initalize 3.X shared alert area (first segment).

DpAppcBlksLow: max appc blocks in queue is 500 (50 %)

DpWpBlksLow: max wp blocks in queue is 800 (80 %)

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c   1296]

MBUF state ACTIVE

MBUF component UP

DpMsgProcess: 1 server in MBUF

Tue Jun 18 01:43:44 2013

***LOG Q0I=> NiIRead: P=10.98.45.39:13889; L=0.0.0.0:3200: recv (10053: WSAECONNABORTED: Software caused connection abort) [nixxi.cpp 5087]

*** ERROR => NiIRead: SiRecv failed for hdl 49/sock 956

    (SI_ECONN_BROKEN/10053; I4; ST; P=10.98.45.39:13889; L=0.0.0.0:3200) [nixxi.cpp    5087]

DpRTmPrepareReq: network error of client T20, NiBufReceive (-6: NIECONN_BROKEN), dp_tm_status=3

Tue Jun 18 01:43:49 2013

DpRTmPrepareReq: client address of T20 is 10.98.45.39(10.98.45.39)

***LOG Q04=> DpRTmPrep, NiBufReceive (21 20 Faheem-PC ) [dpxxdisp.c   12181]

RM-T20, U21,                 , Faheem-PC, 22:20:00, M0, W-1,     , 1/0

4) dev_ms

---------------------------------------------------

trc file: "dev_ms", trc level: 1, release: "720"

---------------------------------------------------

[Thr 4136] Mon Jun 17 22:19:25 2013

[Thr 4136] ms/http_max_clients = 500 -> 500

[Thr 4136] MsSSetTrcLog: trc logging active, max size = 52428800 bytes

systemid   562 (PC with Windows NT)

relno      7200

patchlevel 0

patchno    218

intno      20020600

make       multithreaded, Unicode, 64 bit, optimized

pid        4132

[Thr 4136] ***LOG Q01=> MsSInit, MSStart (Msg Server 1 4132) [msxxserv.c   2279]

[Thr 4136] Mon Jun 17 22:19:26 2013

[Thr 4136] load acl file = D:\usr\sap\BW2\SYS\global\ms_acl_info.DAT

[Thr 4136] MsGetOwnIpAddr: my host addresses are :

[Thr 4136]   1 : [10.100.37.184] got-bw**.emea.tib**.com (HOSTNAME)

[Thr 4136]   2 : [127.0.0.1] got-bw**.emea.tib**.com (LOCALHOST)

[Thr 4136] MsHttpInit: full qualified hostname = got-bw**.emea.tib**.com

[Thr 4136] HTTP logging is switch off

[Thr 4136] set HTTP state to LISTEN

[Thr 4136] *** HTTP port 8100 state LISTEN ***

[Thr 4136] MsHttpOwnDomain: own domain[1] = emea.tibco.com

[Thr 4136] *** I listen to port sapmsBW2 (3600) ***

[Thr 4136] *** I listen to internal port 3900 (3900) ***

[Thr 4136] *** HTTP port 8100 state LISTEN ***

[Thr 4136] CUSTOMER KEY: >X1997278969<

[Thr 4136] build version=720.2012.04.20

Hope this helps,

Thanks

Abu

[Reagan · Accepted solution]

Hello

I can see that you are executing the R3trans under Administrator user.

Please execute R3trans -d under user bw2adm.

After that check the trans.log file generated by the R3trans.

If there is MaxDB Studio Manager installed check the status of the database.

Cheers

RB

[AtulKumarJain · Accepted solution]

Hi Abu,

Please check

http://scn.sap.com/thread/1611444

also please check you

http://scn.sap.com/thread/1952876

BR

Atul

[Former Member · Accepted solution]

Hi RB

Just waiting to connect. Ill keep u posted.

Rgds

Abu

[Former Member · Accepted solution]

Hi RB

I finally was able to execute r3trans with user SIDadm

Ive attached trans.log.

Rgds

Abu

trans copy.txt.zip

[Reagan · Accepted solution]

Hello Abu

The trans.log file is not complete.

What was the return code when you executed R3trans -d under sidadm ?

There are no errors found in the log you have attached.

If the return code is 0000 then it is most likely an issue with the OS.

In that case could you restart the server and then start SAP and then closely watch the event viewer logs in Windows when the system crashes.

Also check the developer traces (dev_w0, dev_disp, dev_ms) when the system crashes.

Regards

RB

[Former Member · Accepted solution]

Hi RB

I looked at the trans.log again. I conclude the return code is 0000. Please confirm.

Tnx

Abu.

See below.

4 ETW000 ================== STEP 1 =====================

4 ETW000 date&time        : 18.06.2013 - 23:23:53

4 ETW000 function         : CONNECT

4 ETW000 buffersync       : YES

4 ETW000 clients          : default

4 ETW000 commit           : 100000

4 ETW000 table cache      : dynamic

4 ETW000

4 ETW000  [     dev trc,00000]  Disconnecting from ALL connections:                                      414  0.000414

4 ETW000  [     dev trc,00000]  Disconnecting from connection 0 ...                                      369  0.000783

4 ETW000  [     dev trc,00000]  Now I'm disconnected from MaxDB                                          694  0.001477

4 ETW000  [     dev trc,00000]  Disconnected from connection 0                                            89  0.001566

4 ETW000  [     dev trc,00000]  statistics db_con_commit (com_total=1, com_tx=1)                          31  0.001597

4 ETW000  [     dev trc,00000]  statistics db_con_rollback (roll_total=0, roll_tx=0)                      27  0.001624

4 ETW000 Disconnected from database.

4 ETW000 End of Transport (0000).

4 ETW000 date&time: 18.06.2013 - 23:23:53

[Reagan · Accepted solution]

Hello Abu

Please follow these:

If the return code is 0000 then it is most likely an issue with the OS.
In that case could you restart the server and then start SAP and then closely watch the event viewer logs in Windows when the system crashes.
Also check the developer traces (dev_w0, dev_disp, dev_ms) when the system crashes.

Regards

RB

[Former Member · Accepted solution]

Hi RB

Restarted Server and instance.

Only significant item from event viewer

Information:

The description for Event ID 19817 from source MAXDB:Bw2 cannot be found. Either the component that raises this event is not installed on your local computer or the installation is corrupted. You can install or repair the component on the local computer.

If the event originated on another computer, the display information had to be saved with the event.

The following information was included with the event:

MAXDB - Bw2

:

- INFO   TID: 0xFDC  PID: 0xBF0  MsgID: 19817

SERVERDB 'BW2' started,

   Version:           'Kernel    7.7.06   Build 010-123-204-327'

   DBROOT:           'D:\sapdb\BW2\db'

[Reagan · Accepted solution]

Hello

It looks like there are issues with the MaxDB database:

Check the KNLDIAG or the KNLMSG trace files to find out the reasons.

In you case I believe it should be KNLMSG as you have a 7.7 version MaxDB

Use this Wiki for guidance:

http://wiki.sdn.sap.com/wiki/display/MaxDB/MaxDB+log+files

You will need to closely monitor the system for sometime until it crashes, especially the event viewer in Windows.

Good Luck

RB

[Former Member · Accepted solution]

Hi RB

I checked knlmsg trace. Job log seems to be full.

Tnx

Abu

KnlMsg copy.txt.zip

[Former Member · Accepted solution]

Thanks for the help RB.

The problem was the db log area was full.

The system is back online.

Regards

Abu

[shabeer]

Hi,

When you say "Snapshot restore"... Does it retain same hostname/ip address/physical address? Did you verify/notice any changes in this? Also check the network status.

Regards,

Shabeer

[shabeer]

Hi,

The instance was running fine for weeks. Then a windows snapshot was restored then problems started occurring.

1. Is this system hosted on any cloud services?

2. The snapshot restored on the same host?

Regards,

Shabeer

[Former Member]

Hi Shabeer.

1. No cloud host

2. Snapshot was restored on same host.

Rgds

Abu

[Reagan]

Hello

Could you check what I have suggested before ?

Check the trans.log file after executing R3trans -d as sidadm user.

Cheers

RB

[Former Member]

Hello Abu,

Update your kernel to the latest available in SMP.

Generally, it should resolve the issue.

Thanks & Regards,

Ananda Swaroop

[Former Member]

Hi Ananda

The instance was running fine for weeks. Then a windows snapshot was restored then problems started occurring. What would an update of the kernel achieve, cos it was working fine with the old kernel.

Tnx

Abu

[Former Member]

Please clarify: after snapshot restore if system is working fine with old kernel? Are problems arise only after kernel update?

[Former Member]

Hi Roman

I haven't done a kernel update.

Tnx

Abu

[former_member188883]

Hi Abu,

Could you ensure that sapstartsrv file of the same version exists in kernel directory as well as C:\windows\system32 folder as well.

Once you have synchronized, you may restart SAP and check the results.

Hope this helps.

Regards,

Deepak Kori

[Former Member]

Hi Deepak

Both files are the same.

Tnx

Abu