R3trans -x takes 9 minutes and ends with RC=0

[Former Member]

Hi,

I have a very strange problem. On one of our SAP DB servers R3trans takes 9 minutes to end with RC=0:

4 ETW000 R3trans version 6.13 (release 640 - 21.10.08 - 10:02:00).

4 ETW000 ===============================================

4 ETW000

4 ETW000 date&time : 20.11.2009 - 15:38:47

4 ETW000 control file: <no ctrlfile>

4 ETW000 R3trans was called as follows: R3trans -x

4 ETW000 trace at level 2 opened for a given file pointer

4 ETW000 [dev trc ,00000] Fri Nov 20 15:38:47 2009 307 0.000307

4 ETW000 [dev trc ,00000] db_con_init called 26 0.000333

4 ETW000 [dev trc ,00000] create_con (con_name=R/3) 115 0.000448

4 ETW000 [dev trc ,00000] Loading DB library '/usr/sap/HE1/SYS/exe/run/dboraslib.so' ...

4 ETW000 69 0.000517

4 ETW000 [dev trc ,00000] Fri Nov 20 15:47:11 2009 503303590 503.304107

4 ETW000 [dev trc ,00000] load shared library (/usr/sap/HE1/SYS/exe/run/dboraslib.so), hdl 0

4 ETW000 357 503.304464

4 ETW000 [dev trc ,00000] Library '/usr/sap/HE1/SYS/exe/run/dboraslib.so' loaded

4 ETW000 32 503.304496

while on all other systems it takes less than 1 second:

4 ETW000 R3trans version 6.13 (release 640 - 21.10.08 - 10:02:00).

4 ETW000 ===============================================

4 ETW000

4 ETW000 date&time : 20.11.2009 - 15:19:58

4 ETW000 control file: <no ctrlfile>

4 ETW000 R3trans was called as follows: R3trans -x

4 ETW000 trace at level 2 opened for a given file pointer

4 ETW000 [dev trc ,00000] Fri Nov 20 15:19:58 2009 43395 0.043395

4 ETW000 [dev trc ,00000] db_con_init called 856 0.044251

4 ETW000 [dev trc ,00000] create_con (con_name=R/3) 7442 0.051693

4 ETW000 [dev trc ,00000] Loading DB library '/usr/sap/HQ1/SYS/exe/run/dboraslib.so' ...

4 ETW000 688 0.052381

4 ETW000 [dev trc ,00000] load shared library (/usr/sap/HQ1/SYS/exe/run/dboraslib.so), hdl 0

4 ETW000 56371 0.108752

4 ETW000 [dev trc ,00000] Library '/usr/sap/HQ1/SYS/exe/run/dboraslib.so' loaded

4 ETW000 35 0.108787

As you can see on the first log, the loading of dboraslib.so takes about 9 minutes!!! And this is very strange. The problem appeared after migrating the databasefiles to another volume.

Connect to the database with sqlplus goes very fast and one can work without problem. Also SAP is working normal once its started, but sapstart also takes way longer compared to all other machines.

All of our servers share the same kernel directory (NFS mounted), so all use the same R3trans and load the same library.

Both systems have the same LD_LIBRARY_PATH variable set (except SYSID of course). Both are on Solaris 10, same patch level. Both are Oracle 9.2.0.7. None of them is suffering from heavy load.

I'd appreciate any input.

Thanks,

Reinhold

====> does anybody have an idea why this text is so badly formatted while it looks OK in the editor?

Edited by: Reinhold Wagner on Nov 20, 2009 4:52 PM

[markus_doehr2 · Accepted solution]

> I have a very strange problem. On one of our SAP DB servers R3trans takes 9 minutes to end with RC=0:

You can try the following:

truss -f R3trans -x

to see what the R3trans is doing all that time.

Markus

[Former Member · Accepted solution]

Markus,

good idea:

26520: stat("/net/sapmnt.db_sw/oracle/920_64/CustClient/9207/lib/libwtc9.so", 0xFFFFFFFF7FFFE370) (sleeping...)

I checked the Oracle client directory and solved the problem:

bash-3.00# ls -l

total 48

drwxrwxr-x 5 he1adm sapsys 4096 Sep 29 2005 jdbc

drwxrwxr-x 2 he1adm sapsys 4096 Sep 29 2005 lib

drwxrwxr-x 3 he1adm sapsys 4096 Sep 29 2005 network

drwxrwxr-x 3 he1adm sapsys 4096 Sep 29 2005 ocommon

drwxrwxr-x 4 he1adm sapsys 4096 Sep 29 2005 oracore

drwxrwxr-x 3 he1adm sapsys 4096 Sep 29 2005 rdbms

bash-3.00# mv lib lib.orig

bash-3.00# mv jdbc jdbc.orig

bash-3.00# mv ocommon ocommon.orig

bash-3.00# ln -s /oracle/HE1/920_64/jdbc

bash-3.00# ln -s /oracle/HE1/920_64/lib

bash-3.00# ln -s /oracle/HE1/920_64/ocommon

Thanks.

Reinhold

[Former Member]

Problem solved as described.

[Former Member]

Hi,

what is your hardware set-up look like...... Server hardware disk array etc.....

Mark