SAP upgrade to 11.2.0.4 - DBUA results on error "sp02 -0640:not connected".

[Former Member]

Hi,

I am new on SAP WORLD and i´m trying to upgrade SAP database from 11.2.0.3 to SAP 11.2.0.4

I am following this SAP NOTE:

Database Upgrade Guide

Upgrade to Oracle Database 11g Release 2 (11.2): UNIX

For Oracle Patch Set Release 11.2.0.4

I have executed "./dbua.sap.sh -q" with success.

So i tried to execute the DBUA with this steps:

bash

export DISPLAY=10.1.4.175:0.0

export IHRDBMS=/oracle/XYZ/11204

export OHRDBMS=/oracle/XYZ/112_64

export ORACLE_HOME_SRC=/oracle/XYZ/112_64

export ORACLE_HOME_TGT=/oracle/XYZ/11204

cd $ORACLE_HOME_TGT/sap/ora_upgrade/post_upgrade

./dbua.sap.sh

After WELCOME page appeared with sucess, i pressed NEXT and recieved:

"sp02 -0640:not connected".

I checked TRACE.LOG (attached on discussion)  generated and discovered this message error:

[Thread-7] [ 2016-08-10 20:06:39.803 BRT ] [OracleHome.initOptions:1253]  executing: startup nomount pfile='/oracle/XYZ/11204/dbs/init

[Thread-7] [ 2016-08-10 20:06:39.847 BRT ] [SQLEngine.done:2189]  Done called                                                      

[Thread-7] [ 2016-08-10 20:06:39.848 BRT ] [OracleHome.initOptions:1262]  ORA-01041: internal error. hostdef extension doesn't exist

I do not know if i am missing something in the SAP note. If someone could suggest anything to check the enviroment, i will be glad.

Best regards,

Sergio

trace.TXT.zip

[thiago_cavalheiro · Accepted solution]

Hello Sergio,

Please validate whether the system time is properly set at the OS level. If not, do so and reboot the server. Also make sure the init or spfile under $ORACLE_HOME/dbs are clean.

Best regards,

Thiago

[Former Member]

Hi Ganezan & James,

I do not know why this problem ocurred in SAP upgrade. Maybe i have skipped one step on SAP note or do additional steps (outside SAP note).

But for the problem i have faced, following oracle support action plan (My Oracle Support note 1467060.1) have solved my problem and i could continued with upgrade till the end.

Again, thank you very much for your help and patience (i am new in SAP World).

If you doesn´t help me so much in this issue, i believe i was still in the same place, thinking what to do.

Best regards,

Sergio

[Former Member]

Hi Sergio,

Good to know that the issue is resolved and thanks for updating the discussion to make it completed.

Regards,

Ganesan

[Former Member]

Hi,

I can resume the problem in this manner

A) WITHOUT  "SQLNET.AUTHENTICATION_SERVICES = (NONE)" :

     ORA-01041: internal error. hostdef extension doesn't exist

B) WITH  "SQLNET.AUTHENTICATION_SERVICES = (NONE)" :

     ORA-01017: invalid username/password; logon denied

     obs: The PWD file was recreated on ORACLE_HOME_SOURCE/dbs

Reggards,

Sergio

[JamesZ]

Hi Sergio,

Really run of idea . As mentioned, manual upgrade is not recommended. If you really want to do it, you can refer to:

https://docs.oracle.com/cd/E11882_01/server.112/e23633/upgrade.htm#UPGRD00350

SAP note 1431793

Are you an SAP customer? If so, you can raise an call to SAP, in the meanwhile keep this discussion open. So SAP and SCN can work in parallel.

Best regards,
James

[Former Member]

Hi James & Ganesan,

First of all, thank you very much for your help and patience in this discussion.

I have learned a lot of things. Thanks for that.

I agree with you. I think we need here to open a SAR call, and i will discuss it with my manager.

I tried to apply this procedure in a second environment, with the same error. So. i think my procedure is not OK and i will try to have a feedback from SAP support.

I promisse i will update this discussion if we found the reason for this problem.

Best regards,

Sergio

[Former Member]

Hi James & Ganesan,

I have oppened a SR issue on METALINK site.

They proposed me an action plan (based on note Relinking Oracle Home FAQ -  Frequently Asked Questions - Doc ID 1467060.1)

It aparentally solved the problem with DBUA:

# SET VARIABLES TO POINT 11.2.0.4 INSTALLATION

bash

export DISPLAY=10.1.4.175:0.0

#xhost +

export ORACLE_HOME=/oracle/ECH/11204

export ORACLE_SID=DBUA0030239

export LD_LIBRARY_PATH=/usr/sap/ECH/SYS/exe/run:/usr/sap/ECH/SYS/exe/uc/linuxx86_64:/oracle/ECH/11204/lib

export PATH=/oracle/ECH/11204/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/sap/ECH/SYS/exe/uc/linuxx86_64:/usr/sap/ECH/SYS/exe/run:/oracle/ECH:.

# RELINK 11.2.0.4 INSTALLATION

$ORACLE_HOME/bin/relink all

writing relink log to: /oracle/ECH/11204/install/relink.log

# STARTUP NOMOUNT WITH INIT FILE GENERATED BY DBUA

SQL> startup nomount pfile='/oracle/ECH/11204/dbs/initDBUA0030239.ora'

ORACLE instance started.

Total System Global Area  217157632 bytes

Fixed Size                  2251816 bytes

Variable Size             159384536 bytes

Database Buffers           50331648 bytes

Redo Buffers                5189632 bytes

# SHUTDOWN INSTANCE

SQL> shutdown immediate

ORA-01507: database not mounted

ORACLE instance shut down.

I do not know if this workahound will impact the PATCH SAP BUNDLE installation, but i will proceed with the SAP upgrade to 11.2.0.4 and then ask devolopment team to proceed with validations.

I will post in this discussion the results of this workahound.

Best regards,

Sergio Coutinho

[JamesZ]

Hi Sergio,

Metalink 1467060.1？

As long as you get official reply from oracle, generally it would be fine.

Best regards,
James

[Former Member]

PSC

Another files ..

TRACE_LOG.TXT.zip

sqls_log.txt.zip

[Former Member]

Hi,

Same error ocurred

I have noticed that DBUA generates a initECH and a PWD file with a randonic name:  "initDBUA0030239.ora" and  "orapwDBUA0030239"

Is it normal using DBUA.sap.sh ?

Regards,

Sergio

DBAU_TRACE_LOG.TXT.zip

11gupgrade-11204-ECH-2016_08_15-22-31-17_LOG.TXT.zip

[Former Member]

Hi Ganezan,

Trying to understand what´s happening on startup,I have  executed a "TRUSS" (strace on LINUX):

export LD_LIBRARY_PATH=/usr/sap/ECH/SYS/exe/run:/usr/sap/ECH/SYS/exe/uc/linuxx86_64:/oracle/ECH/11204/lib:/oracle/ECH/112_64/lib

export ORACLE_HOME=/oracle/ECH/11204

export PATH=/oracle/ECH/11204/bin:/oracle/ECH/112_64/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/sap/ECH/SYS/exe/uc/linuxx86_64:/usr/sap/ECH/SYS/exe/run:/oracle/ECH:.

strace -fo /tmp/truss.out -f sqlplus "/ as sysdba"

startup nomount pfile='/oracle/ECH/11204/dbs/initDBUA0030239.ora';

I have upload "truss" file output .. maybe some directory is missing.

Could you see this file?

Regards,

Sergio

TRUSS_SQLPLUS_STARTUP_TRACE.TXT.zip

[Former Member]

Hi,

DBUA dummy instance is a normal one. You can see, alert_DBUA****.log file and DBUA***_ora_***.trc files under the directory here : /oracle/ECH/11204/log. Could you please post both files here? Then we can see the reason why DBUA dummy instance is not being started.

Regards,

Ganesan

[Former Member]

K Ganesan,

I´m sorry, but this directory "/oracle/ECH/11204/log" is empty.

There is a sub-directory here, named   "srv-sgecx-db".

But there are no ALERT or TRACE file generated.

Could it be located in another directory?

And do you think TRUSS file uploaded is ok?

Regards,

Sergio

[Former Member]

Hi,

Sorry, I can't validate TRUSS file, because i have never created this one. According the the pfile of the dummy instance the log file should be in the location /oracle/ECH/11204/log and all logs should be there. 

db_name=DBUA4718

db_unique_name=DBUA4718262

shared_pool_size=128m

cpu_count=1

diagnostic_dest=/oracle/ECH/11204/log

_enable_NUMA_support=false

Or could you please see it here: "$ORACLE_HOME/cfgtoollogs/dbua/logs"? If we have the alert and trace log of DBUA, then we can try to find the root cause of this issue.

Regards,

Ganesan

[Former Member]

Hi Ganezan,

This is the only file i could find DBUA.

Regards,

Sergio

DBUA_TRACE_LOG.TXT.zip

[Former Member]

Hi Sergio,

It is really strange when the DBUA logs are not created under the "diagnostic_dest" location. Could you post content of files from : "/oracle/cfgtoollogs/dbua"? I would like to see, for which reason, DBUA dummy instance is not getting started. 

Regards,

Ganesan

[Former Member]

Hi,

Can you post your 11204 listener.ora file here?

Regards,

Ganesan

[Former Member]

Hi Ganezan,

Sorry for the delay.

I am uploading LISTENER.ORA

Before DBUA, I have edited it to set ORACLE_HOME to new ORACLE_HOME_11204.

Do you think there is anything wrong with this SAP environment?

Did i need to repeat previous steps of SAP upgrade or try to do MANUAL upgrade (although i really doesn´t know how to do it)?

Regards,

Sergio

LISTENER_ORA.TXT.zip

[Former Member]

Hi,

I don't see any issues regarding the settings for the upgrade. The issue seems DBUA is not getting restarted properly after the first run. I also suggest you to open an incident with SAP for further assistance. But before that, i would like you to give one more try.If you find the file "$ORACLE_HOME/cfgtoollogs/dbua/logs/Welcome_ECH.txt", backup and remove it.

Then try to run "./dbua.sap.sh" again. If it doesn't work, you can raise an incident with SAP as suggested by James. It is really strange, dbua could not start dummy instance when we don't have any issues until this step.

Regards,

Ganesan

[Former Member]

Hi,

I have:

• Recreated orapwdECH file om ORACLE_HOME_SOURCE 11.2.0.3;
• Discover a depreciated parameter (remote_login_password) on SPFILE of ORACLE_HOME_SOURCE and deleted from it;
• Shutdown listener and RDBMS of ORACLE_HOME_SOURCE;
• Startup RDBMS of ORACLE_HOME_SOURCE;
• Set environment variables to run DBUA.sap.sh;
• Runned DBUA.sap.sh;

On Welcome page i have pressed NEXT an got again error sp02 -0640:not connected".

I have checked DBUA log and found the error ORA-01041: internal error. hostdef extension doesn't exist

Really do not know what do do now. Maybe i can execute ORACLE DBUA as oracle note explains, to see i can found a reason for this problem. Only one thing: where is ORACLE ALERT.LOG of instance 11.2.0.4? I could not found alert.log of it. And i think it´s strange 11.2.0.4 INIT and PWD files of 11.2.0.4 have "randonic names" (ex: initDBUA4718262.ora instead of initECH.ora).

I´m upolading some files of last execution.

Regards,

Sergio

11ginstall_11204.txt.zip

11gupgrade-11204-ECH-2016_08_14-01-46-04.TXT.zip

initDBUA4718262_ora.TXT.zip

[Former Member]

Hi,

Let me summarize the pre-upgrade and preparations tasks in Linux environment. We will try to check step by step. You please confirm all the steps below. I assume that all the steps before DBUA execution have been done successfully.

Verify:

(a) You have copied all SQL*NET files from old location (11203) to new location (11204) and also has done the necessary modifications in listener.ora file (replace the entries of 11203 with 11204). Ensure, listerner.ora, sqlnet.ora and tnsnames.ora should be available under /network/admin of 11204.

• cp /oracle/ECH/11203/network/admin/*.ora /oracle/ECH/11204/network/admin/

(b) There is no special character is used in Oracle passwords.

Check again:

1. Run pre-upgrade scripts (@pre-upgrade_tasks.sql) as oraech using 11203 environment variables. The database must be up and open. Check output log of (@pre-upgrade_status.sql). You need to solve all the errors in this output.

2. Run the SQL command "select name, description from SYS.V$PARAMETER WHERE name LIKE '\_%'ESCAPE'\';"

3. If any parameters reported, you need to reset them. Shutdown and start database and check again with the above SQL command in 11203 environment.

4. STOP listener 11203.

5. Open a new session, logon as oraech using the normal 11203 environment and ensure the DB is up and open.

6. Set the old and new environment again in the same session to be sure before running DBUA.

• setenv ORACLE_HOME_SOURCE /oracle/ECH/112_64
• setevn ORACLE_HOME_TARGET /oracle/ECH/11204

7. If everything is OK, could you try to run DBUA in query mode?

• cd $ORACLE_HOME_TARGET/sap/ora_upgrade/post_upgrade/
• setenv DISPLAY <hostname>:0.0
• xclock
• ./dbua.sap.sh -q

Please paste the output of the above DBUA run in query mode here. it is useful for us to verify that the environment is correct. Also ensure that you have granted the following access.

           chmod -R 755 /oracle/ECH/11203

           chmod -R 755 /oracle/ECH/11204

I also see in your SQL trace, the database is trying to startup with wrong pfile

show sqlprompt

set sqlprompt 'SQL>'

startup nomount pfile='/oracle/ECH/11204/dbs/initDBUA4718262.ora';

set heading off

set timing off

If we confirm that all environment variable is set correctly for the upgrade, then we will analyse it further.

Regards,

Ganesan

Message was edited by: K GANESAN

[Former Member]

Hi,

Before doing, my previous suggestion, could you please backup and remove the file "lkECH" from 11203/dbs location? It seems that it is locked in /dbs location.

-rw-r-xr-x 1 oraech dba        29947 Nov  4  2015 initECH.sap

-rw-r--r-- 1 oraech dba         2851 May 15  2009 init.ora

-rw-r----- 1 oraech dba           24 Nov  4  2015 lkECH

-rw-r----- 1 oraech dba         2560 Nov 11  2015 orapwECH

-rw-r--r-- 1 oraech dba         1867 Jun 27 23:00 sapECH.ora

Regards,

Ganesan

[Former Member]

Hi Ganezan,

I have followed the steps you have instructed me.

- Copy $ORACLE_HOME/network/admin" files to $NEW_ORACLE_HOME/network/admin;

- Removed lkECH;

- Changed permissions of ORACLE_HOMES;

This is the ouput of "./dbua.sap.sh -q"

[oraech@srv-sgecx-db post_upgrade]$ ./dbua.sap.sh -q

.

. Oracle Database Upgrade

. Version 11.2.0.4.0 Release Date 2013-10-08 Patch Level 009 (rel)

. Copyright (c) Oracle Corporation 2010,2011. All Rights Reserved.

. SAP note 1431793

. Oracle Database Release: 11.2.0.4.0

.

. Host     : srv-sgecx-db

. Platform : linux_x86_64 (64-bit)

. Date     : 2016_08_15 20:54:42

. User     : oraech

. Log file : /oracle/ECH/11gupgrade-11204-ECH-2016_08_15-20-54-42.log

.

.

. Performing Pre-Upgrade checks ...

.

. (OK) - Source Oracle home directory /oracle/ECH/112_64 exists.

. (OK) - Target Oracle home directory /oracle/ECH/11204 exists.

. (OK) - Source release for database upgrade was derived from source Oracle home                                                      directory name.

. (OK) - /etc/oratab exists.

. (WARNING) - There is no SAP Bundle Patch (SBP) installed in /oracle/ECH/112_64                                          

. (OK) - An SAP Bundle Patch is installed in in /oracle/ECH/11204.

. SBP Type            SBP

. SBP Info            SBP 11.2.0.4.160419 201605

. SBP Date            201605

. SBP Version #1      11.2.0.4.160419

. SBP Version #2      11204160419

. SBP directory name  SBP_11204160419_201605

. SBP directory path  /oracle/ECH/11204/sapbundle/SBP_11204160419_201605

. SBP catsbp path     /oracle/ECH/11204/sapbundle/SBP_11204160419_201605/catsbp.sql

. (OK) - File /oracle/ECH/11204/network/admin/tnsnames.ora already exists.

. (OK) - File /oracle/ECH/11204/network/admin/sqlnet.ora already exists.

. (OK) - File /oracle/ECH/11204/network/admin/listener.ora already exists.

. (OK) - File /oracle/ECH/11204/dbs/initECH.sap already exists.

. (OK) - File /oracle/ECH/11204/lib/libobk.so already exists.

. (OK) - Source Release checked: 11.2.0.3.0

. (OK) - Target Release checked: 11.2.0.4.0

.

. Pre-Upgrade checks completed.

.

. (INFO) - Post-upgrade script 'set_compatible.sql' will not be executed because                                                        the database is already running from an 11.2 release.

.

. dbua.sap.sh Settings

.

. Script log file     : /oracle/ECH/11gupgrade-11204-ECH-2016_08_15-20-54-42.log

. Script command line : -q

. Query mode          : enabled

. Verbose mode        : disabled

. Debug mode          : disabled

.

. Environment Settings

.

. ORACLE_HOME_SRC     : /oracle/ECH/112_64

. ORACLE_HOME_TGT     : /oracle/ECH/11204

. ORACLE_BASE         : /oracle

.

. DB_SID              : ECH

. ORACLE_SID          : ECH

.

. ORACLE_HOME         : /oracle/ECH/112_64

. DISPLAY             : 10.1.4.175:0.0

.

. Directory Settings

.

. Current directory   : /oracle/ECH/11204/sap/ora_upgrade/post_upgrade

. Upgrade scripts     : /oracle/ECH/11204/sap/ora_upgrade/post_upgrade

.

. Database information

.

. Database Name                          : ECH

. Database type                          : Single instance

. Database Instance                      : ECH

.

. Upgrade Settings

.

. Upgrade type                           : Patch Set Release Upgrade

.                                          11.2.0.3.0 -> 11.2.0.4.0

.

. Source Oracle home                     : /oracle/ECH/112_64

. Source Release (from ORACLE_HOME_SRC)  : 11.2.0.X

. Source Release (verified with SQL*Plus): 11.2.0.3.0

.

. Target Oracle home                     : /oracle/ECH/11204

. Target Release (from script           😞 11.2.0.4

. Target Release (verified with SQL*Plus): 11.2.0.4.0

.

. SAP Bundle Patch Status

.

. SBP installed?                         : no

. (WARNING) - There is no SAP Bundle Patch (SBP) installed in the source Oracle                                                                                                   home.

. SBP installed?                         : yes, SBP 11.2.0.4.160419 201605

.

. DBUA Settings

.

. DBUA log directory   : /oracle/cfgtoollogs/dbua/ECH/upgrade4

. DBUA silent mode     : disabled

. TSTZ upgrade method  : DBUA

. Use of custom scripts: enabled

. DIAGNOSTIC_DEST      : /oracle/ECH/saptrace

. AUDIT_FILE_DEST      : /oracle/ECH/saptrace/audit

. Listener name        : LISTENER (Default)

.                        ADR_BASE_LISTENER=/oracle/ECH/saptrace

. Enterprise Manager   : -emConfiguration NONE

.

. Custom Scripts

.

. Script directory : /oracle/ECH/11204/sap/ora_upgrade/post_upgrade

. post_upgrade_tasks.sql

. set_remote_os_authent.sql

. set_compatible.sql - is not run because you upgrade the database from 11.2.0.X                                                                                                  .

. sapuprof_profile.sql

.

. DBUA Command line

.

. /oracle/ECH/11204/bin/dbua  -sid ECH -oracleBase /oracle -oracleHome /oracle/ECH/

  112_64 -recompile_invalid_objects true  -emConfiguration NONE -upgradeTimezone 

  -postUpgradeScripts /oracle/ECH/11204/sap/ora_upgrade/post_upgrade/post_upgrade_tasks.sql,

   /oracle/ECH/11204/sap/ora_upgrade/post_upgrade/set_remote_os_authent.sql,

   /oracle/ECH/11204/sap/ora_upgrade/post_upgrade/sapuprof_profile.sql | 

   tee /oracle/ECH/.11gupgrade_11204.dbua

.

.

. Post-Upgrade Settings

.

.

. The log file of dbua.sap.sh is /oracle/ECH/11gupgrade-11204-ECH-2016_08_15-20-54-42.log54-42.log

. Exiting because dbua.sap.sh was started in query mode.

[oraech@srv-sgecx-db post_upgrade]$

Do you think i need to do anything before run DBUA.SAP.SH now?

These are the variables of session:

[oraech@srv-sgecx-db post_upgrade]$

[oraech@srv-sgecx-db post_upgrade]$ env

REMOTEHOST=srv-cix-xa06.tcu.gov.br

DIR_LIBRARY=/usr/sap/ECH/SYS/exe/run

HOSTNAME=srv-sgecx-db

dbms_type=ORA

dbs_ora_tnsname=ECH

SHELL=/bin/csh

TERM=xterm

HOST=srv-sgecx-db

SSH_CLIENT=10.2.80.6 58366 22

SAPEXE=/usr/sap/ECH/SYS/exe/run

NLS_LANG=AMERICAN_AMERICA.UTF8

RSEC_SSFS_DATAPATH=/usr/sap/ECH/SYS/global/security/rsecssfs/data

OLDPWD=/oracle/ECH

QTDIR=/usr/lib64/qt-3.3

QTINC=/usr/lib64/qt-3.3/include

SSH_TTY=/dev/pts/1

THREAD=NOPS

USER=oraech

GROUP=dba

LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.tbz=01;31:*.tbz2=01;31:*.bz=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.axa=01;36:*.oga=01;36:*.spx=01;36:*.xspf=01;36:

LD_LIBRARY_PATH=/usr/sap/ECH/SYS/exe/run:/usr/sap/ECH/SYS/exe/uc/linuxx86_64:/oracle/ECH/112_64/lib

ORACLE_SID=ECH

HOSTTYPE=x86_64-linux

ORACLE_BASE=/oracle

dbs_ora_schema=SAPSR3

PATH=/oracle/ECH/112_64/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/sap/ECH/SYS/exe/uc/linuxx86_64:/usr/sap/ECH/SYS/exe/run:/oracle/ECH:.

MAIL=/var/spool/mail/oraech

rsdb_ssfs_connect=1

PWD=/oracle/ECH/11204/sap/ora_upgrade/post_upgrade

SAPDATA_HOME=/oracle/ECH

DB_SID=ECH

LANG=en_US.UTF-8

SAPSYSTEMNAME=ECH

RSEC_SSFS_KEYPATH=/usr/sap/ECH/SYS/global/security/rsecssfs/key

SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass

HOME=/oracle/ECH

SHLVL=3

OSTYPE=linux

VENDOR=unknown

LOGNAME=oraech

MACHTYPE=x86_64

CVS_RSH=ssh

QTLIB=/usr/lib64/qt-3.3/lib

SSH_CONNECTION=10.2.80.6 58366 10.1.2.245 22

LESSOPEN=||/usr/bin/lesspipe.sh %s

DISPLAY=10.1.4.175:0.0

ORACLE_HOME_TGT=/oracle/ECH/11204

ORACLE_HOME=/oracle/ECH/112_64

G_BROKEN_FILENAMES=1

ORACLE_HOME_SRC=/oracle/ECH/112_64

_=/bin/env

[oraech@srv-sgecx-db post_upgrade]$

Regards,

Sergio

[Former Member]

Hi,

Uploading log files before upgrade

Sergio

PRE_UPGRADE_TASKS_LOG.TXT.zip

PRE_UPGRADE_STATUS_LOG.TXT.zip

[Former Member]

Hi,

I don't see any errors related to environment settings for the upgrade except a warning message for SBP on the source database and I don't think it will cause a problem to start DBUA. Now, could you try to run the DBUA in upgrade mode? Try to check the followings additionally.

Check database must be available with 11203 environment.

1. Check again for "lkECH" file in both /dbs directory. (this might be the main cause for the error (ORA-01041)

2. Check for invalid objects in the source system with command "select count(*) from dba_objects where status='INVALID';" it should not return any result. If you have any invalid objects reported, try to run "@utlrp.sql" script, you can see it in 11203/RDBMS/ADMIN folder and check for invalid objects again.

3. Run the following scripts from PWD "/11204/sap/ora_upgrade/pre-upgrade"

     @pre_upgrade_checks.sql

     @pre_upgrade_tasks.sql    

     @pre_upgrade_status.sql

All errors and necessary warnings are to be rectified before starting DBUA.

4. Now, you can run "./dbua.sap.sh" from PWD "$ORACLE_HOME_TGT/sap/ora_upgrade/post_upgrade"

I hope this time DBUA will run normally. If you still have any new errors, please post here.

Good luck.

Regards,

Ganesan

[Former Member]

Hi,

I don't see any errors in the pre-upgrade status. This task was run on 11.08. I assume that there were no changes in database objects afterwards. I think you can go with the DBUA run and post if you have any errors reported.

Regards,

Ganesan

[Former Member]

Sorry,

When i first oppened this discussion, i mencioned XYZ in the posts.

I do not preview i need to provide detailed information about this environment, wich real name is "ECH";

So please, when you read in this discussion "XYZ", please understand "ECH"

Regards,

Sergio

[Former Member]

Re: SAP upgrade to 11.2.0.4 - DBUA results on error "sp02 -0640:not connected".

Sergio Coutinho Aug 12, 2016 2:19 PM (in response to K GANESAN)

Hi K.Ganezan,

I will proceed with this action plan you suggested me.

But before it, i would like to show you DBS directory of  11.2.0.3 and 11.2.0.4 releases:

A) This is DBS directory of actual release 11.2.0.3 (112_64 - ORACLE_HOME_SOURCE):

-rw-rw---- 1 oraech dba         1544 Aug 11 18:51 hc_ECH.dat

-rw-r----- 1 root   sapinst      641 Nov  4  2015 initECH.1.ora

-rw-r-x--- 1 root   sapinst     1528 Nov  4  2015 initECH.2.ora

-rw-r-x--- 1 root   sapinst     1668 Nov  4  2015 initECH.3.ora

-rw-r----- 1 root   sapinst      641 Nov  4  2015 initECH.4.ora

-rw-r-x--- 1 root   sapinst     1528 Nov  4  2015 initECH.5.ora

-rw-r-x--- 1 root   sapinst     1668 Nov  4  2015 initECH.6.ora

-rw-r----- 1 root   sapinst      641 Nov  4  2015 initECH.7.ora

-rw-r-x--- 1 root   sapinst     1528 Nov  4  2015 initECH.8.ora

-rw-r-xr-x 1 oraech dba         1867 Jun 27 23:00 initECH.ora

-rw-r-x--- 1 root   sapinst     1668 Nov  4  2015 initECH.ora.SAPINST-ORIG

-rw-r-xr-x 1 oraech dba        29947 Nov  4  2015 initECH.sap

-rw-r--r-- 1 oraech dba         2851 May 15  2009 init.ora

-rw-r----- 1 oraech dba           24 Nov  4  2015 lkECH

-rw-r----- 1 oraech dba         2560 Nov 11  2015 orapwECH

-rw-r--r-- 1 oraech dba         1867 Jun 27 23:00 sapECH.ora

-rw-r--r-- 1 oraech dba         1867 Jun 27 23:00 sapECH.ora.bkp2

-rw-r----- 1 oraech dba     24559616 Jun 28 01:44 snapcf_ECH.f

-rw-r----- 1 oraech dba         4608 Aug 11 18:45 spfileECH.ora

-rw-r----- 1 oraech dba         4608 Jul  2 12:47 spfileECH.ora.bkp2

B) This is DBS directory of future release 11.2.0.4 (ORACLE_HOME_TARGET):

drwxr-x--- 2 oraech dba  4096 Aug  8 18:37 core_8222

<< many core_NNNN directories >>

drwxr-x--- 2 oraech dba  4096 Aug  8 18:54 core_9972

-rw-r----- 1 oraech dba   143 Aug 11 00:01 initDBUA0153361.ora

-rw-r----- 1 oraech dba   143 Aug 11 00:02 initDBUA0253120.ora

-rw-r----- 1 oraech dba   143 Aug 11 19:05 initDBUA0507753.ora

-rw-r----- 1 oraech dba   143 Aug 11 02:09 initDBUA0909869.ora

-rw-r----- 1 oraech dba   143 Aug 10 23:10 initDBUA1046410.ora

-rw-r----- 1 oraech dba   143 Aug 11 02:12 initDBUA1212960.ora

-rw-r----- 1 oraech dba   143 Aug 11 02:12 initDBUA1233265.ora

-rw-r----- 1 oraech dba   143 Aug 11 00:17 initDBUA1701703.ora

-rw-r----- 1 oraech dba   143 Aug 11 20:17 initDBUA1718394.ora

-rw-r----- 1 oraech dba   143 Aug 11 20:17 initDBUA1724787.ora

-rw-r----- 1 oraech dba   143 Aug 10 23:18 initDBUA1804938.ora

-rw-r----- 1 oraech dba   143 Aug 12 01:19 initDBUA1956290.ora

-rw-r----- 1 oraech dba   143 Aug 11 20:21 initDBUA2113391.ora

-rw-r----- 1 oraech dba   143 Aug 11 21:24 initDBUA2403690.ora

-rw-r----- 1 oraech dba   143 Aug 11 20:24 initDBUA2437775.ora

-rw-r----- 1 oraech dba   143 Aug 11 21:25 initDBUA2509925.ora

-rw-r----- 1 oraech dba   143 Aug 11 20:25 initDBUA2544446.ora

-rw-r----- 1 oraech dba   143 Aug 11 20:25 initDBUA2550492.ora

-rw-r----- 1 oraech dba   143 Aug 11 20:26 initDBUA2642116.ora

-rw-r-xr-x 1 oraech dba 29947 Nov  4  2015 initECH.sap

-rw-r--r-- 1 oraech dba  2851 May 15  2009 init.ora

-rw-r----- 1 oraech dba  1536 Aug 11 21:25 OLD_orapwDBUA2509925

-rw-r----- 1 oraech dba  1536 Aug 11 00:01 orapwDBUA0153361

-rw-r----- 1 oraech dba  1536 Aug 11 00:02 orapwDBUA0253120

-rw-r----- 1 oraech dba  1536 Aug 11 19:05 orapwDBUA0507753

-rw-r----- 1 oraech dba  1536 Aug 11 02:09 orapwDBUA0909869

-rw-r----- 1 oraech dba  1536 Aug 10 23:10 orapwDBUA1046410

-rw-r----- 1 oraech dba  1536 Aug 11 02:12 orapwDBUA1212960

-rw-r----- 1 oraech dba  1536 Aug 11 02:12 orapwDBUA1233265

-rw-r----- 1 oraech dba  1536 Aug 11 00:17 orapwDBUA1701703

-rw-r----- 1 oraech dba  1536 Aug 11 20:17 orapwDBUA1718394

-rw-r----- 1 oraech dba  1536 Aug 11 20:17 orapwDBUA1724787

-rw-r----- 1 oraech dba  1536 Aug 10 23:18 orapwDBUA1804938

-rw-r----- 1 oraech dba  1536 Aug 12 01:19 orapwDBUA1956290

-rw-r----- 1 oraech dba  1536 Aug 11 20:21 orapwDBUA2113391

-rw-r----- 1 oraech dba  1536 Aug 11 21:24 orapwDBUA2403690

-rw-r----- 1 oraech dba  1536 Aug 11 20:24 orapwDBUA2437775

-rw-r----- 1 oraech dba  5120 Aug 12 01:19 orapwDBUA2509925

-rw-r----- 1 oraech dba  1536 Aug 11 20:25 orapwDBUA2544446

-rw-r----- 1 oraech dba  1536 Aug 11 20:25 orapwDBUA2550492

-rw-r----- 1 oraech dba  1536 Aug 11 20:26 orapwDBUA2642116

So, i will :

1. Recreate PWD file on actual ORACLE_HOME_SOURCE 11.2.0.3 (orapwECH);
2. Purge all  "initDBUA*.*" and "orapwDBUA*" on ORACLE_HOME_TARGET 11.2.0.4;
3. Change permissions on ORACLE_HOME_SOURCE and ORACLE_HOME_TARGET;

           chmod -R 755 /oracle/ECH/11203

           chmod -R 755 /oracle/ECH/11204

Could i proceed with this action plan? We have an window maintenance, so i am afraid i need to wait sometime before could apply it.

You have mentioned that it´s possible to upgrade it "manually". Could you show me some note or instruction about how to do it?

I have found a metalink note called "Complete Checklist for out-of-Place Manual Upgrade from Previous 11.2.0.N Version to the Latest 11.2.0.N Patchset (Doc ID 1276368.1)". Is something like that you could provide to me?

Best regards, and thank you for your help!

Sergio

[Former Member]

Hi,

I hope after having done with the three steps you mentioned above, DBUA should work fine. Please take backup of PWD file before you recreat it again..In case, if you still have logon error, then the final option is "manual" upgrade. Unfortunately i couldn't open the meta link document at the moment... You can find many guidelines on manual upgrade if you google it...Good Luck...

Regards,

Ganesan

[Former Member]

Hi K GANESAN ,

Thanks for your orientation ! 

I will try again, and don´t  worry about metalink access.

My last doubt before doing the action plan. It´s about "manual upgrade": can i assume that i can do it only with metalink notes or in this "manual update I need to do some SAP aditional command ? Here i´m only talking about the "DBUA.sap.sh" execution script, ok?

Best regards,

Sergio

[JamesZ]

Hi Sergio,

Manual upgrade is only recommended in emergency, because there will be more manual scripts than dbua. SAP integrate lots of scripts into dbua, thus avoid manual execution.

If this is your testing system, manual upgrade is not recommended, because once you use manual upgrade, it means you will proceed the same to the production system.

Don't worry, the more errors during testing, the better for production system.

Best regards,
James

[Former Member]

Hi,

I think you already installed Oracle target version as a SAP relevant installation. So, for me, there should be no special scripts for SAP in DBUA. I dont find any document to justify about SAP scripts in DBUA. In every version, you can see preupgrade, upgrade and post upgrade scripts. For sure, in our CRM production system, we upgraded oracle manually in Windows platform while we used DBUA in DEV & QAS last year. I dont have any issues after the manual upgrade.

As suggested by James, you can try to do all possibilities to do the upgrade using DBUA, before going with manual upgrade as a last option. If you have oracle DBA at your site, you can also discuss with them. If you have any more query, feel free to update us.

Regards,

Ganesan

[Former Member]

Hi James,

Thanks for the feedback.

My $ORACLE_SID is seted with value "XYZ".

May be "initDBUA0507753.ora" is an strange name, but i saw that DBUA have generated both PWD and INIT with this name in TARGET ORACLE HOME dbs directory.

Cause this is the  first time i am updating this SAP environment, i really doesn´t know if this issue is common on SAP oracle database upgrades.

Best regards,

Sergio

[JamesZ]

Hi Sergio,

I did such kind of upgrade times, but never meet this issue. The upgrade script is stable, so something wrong is in your environment.

Please attach the dbua log, I would like to review it.

I just notice that, you mentioned:

----------------------------------------------------------------------------------------------------------------

cd $ORACLE_HOME

    sqlplus / as sysdba

    SQL> startup nomount pfile='/oracle/ECH/11204/dbs/initDBUA0507753.ora'

      ORA-01041: internal error. hostdef extension doesn't exist

-----------------------------------------------------------------------------------------------------------------------------

'/oracle/ECH/11204/dbs/initDBUA0507753.ora'???? what is ECH here? the patch is supposed to
be '/oracle/XYZ/....

Best regards,


James

[Former Member]

Hi James,

I am providing the LOGs of DBUA.

Best regards,

Sergio

sqls_log.TXT.zip

trace_log.TXT.zip

[JamesZ]

Hi Sergio,

I found the following command in the log:

------------------------------------------------------------

Execing SQLPLUS/SVRMGR process
-----------------------------------------------------------------------

So the question is are you using oracle RAC?

If you are not using RAC, but using single instance, please try to restart dbua by just setting:

export ORACLE_HOME_SRC=/oracle/XYZ/112_64

export ORACLE_HOME_TGT=/oracle/XYZ/11204

As mentioned in the guide. Also as mentioned in the guide, you need to stop oracle listener before starting dbua.

Are you referring to this guide?

https://websmp106.sap-ag.de/~sapidb/011000358700000333942010E/GUIDE_UX_ORA_UPGR_112_400.pdf

Best regards,

James

[Former Member]

Hi James,

My environment is a single instance, and i have set the variables as you have explained.

And i have stopped listener before execute DBUA.

Yes. i am using the guide you have asked me: Database Upgrade Guide Upgrade to Oracle Database 11g Release 2 (11.2): UNIX For Oracle Patch Set Release 11.2.0.4

Regards,

Sergio

[JamesZ]

Hi Sergio,

In this case, please recreate password file as mentioned by K GANESAN

You need to stop upgrade and switch bad to "old" oracle environment to recreate password file.

Best regard,
James

[Former Member]

Hi James,

I have now  renamed and created password file. as K GANESAN.

But every time i call  dbua.sap.sh,  the program create a new PWD and INIT file on "$ORACLE_HOME_TARGET/dbs" directory

Example:

A) I have renamed and recriated a new PWD file

-rw-r----- 1 oraech dba   143 Aug 11 21:25 initDBUA2509925.ora

-rw-r----- 1 oraech dba  1536 Aug 11 21:25 OLD_orapwDBUA2509925

-rw-r----- 1 oraech dba  5120 Aug 12 01:19 orapwDBUA2509925

B) I have called DBUA, but  new PWD and INIT file are created and used in migration

-rw-r----- 1 oraech dba   143 Aug 11 21:25 initDBUA2509925.ora

-rw-r----- 1 oraech dba  1536 Aug 11 21:25 OLD_orapwDBUA2509925

-rw-r----- 1 oraech dba  5120 Aug 12 01:19 orapwDBUA2509925

-rw-r----- 1 oraech dba   143 Aug 12 01:19 initDBUA1956290.ora

-rw-r----- 1 oraech dba  1536 Aug 12 01:19 orapwDBUA1956290

I think that "1956290" are second and millisecond of current date (Aug 12 01:19).

Is it correct ?  Are new files created every DBUA run ?

I do not know if it´s common DBUA act like it on migrations.

Regards,

Sergio

[Former Member]

Hi,

I just mentioned that (DBUA) password files is not a good one. You need to create the password file for the existing system, the file name will be "pwd<SID>.ora" in dbs directory. When you run DBUA, it will create a copy of password file from the existing system. Also check, OS user executing DBUA has all access rights on Oracle binary. (I had the same issue last year during upgrade in Windows platform, and I solved it by granting full control to executing user on the Oracle directory). If you still have access issues, let us know, you still have a way to upgrade it "Manually".

Regards,

Ganesan

[Former Member]

Hi,

I have read ORACLE METALINK note:  DBUA Fails With Error "SP2-0640 Not Connected" (Doc ID 1384814.1)

The symbolic link in "new" $ORACLE_HOME/lib appears to be OK:

         libodm11.so -> libodmd11.so

There is an aditional check : "If any of the environment variables are pointing to source , i.e timezone". and then the note explain about  "check whether all the environmental variables are pointing to the target".

I really doesn´t understand "TIMEZONE pointing to SOURCE". Could someone please show me an example?

Best regards,

Sergio

[JamesZ]

Hi Sergio,

----------------------------------------------------------------------------------------------------------------

cd $ORACLE_HOME

    sqlplus / as sysdba

    SQL> startup nomount pfile='/oracle/ECH/11204/dbs/initDBUA0507753.ora'

      ORA-01041: internal error. hostdef extension doesn't exist

-----------------------------------------------------------------------------------------------------------------------------

It is interesting dbua use '/oracle/ECH/11204/dbs/initDBUA0507753.ora' profile to start instance, usually pfile is named with format init<DBSID>.ora

What is your ORACLE_SID? Is DBUA2642116?

Please attach the oracle alert log as well.

Best regards,
James

[Former Member]

Hi,

I have done the following test suggested by K GANESAN

I have added the following line to sqlnet.ora :     SQLNET.AUTHENTICATION_SERVICES = (NONE)

After it, i have repeated DBUA :  ./dbua.sap.sh

I have noticed that message error changed

FROM:

Initializing Database Options with  for dummy

sid=DBUA2642116 using initfile=/oracle/ECH/11204/dbs/initDBUA2642116.ora using pwdfile=/oracle/ECH/11204/dbs/orapwDBUA2642116

ORA-01041: internal error. hostdef extension doesn't exist

TO:

Initializing Database Options with  for dummy

sid=DBUA2642116 using initfile=/oracle/ECH/11204/dbs/initDBUA2642116.ora using pwdfile=/oracle/ECH/11204/dbs/orapwDBUA2642116

ORA-01017: invalid username/password; logon denied

Best regards,

Sergio

[Former Member]

Hi,

It seems that your password file (pwdfile=/oracle/ECH/11204/dbs/orapwDBUA2642116)is not a good one. You need to re-create password file using ORAPWD utility. Try to follow the procedure mentioned in the link. Rename the present password file before creating a new one with the same name. After creating the new password file, DBUA should work. Hope this can help you.

Creating and Maintaining a Password File

Regards,

Ganesan

[Former Member]

Hi,

I´m sorry for the delay to update this discussion.

I have checked all the previous steps of upgrade and checked the questions done in this discussion:

• I have checked system time in the OS level and i´m think it´s ok;
• The correct startup command described on DBUA is " startup nomount pfile='/oracle/XYZ/11204/dbs/initDBUA0507753.ora' ";
• I have checked SQLNET.ORA and changed it adding the following line "SQLNET.AUTHENTICATION_SERVICES=NONE";
• My database is up and running on old ORACLE_HOME /oracle/XYZ/112_64. I have stopped listener services in old ORACLE_HOME, as SAP note explained;
• ORACLE_HOME is set to /oracle/XYZ/112_64 before DBUA;

I have done a simple test, seting ORACLE_HOME to /oracle/XYZ/11204. So:

   cd $ORACLE_HOME

    sqlplus / as sysdba

    SQL> startup nomount pfile='/oracle/ECH/11204/dbs/initDBUA0507753.ora'

      ORA-01041: internal error. hostdef extension doesn't exist

I really do not know if is an ORACLE specific problem or is an DBUA-SAP insue.

Do you think it´s something related to previous step of ORACLE 11.2.0.4 install?

Best regards,

Sergio

[manish_singh13]

Hi Sergio,

Could you please confirm below:

1. Your database is up and running from old Oracle Home /oracle/XYZ/112_64

2. You haven't set ORACLE_HOME to /oracle/XYZ/11204 before running this dbua.

3. You don't need to set IHRDBMS & OHRDBMS environment variable. Only ORACLE_HOME_TGT & ORACLE_HOME_SRC are sufficient to run dbua

Thanks,

Manish

[Former Member]

Hi,

It seems that the error is "ORA-01041". Could you check what is the parameter "SQLNET.AUTHENTICATION_SERVICES" value in "sqlnet.ora" file? Could you try to set this parameter to "NONE" and try to restart DBUA again?

Regards,

Ganesan

[JamesZ]

Hi Sergio,

The error is caused by startup nomount:

startup nomount pfile='/oracle/XYZ/11204/dbs/init

The pasted command is not complete, can you show us with the complete one?

Please check which pfile is used to start instance.

Best regards,
James