Problem in start of SAP on AIX

[Former Member]

Hello Gurus,

We are facing problem in our test server.

lpar1:prdadm 1> ulimit -a

time(seconds) unlimited

file(blocks) unlimited

data(kbytes) unlimited

stack(kbytes) unlimited

memory(kbytes) 32768

coredump(blocks) unlimited

nofiles(descriptors) 2000

lpar1:prdadm 2> su - oraprd

oraprd's Password:

[YOU HAVE NEW MAIL]

lpar1:oraprd 1> ulimit -a

time(seconds) unlimited

file(blocks) unlimited

data(kbytes) unlimited

stack(kbytes) unlimited

memory(kbytes) 32768

coredump(blocks) unlimited

nofiles(descriptors) 2000

I am attaching the log for your reference (more startdb.log)

lpar1:oraprd 2> su - prdadm

prdadm's Password:

lpar1:prdadm 1> startsap

Checking PRD Database

-

---

ABAP Database is not available via R3trans

Starting SAP-Collector Daemon

-

---

23:01:56 16.08.2009 LOG: Effective User Id is root

***********************************************************************

• This is Saposcol Version COLL 20.95 700 - AIX v11.00 5L-64 bit 070920

• Usage: saposcol -l: Start OS Collector

• saposcol -k: Stop OS Collector

• saposcol -d: OS Collector Dialog Mode

• saposcol -s: OS Collector Status

• The OS Collector (PID 426070) is already running .....

************************************************************************

saposcol already running

Running /usr/sap/PRD/SYS/exe/run/startdb

Trying to start PRD database ...

Log file: /home/prdadm/startdb.log

/usr/sap/PRD/SYS/exe/run/startdb: Terminating with error code 12

DB startup failed

lpar1:prdadm 2> more startdb.log

-

---

Sun Aug 16 23:01:56 CDT 2009

LOGFILE FOR STARTING ORACLE

Trying to start PRD database ...

-

---

Sun Aug 16 23:01:56 CDT 2009

checking required environment variables

ORACLE_HOME is >/oracle/PRD/102_64<

ORACLE_SID is >PRD<

-

---

Sun Aug 16 23:01:56 CDT 2009

check initora

-

---

Sun Aug 16 23:01:56 CDT 2009

check initora

-

---

Sun Aug 16 23:01:56 CDT 2009

checking V2 connect

TNS Ping Utility for IBM/AIX RISC System/6000: Version 10.2.0.1.0 - Production on 16-AUG-2009 23:01:56

Copyright (c) 1997, 2005, Oracle. All rights reserved.

Used parameter files:

/usr/sap/PRD/SYS/profile/oracle/sqlnet.ora

Used TNSNAMES adapter to resolve the alias

Attempting to contact (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (COMMUNITY = SAP.WORLD) (PROTOCOL = TCP) (HOST = lpar1) (PORT = 1527)))

(CONNECT_DATA = (SID = PRD) (GLOBAL_NAME = PRD.WORLD)))

OK (0 msec)

tnsping: V2 connect to PRD

-

---

Sun Aug 16 23:01:56 CDT 2009

Connect to the database to check the database state:

R3trans: connect check finished with return code: 12

Database not available

-

---

Sun Aug 16 23:01:56 CDT 2009

Shutdown database

First trying to shutdown the database - May be,

the database is in the nomount or mount state

-

---

Sun Aug 16 23:01:56 CDT 2009

starting database

SQL*Plus: Release 10.2.0.1.0 - Production on Sun Aug 16 23:01:56 2009

Copyright (c) 1982, 2005, Oracle. All rights reserved.

Connected to an idle instance.

ORA-10997: another startup/shutdown operation of this instance inprogress

ORA-09967: unable to create or open lock file

IBM AIX RISC System/6000 Error: 13: Permission denied

Disconnected

-

---

Sun Aug 16 23:01:57 CDT 2009

Connect to the database to verify, that the database is now open

R3trans check finished with return code: 12

• ERROR: Startup of database failed

Notify Database Administrator.

/usr/sap/PRD/SYS/exe/run/startdb: Terminating with error code 12

Pls guide us to resolve the problem

[Former Member]

This message was moderated.

[Former Member]

hello markus

many thanks for your reply

I am pasting the content of limits file

pls guide me the rectification

Thanks & Regards

Shishir

[markus_doehr2]

I must admit I'm out of ideas - everything seems to be fine.

What you can try is to log off completely, logon again and see if that helps (don't know if the limits are somehow "kept").

Markus

[Former Member]

lpar1:/etc> cd security

lpar1:/etc/security> cat limits

*

• Sizes are in multiples of 512 byte blocks, CPU time is in seconds

*

• fsize - soft file size in blocks

• core - soft core file size in blocks

• cpu - soft per process CPU time limit in seconds

• data - soft data segment size in blocks

• stack - soft stack segment size in blocks

• rss - soft real memory usage in blocks

• nofiles - soft file descriptor limit

• fsize_hard - hard file size in blocks

• core_hard - hard core file size in blocks

• cpu_hard - hard per process CPU time limit in seconds

• data_hard - hard data segment size in blocks

• stack_hard - hard stack segment size in blocks

• rss_hard - hard real memory usage in blocks

• nofiles_hard - hard file descriptor limit

*

• The following table contains the default hard values if the

• hard values are not explicitly defined:

*

• Attribute Value

• ========== ============

• fsize_hard set to fsize

• cpu_hard set to cpu

• core_hard -1

• data_hard -1

• stack_hard 8388608

• rss_hard -1

• nofiles_hard -1

*

• NOTE: A value of -1 implies "unlimited"

*

default:

fsize = 2097151

core = 2097151

cpu = -1

data = 262144

rss = 65536

stack = 65536

nofiles = 2000

root:

fsize = -1

data = -1

stack = -1

daemon:

bin:

sys:

adm:

uucp:

guest:

nobody:

lpd:

oraprd:

data = -1

fsize = -1

stack = -1

core = -1

fsize_hard = -1

cpu_hard = -1

stack_hard = -1

core_hard = -1

prdadm:

fsize = -1

data = -1

stack = -1

core = -1

fsize_hard = -1

data_hard = -1

stack_hard = -1

core_hard = -1

cpu_hard = -1

[Former Member]

you can set the all the default values to -1 to get these values as indefinite:

default:

fsize = 2097151

core = 2097151

cpu = -1

data = 262144

rss = 65536

stack = 65536

nofiles = 2000

set all these to -1.

Regards,

Priya

[Former Member]

Many Thanks for the reply markus

lpar1:/> su - prdadm

lpar1:prdadm 1> ulimit -m unlimited

lpar1:prdadm 2> ulimit -a

time(seconds) unlimited

file(blocks) unlimited

data(kbytes) unlimited

stack(kbytes) unlimited

memory(kbytes) 32768

coredump(blocks) unlimited

nofiles(descriptors) 2000

lpar1:prdadm 3> su - oraprd

oraprd's Password:

[YOU HAVE NEW MAIL]

lpar1:oraprd 1> ulimit -a

time(seconds) unlimited

file(blocks) unlimited

data(kbytes) unlimited

stack(kbytes) unlimited

memory(kbytes) 32768

coredump(blocks) unlimited

nofiles(descriptors) 2000

lpar1:oraprd 2> ulimit -m unlimited

lpar1:oraprd 3> ulimit -a

time(seconds) unlimited

file(blocks) unlimited

data(kbytes) unlimited

stack(kbytes) unlimited

memory(kbytes) 32768

coredump(blocks) unlimited

nofiles(descriptors) 2000

I have followed but same result

Thanks

Shishir

[markus_doehr2]

What's the content of

/etc/security/limits

Markus

[Former Member]

Hello Marjan Al-Jeffry

from Root

lpar1:/> ulimit -a

time(seconds) unlimited

file(blocks) unlimited

data(kbytes) unlimited

stack(kbytes) 4194304

memory(kbytes) unlimited

coredump(blocks) 2097151

nofiles(descriptors) unlimited

from orasid

lpar1:/> su - oraprd

[YOU HAVE NEW MAIL]

lpar1:oraprd 1> ulimit -a

time(seconds) unlimited

file(blocks) unlimited

data(kbytes) unlimited

stack(kbytes) unlimited

memory(kbytes) 32768

coredump(blocks) unlimited

nofiles(descriptors) 2000

from sidadm

lpar1:oraprd 3> su - prdadm

prdadm's Password:

lpar1:prdadm 1> ulimit -a

time(seconds) unlimited

file(blocks) unlimited

data(kbytes) unlimited

stack(kbytes) unlimited

memory(kbytes) 32768

coredump(blocks) unlimited

nofiles(descriptors) 2000

lpar1:oraprd 2> sqlplus "/as sysdba"

SQL> select status from v$instance;

STATUS

-

---

OPEN

I want to increase the memory parameter in ulimit ( memory(kbytes) 32768) from both user orasid & sid adm

Thanks & regards

Shishir

[markus_doehr2]

> I want to increase the memory parameter in ulimit ( memory(kbytes) 32768) from both user orasid & sid adm

Can you set it manually?

su - ora<sid>
ulimit -s unlimited
ulimit -a

If yes, then you have to add that to the "dot"-files (.sapenv_<hostname>., .dbenv_<hostname>.)

Markus

[markus_doehr2]

Sorry, I mean of course

ulimit -m unlimited

Markus

[Former Member]

Dear Shishir Bajpai,

Can you start the db by using the sqlplus?

[Former Member]

Hello Markus

Can you guide me the way how to change the value ! we have tried through smitty

Thanks & regards

Shishir

[Former Member]

Hello Markus

Many thanks for your kind support

I have one qurey regarding this

Adapt your shell limits (see Note 323816 - User limits on AIX).

my shell limit for my server is mention below

for ora(SID)

lpar1:oraprd 1> ulimit -a

time(seconds) unlimited

file(blocks) unlimited

data(kbytes) unlimited

stack(kbytes) unlimited

memory(kbytes) 32768

coredump(blocks) unlimited

nofiles(descriptors) 2000

For (SID)adm

lpar1:prdadm 1> ulimit -a

time(seconds) unlimited

file(blocks) unlimited

data(kbytes) unlimited

stack(kbytes) unlimited

memory(kbytes) 32768

coredump(blocks) unlimited

nofiles(descriptors) 2000

Please guide me, the rectification

As per the oracle patch level I have download the patch version 10.2.0.4.0 and implement very soon

Thanks

Shishir

[markus_doehr2]

Change the "memory" limit in the shell to "unlimited".

Markus

[Former Member]

Hello Markus,

This is the problem I am facing

4 ETW000 [dbntab ,01000] ***LOG BY0=>ORA-01116: error in opening database file 6

4 ETW000 ORA-01110: data file 6: '/oracle/PRD/sapdata2/sr3_3/sr3.data3'

4 ETW000 ORA-27092: size of file exceeds file size limit of the process

4 ETW000 Additional information: 131071 101 0.146892

4 ETW000 Additional information: 282497 [dbntab#4 @ 10003]

2EETW000 sap_dext called with msgnr "1":

2EETW000 -

---

db call info -

---

2EETW000 function: db_ntab

2EETW000 fcode: NT_RDTDESCR

2EETW000 tabname: TADIR

2EETW000 len (char): 5

2EETW000 key: TADIR

2EETW000 retcode: 1

2EETW125 SQL error "1116" during "" access: "ORA-01116: error in opening database file 6

ORA-01110: data file 6: '/oracle/PRD/sapdata2/sr3_3/sr3.data3'

ORA-27092: size of file exceeds file size limit of the process

Additional information: 131071

Additional information: 282497"

4 ETW000 [dev trc ,00000] db_con_rollback (con_da={R/3,0,0},th_rollback=1,tx=0)

4 ETW000 713 0.147605

Can you guide me the rectification !

[markus_doehr2]

> 2EETW125 SQL error "1116" during "" access: "ORA-01116: error in opening database file 6

> ORA-01110: data file 6: '/oracle/PRD/sapdata2/sr3_3/sr3.data3'

> ORA-27092: size of file exceeds file size limit of the process

Adapt your shell limits (see Note 323816 - User limits on AIX).

And again: upgrade your database, 10.2.0.1 contains serious bugs which may cause data loss.

Markus

[markus_doehr2]

> SQL*Plus: Release 10.2.0.1.0 - Production on Sun Aug 16 23:01:56 2009

That database version is not supported. You need at least 10.2.0.2 or 10.2.0.4.

What did you do prior to this problem?

Markus