cancel
Showing results for 
Search instead for 
Did you mean: 

SUM cannot start SAP during EHP7 on Solaris 11

benoit-schmid
Contributor
0 Kudos

Hello,

Our SUM cannot start SAP during Execution Phase:

---

Checks after phase MAIN_TRANSEXEC/STARTSAP_TRPREACT were negative!
Last error code set: Process /usr/sap/EH7/DVEBMGS00/exe/sapcontrol exited with 2, see '/usr/sap/EH7/SUM/abap/log/SAPup.ECO' for details<br/> System start failed<br/> Earlier, validating the profile failed, see INSTANCE.OUT

---

In stack file, the following packages have been chosen by the mopz:

SAPEXEDB_27-10011854.SAR

SAPEXE_27-10011853.SAR

startsap says that the instance is started.

But it is not possible to connect to it.

After more than 10 minutes, the dispatcher runs in a non responsive mode for ever:

cat disp+work.status
9 1 disp+work
9 2 Dispatcher
9 3 12642
9 4 Request handling without progress
9 5 YELLOW
9 6 gwrd
9 7 Gateway
9 8 12655
9 9 Running
9 10 GREEN
9 -11

How should I proceed to solve this problem?

Regards,

Accepted Solutions (1)

Accepted Solutions (1)

benoit-schmid
Contributor
0 Kudos

Hello,

SAP has found the problem.

With kernel 740, it is mandatory to let ip multicast go through.

Otherwise the dispatcher won't start.

The host firewall was blocking these multicasts.

What is quite bad is that there is no logging at all when these packets are not received.

Even after increasing the debug (kill -USR2  dispatcherPID), there was no relevant info.

I have not seen any Note specifying that you should modify firewall before updating to 740.

Regards,

petrsourek
Explorer
0 Kudos

SAP Note 1931675, but to be honest I have found it thanks to you. Because if I wouldn't seen your post with multicast I wouldn't have installed the SAP (the first thing I have done was blocking the multicast).

There even was nothing in the logs o_O which would point it out...

Thank you,

Regards,

Petr Šourek

Answers (6)

Answers (6)

tariqmaqsood
Explorer
0 Kudos

I am facing a similar issue on ERP 6 EHP 7 upgrade with SAP Kernel 7.41 on AIX 7.1 FP1. In my case there is an error written in dev_disp.new:

*** ERROR => DpCheckMulticast: NiDgSendToMulticastAddrLocalCheck failed (-8)

***

*** Fatal Error

***

*** Multicast datagrams do not work properly on this host.

***

*** Multicast datagrams are needed for the server internal communication.

***

*** The server terminates now!

*** Please check note 1931675 for further information

*** DP_FATA_ERROR => DpSAPEnvInit: DpCheckMulticast failed

*** DISPATCHER EMERGENCY SHUTDOWN ***

----------------------------------------------------------------------------

We updated our AIX 7.1 to fix packs 3 to solve this issue.

----------------------------------------------------------------------------

Reagan
Advisor
Advisor
0 Kudos

Then after waiting more than 12 hours, he has replied.

Increase the size of the pool 40.

That is the reason why an OSS message should be created with all the actions taken from your end.

You can contact the SAP Support Line and ask them to an immediate action from their end.

Regards

RB

benoit-schmid
Contributor
0 Kudos

Hello Benjamin,

Reagan Benjamin wrote:

That is the reason why an OSS message should be created with all the actions taken from your end.

You can contact the SAP Support Line and ask them to an immediate action from their end.

The times that I am reporting are the SAP Support times.

How can force them for an immediate action?

I am waiting several hours and there is no news.

Regards,

benoit-schmid
Contributor
0 Kudos

Hello Benjamin,


Reagan Benjamin wrote:

That is the reason why an OSS message should be created with all the actions taken from your end.

You can contact the SAP Support Line and ask them to an immediate action from their end.

My message is in priority high and has been escalated this morning.

But I have not get any answer since 5 days.

Could you please explain me how you "ask them to an immediate action" 🙂

Regards.

Reagan
Advisor
Advisor
0 Kudos

M  *** ERROR => ThrtDatabaseEnvInit: db_init failed (4) [thrtDatabase 48]

M  *** ERROR => ThrtDatabaseEnvInit failed (4) [thxxext.c    181]

M  *** ERROR => ThCallHooks: event handler ThrtStartup for event CREATE_SHM failed (4) [thSos.c      2081]

If you have cleaned up the shared memory segments before restarting the SAP system manually then most probably the issue could be with the kernel.

Similar issues are mentioned in these SAP notes but on of them is for AIX and you are on Solaris.

1897221  - Work process restarts after you apply kernel patch

1889466  - Memory Management errors on AIX in 7.40 kernel

If possible try with a different patch level of the kernel 740 and see if that helps.

Regards

RB

benoit-schmid
Contributor
0 Kudos

Hello Benjamin,

Reagan Benjamin wrote:

If possible try with a different patch level of the kernel 740 and see if that helps.

As it is during an upgrade, I am less familiar with the procedure.

Is it sufficient to patch the "real" kernel, located in /sapmnt/$SID/exe?

Or should I also patch a Kernel stored in a subdir of /usr/sap/$SID/SUM?

Regards,

former_member206552
Active Contributor
0 Kudos

Hi

If I change the kernel myself during an EHP to a higher version i do both places myself,

both /sapmnt/SID/exe and /usr/sap/SID/SUM . just my 2c

Best Regards

Marius

benoit-schmid
Contributor
0 Kudos

Hello,

Upgrading the 740 Kernel does not solve the issue.

What are the next options to solve this problem?

Regards,

Reagan
Advisor
Advisor
0 Kudos

Benoit,

You just need to download a different patch level of kernel release 740

Download the SAPEXE.SAR and SAPEXEDB.SAR and extract them.

Remove all the files from /sapmnt/EH7/exe and /usr/sap/EH7/DVEBMGS00/exe

Put the new kernel to /sapmnt/EH7/exe and restart SAP manually.

Also consider raising an OSS message.

Regards

RB

benoit-schmid
Contributor
0 Kudos

Hello,

Reagan Benjamin wrote:

Benoit,

You just need to download a different patch level of kernel release 740

Download the SAPEXE.SAR and SAPEXEDB.SAR and extract them.

Remove all the files from /sapmnt/EH7/exe and /usr/sap/EH7/DVEBMGS00/exe

Put the new kernel to /sapmnt/EH7/exe and restart SAP manually.

Also consider raising an OSS message.

Regards

RB

I have updated the kernel with the latest version.

###

disp+work information
--------------------

kernel release                740

kernel make variant           740_REL

DBMS client library           OCI_112,                       

DBSL shared library version   740.10

compiled on                   SunOS 5.10 Generic_147440-01 sun4u for sun_64

compiled for                  64 BIT

compilation mode              Non-Unicode

compile time                  Sep 27 2013 20:31:17

update level                  0

patch number                  37

###

But there is the problem.

I have opened an OSS message.

SAP -> Please open an R3 connection

ME -> How do you want to connect if R3 is down

SAP-> Please provide me log files as in Note 1838153

ME -> It is more than 500 MB, compressed more than 34 MB

ME -> Market Place does not allow more than 4 MB

I am impressed...

Regards,

Reagan
Advisor
Advisor
0 Kudos

You just need to ask them for a MAT link to be opened where you can upload the trace files of big sizes.

Regards

RB

benoit-schmid
Contributor
0 Kudos

Hello,

Reagan Benjamin wrote:

You just need to ask them for a MAT link to be opened where you can upload the trace files of big sizes.

Regards

RB

What is a mat link?

Regards,

former_member206552
Active Contributor
0 Kudos

Hi

This is a link that supplies where you can upload files larger than 4mb, i have uploaded very big zip files through this

Best Regards

Marius

benoit-schmid
Contributor
0 Kudos

Hello,

The support has aske for the INSTANCE.OUT.

Therefore tomorrow they may say that I should increase poll 40.

Has anyone an idea on how I could continue to trace the source of my problem?

Regards,

Reagan
Advisor
Advisor
0 Kudos

***ERROR: Size of shared memory pool 40 too small

================================================================

SOLUTIONS: (1) Locate shared memory segments outside of pool 40

               with parameters like: ipc/shm_psize_<key> =0

SOLUTION: Increase size of shared memory pool 40

          with parameter: ipc/shm_psize_40 =484000000

Shared memory disposition overview

================================================================

Shared memory pools

Key:   10  Pool                        

            Size configured.....:   200000000 ( 190.7 MB)

            Size min. estimated.:   104223396 (  99.4 MB)

            Advised Size........:   108000000 ( 103.0 MB)

Key:   40  Pool for database buffers   

            Size configured.....:   110000000 ( 104.9 MB)

            Size min. estimated.:   481800088 ( 459.5 MB)

            Advised Size........:   484000000 ( 461.6 MB)

Why don't you change the value as suggested and see whether it helps ?

ipc/shm_psize_40 =484000000

Regards

RB

benoit-schmid
Contributor
0 Kudos

Hello,

Reagan Benjamin wrote:

Why don't you change the value as suggested and see whether it helps ?

ipc/shm_psize_40 =484000000

As I have said earlier, I have done so.

But it has not solve the problem and the INSTANCE.OUT is not re written.

Regards,

Reagan
Advisor
Advisor
0 Kudos

If the parameters are set correctly then you just wait until SAP replies.

Most probably the Kernel and OS combination could be the issue.

A MAT link is provided to you by an SAP support agent when there is a need to upload trace files or heap dumps or core dumps for analysis from the SAP side to find out the memory leak.

This is provided when the file size is big and you are not able to attach them in the OSS message.

The MAT link is valid for a certain period of time and gets expired after that.

Regards

RB

benoit-schmid
Contributor
0 Kudos

Hello,

I have uploaded the logs and specified that the shared pool 40 as been increased

so that sappfpar check is ok.

Then after waiting more than 12 hours, he has replied.

Increase the size of the pool 40.

It can be really a pain in the back to deal with SAP Support.

Regards,

Former Member
0 Kudos

Can you attach actual log files for analysis and also syslog messages for rctl.

benoit-schmid
Contributor
0 Kudos

Hello,

Roman N wrote:

Can you attach actual log files for analysis and also syslog messages for rctl.

Which other log files would you like?

Regards,

benoit-schmid
Contributor
0 Kudos

Hello Roman,

Roman N wrote:

Can you attach actual log files for analysis and also syslog messages for rctl.

This is rctl limitation.

% prctl $$
process: 7294: -tcsh
NAME    PRIVILEGE       VALUE    FLAG   ACTION                       RECIPIENT
process.max-port-events
        privileged      65.5K       -   deny                                 -
        system          2.15G     max   deny                                 -
process.max-msg-messages
        privileged      8.19K       -   deny                                 -
        system          4.29G     max   deny                                 -
process.max-msg-qbytes
        privileged      64.0KB      -   deny                                 -
        system          16.0EB    max   deny                                 -
process.max-sem-ops
        privileged        512       -   deny                                 -
        system          2.15G     max   deny                                 -
process.max-sem-nsems
        privileged      2.05K       -   deny                                 -
        system          32.8K     max   deny                                 -
process.max-address-space
        privileged      16.0EB    max   deny                                 -
        system          16.0EB    max   deny                                 -
process.max-file-descriptor
        basic           4.10K       -   deny                              7294
        privileged      65.5K       -   deny                                 -
        system          2.15G     max   deny                                 -
process.max-core-size
        privileged      8.00EB    max   deny                                 -
        system          8.00EB    max   deny                                 -
process.max-stack-size
        basic           8.00MB      -   deny                              7294
        privileged      8.00EB    max   deny                                 -
        system          8.00EB    max   deny                                 -
process.max-data-size
        privileged      16.0EB    max   deny                                 -
        system          16.0EB    max   deny                                 -
process.max-file-size
        privileged      8.00EB    max   deny,signal=XFSZ                     -
        system          8.00EB    max   deny                                 -
process.max-cpu-time
        privileged      18.4Es    inf   signal=XCPU                          -
        system          18.4Es    inf   none                                 -
task.max-cpu-time
        usage             800s  
        system          18.4Es    inf   none                                 -
task.max-processes
        usage               6   
        system          2.15G     max   deny                                 -
task.max-lwps
        usage              15   
        system          2.15G     max   deny                                 -
project.max-contracts
        privileged      10.0K       -   deny                                 -
        system          2.15G     max   deny                                 -
project.max-locked-memory
        usage           8.25GB  
        system          16.0EB    max   deny                                 -
project.max-port-ids
        privileged      8.19K       -   deny                                 -
        system          65.5K     max   deny                                 -
project.max-shm-memory
        privileged      24.0GB      -   deny                                 -
        system          16.0EB    max   deny                                 -
project.max-shm-ids
        privileged        256       -   deny                                 -
        system          16.8M     max   deny                                 -
project.max-msg-ids
        privileged        128       -   deny                                 -
        system          16.8M     max   deny                                 -
project.max-sem-ids
        privileged      1.02K       -   deny                                 -
        system          16.8M     max   deny                                 -
project.max-crypto-memory
        usage           98.3KB  
        privileged      31.3GB      -   deny                                 -
        system          16.0EB    max   deny                                 -
project.max-tasks
        usage               8   
        system          2.15G     max   deny                                 -
project.max-processes
        usage             151   
        system          2.15G     max   deny                                 -
project.max-lwps
        usage             314   
        system          2.15G     max   deny                                 -
project.cpu-cap
        usage               0   
        system          4.29G     inf   deny                                 -
project.cpu-shares
        usage               1   
        privileged          1       -   none                                 -
        system          65.5K     max   none                                 -
zone.max-lofi
        usage               0   
        system          18.4E     max   deny                                 -
zone.max-swap
        usage           24.3GB  
        system          16.0EB    max   deny                                 -
zone.max-locked-memory
        usage           8.25GB  
        system          16.0EB    max   deny                                 -
zone.max-shm-memory
        system          16.0EB    max   deny                                 -
zone.max-shm-ids
        system          16.8M     max   deny                                 -
zone.max-sem-ids
        system          16.8M     max   deny                                 -
zone.max-msg-ids
        system          16.8M     max   deny                                 -
zone.max-processes
        usage             188   
        system          2.15G     max   deny                                 -
zone.max-lwps
        usage             477   
        system          2.15G     max   deny                                 -
zone.cpu-cap
        usage               0   
        system          4.29G     inf   deny                                 -
zone.cpu-shares
        usage               1   
        privileged          1       -   none                                 -
        system          65.5K     max   none                                 -

benoit-schmid
Contributor
0 Kudos

Hello,

Roman N wrote:

Can you attach actual log files for analysis and also syslog messages for rctl.

Here are the shm system limitation reached:

Nov 28 08:49:42 xxx genunix: [ID 475622 kern.notice] privileged rctl project.max-shm-ids (value 256) exceeded by process 7881 in project 3.
Nov 28 08:49:42 xxx genunix: [ID 310224 kern.notice] privileged rctl project.max-shm-memory (value 25769803776) exceeded by process 7881 in project 3.

But for what I have noticed. SAP does not systematically try to go above these thresholds.

Regards,

Reagan
Advisor
Advisor
0 Kudos

Have you checked the work process trace files ?

Try to start SAP manually after cleaning the shared memory segments.

Regards

RB

benoit-schmid
Contributor
0 Kudos

Hello,

Reagan Benjamin wrote:

Have you checked the work process trace files ?

Try to start SAP manually after cleaning the shared memory segments.

It is tough to say why it tries to allocate more than 64 GB of shm.

There are a few errors reported in trace files but nothing concerning Process with PID 2620.

---

% grep -i shm * | grep -i err

dev_enqwork:[Thr 03] *** ERROR => ShmProtect(34,3) shmat(1610612848,0xffffffff7c000000,(SHM_RND | 0)) (22: Invalid argument) [shmux.c      2695]
dev_enqwork:[Thr 03] *** ERROR => ShmCreate: ShmProtect( 34, 3) failed [shmux.c      1326]
dev_enqwork:[Thr 03] *** ERROR => ShmCleanup: ShmCreate(34,0,SHM_ATTACH,...) failed. rtc=1 [shmux.c      3074]
dev_enqwork:[Thr 03] *** ERROR => ShmCleanup: Inv. Key=34  [shmux.c      3109]
dev_enqwork.old:[Thr 03] *** ERROR => ShmProtect(34,3) shmat(1577058392,0xffffffff7c000000,(SHM_RND | 0)) (22: Invalid argument) [shmux.c      2695]

dev_w2:M  *** ERROR => ThCallHooks: event handler ThrtStartup for event CREATE_SHM failed (4) [thSos.c      2081]

---

Regards,

Reagan
Advisor
Advisor
0 Kudos

EM is not the only candidate that takes the memory

For me it looks like the shared memory problems and thus preventing the enqueue server to start.

I would cleanup the shared memory segments or restart the server and then start the SAP system.

Regards

RB

nirmal_konchada
Active Contributor
0 Kudos

Hi,

Can you try to reduce the size of this parameter and take a restart.

rsdb/ntab/irbdsize

Regards,

Nirmal.K

benoit-schmid
Contributor
0 Kudos

Hello,

nirmal konchada wrote:

Can you try to reduce the size of this parameter and take a restart.

rsdb/ntab/irbdsize

I have set it to 1000.

But it does not help.

Why were thinking of reducing this value?

Regards,

Former Member
0 Kudos

Can you provide full log file?

benoit-schmid
Contributor
0 Kudos

Hello,

Roman N wrote:

Can you provide full log file?

Which full log file?

Regards,

Former Member
0 Kudos

Log of enqueue server part of which you provided before or actual error if it changed.

benoit-schmid
Contributor
0 Kudos

Hello,

For your information, I have the following errors in my system.

---

Nov 27 10:12:21 xxx genunix: [ID 334566 kern.notice] privileged rctl project.max-shm-ids (value 256) exceeded by process 26206 in project 3.
Nov 27 10:12:22 xxx genunix: [ID 860056 kern.notice] privileged rctl project.max-shm-memory (value 68719476736) exceeded by process 26206 in project 3.

---

I have limited the em to 6 GB.

Would you know how I could trace why this bloody SAP tries to allocate more than 64 GB

and more than 255 shared memories?

Regards,

sunny_pahuja2
Active Contributor
0 Kudos

Hello,

Are you using solaris 10?

Thanks,

Sunny

benoit-schmid
Contributor
0 Kudos

Hello,

Sunny Pahuja wrote:

Hello,

Are you using solaris 10?

Thanks,

Sunny

No Solaris 11 as reported in the title of my post.

Regards,

sunny_pahuja2
Active Contributor
0 Kudos

Hello,

Could you please paste log INSTANCE.OUT?

Thanks,

Sunny

benoit-schmid
Contributor
0 Kudos

Sunny Pahuja wrote:

Hello,

Could you please paste log INSTANCE.OUT?

Thanks,

Sunny

This is the output.

It is complaining concerning ipc/shm_psize_4, that I am going to increase.

Before restarting, could you explain me why it tries to allocate so much memory and shared memory ics?

Should I manually restart it or let SUM restart it?

SAPup> Starting subprocess with PID 26206 in phase 'MOD_PFPAR_TRANS' at 20131127101221
    ENV: DIR_LIBRARY=/usr/sap/EH7/DVEBMGS00/exe
    ENV: JAVA_HOME=/usr/java
    ENV: LD_LIBRARY_PATH=/usr/sap/EH7/DVEBMGS00/exe:/usr/sap/EH7/SUM/jvm/jre/lib/sparcv9/server:/usr/sap/EH7/SUM/jvm/jre/lib/sparcv9:/usr/sap/EH7/SUM/jvm/jre/../lib/sparcv9:/usr/sap/EH7/SYS/exe/run:/usr/sap/EH7/SYS/exe/nuc/sun_64:/oracle/client/11x_64/instantclient
    ENV: NLS_LANG=AMERICAN_AMERICA.WE8DEC
    ENV: ORACLE_BASE=/oracle
    ENV: ORACLE_HOME=/oracle/EH7/112_64
    ENV: ORACLE_SID=EH7
    ENV: PATH=/usr/sap/EH7/DVEBMGS00/exe:/oracle/EH7/112_64/bin:/usr/sbin:/usr/bin:/usr/ucb:/usr/dt/bin:/usr/openwin/bin:/usr/sfw/bin:/opt/sfw/bin:/usr/local/bin:/usr/sap/EH7/SYS/exe/nuc/sun_64:/usr/sap/EH7/SYS/exe/run:/export/home/eh7adm:.:/usr/ccs/bin
    ENV: SAPDATA_HOME=/oracle/EH7
    ENV: SAPSYSTEMNAME=EH7
    ENV: dbms_type=ORA
    ENV: dbs_ora_schema=SAPSR3
    ENV: dbs_ora_tnsname=EH7

EXECUTING /usr/sap/EH7/DVEBMGS00/exe/sappfpar  check "pf=/usr/sap/EH7/SYS/profile/EH7_DVEBMGS00_xxx "


================================================================================
==   Checking profile:     /usr/sap/EH7/SYS/profile/EH7_DVEBMGS00_xxx
================================================================================

***WARNING: Unexpected parameter: SAPFQDN =xxx
***WARNING: Unexpected parameter: rdisp/system_needs_spool =false
***WARNING: Unexpected parameter: rsdb/pmandt =000
***WARNING: Unexpected parameter: rslg/new_layout =9
***WARNING: Unexpected parameter: rspo/spool_id/use_tskh =0
***WARNING: Unexpected parameter: service/protectedwebmethods =SDEFAULT
***WARNING: Unexpected parameter: ssl/ssl_lib =/usr/sap/EH7/DVEBMGS00/exe/libsapcrypto.so

***ERROR: Size of shared memory pool 40 too small
================================================================
SOLUTIONS: (1) Locate shared memory segments outside of pool 40
               with parameters like: ipc/shm_psize_<key> =0

SOLUTION: Increase size of shared memory pool 40
          with parameter: ipc/shm_psize_40 =484000000

Shared memory disposition overview
================================================================
Shared memory pools
Key:   10  Pool                        
            Size configured.....:   200000000 ( 190.7 MB)
            Size min. estimated.:   104223396 (  99.4 MB)
            Advised Size........:   108000000 ( 103.0 MB)

Key:   40  Pool for database buffers   
            Size configured.....:   110000000 ( 104.9 MB)
            Size min. estimated.:   481800088 ( 459.5 MB)
            Advised Size........:   484000000 ( 461.6 MB)

Shared memories inside of pool 10
Key:       11  Size:      500000 (   0.5 MB) Factory calender buffer     
Key:       12  Size:     6000000 (   5.7 MB) TemSe Char-Code convert Buf.
Key:       13  Size:    40500000 (  38.6 MB) Alert Area                  
Key:       14  Size:     4400000 (   4.2 MB) Presentation buffer         
Key:       16  Size:       22400 (   0.0 MB) Semaphore activity monitoring
Key:       17  Size:     2800228 (   2.7 MB) Roll administration         

Shared memories inside of pool 40
Key:       42  Size:    70592992 (  67.3 MB) DB TTAB buffer              
Key:       43  Size:   273654392 ( 261.0 MB) DB FTAB buffer              
Key:       44  Size:    48374392 (  46.1 MB) DB IREC buffer              
Key:       45  Size:    33014392 (  31.5 MB) DB short nametab buffer     
Key:       46  Size:       20480 (   0.0 MB) DB sync table               
Key:       47  Size:     3073024 (   2.9 MB) DB CUA buffer               
Key:       48  Size:      300000 (   0.3 MB) Number range buffer         
Key:       49  Size:     2769392 (   2.6 MB) Spool admin (SpoolWP+DiaWP) 

Shared memories outside of pools
Key:        1  Size:        2500 (   0.0 MB) System administration       
Key:        2  Size:     5509232 (   5.3 MB) Disp. administration tables 
Key:        3  Size:    66864000 (  63.8 MB) Disp. communication areas   
Key:        4  Size:      524848 (   0.5 MB) statistic area              
Key:        6  Size:   851968000 ( 812.5 MB) ABAP program buffer         
Key:        7  Size:       14838 (   0.0 MB) Update task administration  
Key:        8  Size:    67108964 (  64.0 MB) Paging buffer               
Key:        9  Size:   134217828 ( 128.0 MB) Roll buffer                 
Key:       18  Size:      917604 (   0.9 MB) Paging adminitration        
Key:       19  Size:    30000000 (  28.6 MB) Table-buffer                
Key:       30  Size:       39936 (   0.0 MB) Taskhandler runtime admin.  
Key:       31  Size:     8412000 (   8.0 MB) Dispatcher request queue    
Key:       33  Size:    10240000 (   9.8 MB) Table buffer, part.buffering
Key:       34  Size:    33554432 (  32.0 MB) Enqueue table               
Key:       41  Size:    25010000 (  23.9 MB) DB statistics buffer        
Key:       51  Size:    18000000 (  17.2 MB) Extended memory admin.      
Key:       52  Size:      180000 (   0.2 MB) Message Server buffer       
Key:       54  Size:     8396800 (   8.0 MB) Export/Import buffer        
Key:       55  Size:        8192 (   0.0 MB) Spool local printer+joblist 
Key:       57  Size:     1572864 (   1.5 MB) Profilparameter in shared mem
Key:       58  Size:        4096 (   0.0 MB) Enqueue ID for reset        
Key:       62  Size:    85983232 (  82.0 MB) Memory pipes                
Key:       63  Size:      409600 (   0.4 MB) ICMAN shared memory         
Key:       64  Size:     4202496 (   4.0 MB) Online Text Repository Buf. 
Key:       65  Size:     4202496 (   4.0 MB) Export/Import Shared Memory 
Key:       81  Size:       21760 (   0.0 MB) Security Audit Log          
Key:     1002  Size:      400000 (   0.4 MB) Performance monitoring V01.0
Key: 58900100  Size:        4096 (   0.0 MB) SCSA area                   

Nr of operating system shared memory segments: 30

Shared memory resource requirements estimated
================================================================
Total Nr of shared segments required.....:         30
System-imposed number of shared memories.:        252
Shared memory segment size required min..:  851968000 ( 812.5 MB)
Currently available maximum segment size.: 55566139392 (52992.0 MB)

Swap space requirements estimated
================================================
Shared memory....................: 1859.4 MB
..in pool 10   99.4 MB,   52% used
..in pool 40  104.9 MB,  438% used !!
..not in pool: 1294.9 MB
Processes........................:  321.2 MB
Extended Memory .................: 8096.0 MB
------------------------------------------------
Total, minimum requirement.......: 10276.6 MB
Process local heaps, worst case..: 1907.3 MB
Total, worst case requirement....: 12184.0 MB

Errors detected..................:    1
Warnings detected................:    7
SAPup> Process with PID 26206 terminated with status 1 at 20131127101242!

Thanks in advance for your answer.

sunny_pahuja2
Active Contributor
0 Kudos

Hello,

As per logs above, memories inside pool 40 should be greater than sum of below:

Shared memories inside of pool 40

Key:       42  Size:    70592992 (  67.3 MB) DB TTAB buffer              

Key:       43  Size:   273654392 ( 261.0 MB) DB FTAB buffer              

Key:       44  Size:    48374392 (  46.1 MB) DB IREC buffer              

Key:       45  Size:    33014392 (  31.5 MB) DB short nametab buffer     

Key:       46  Size:       20480 (   0.0 MB) DB sync table               

Key:       47  Size:     3073024 (   2.9 MB) DB CUA buffer               

Key:       48  Size:      300000 (   0.3 MB) Number range buffer         

Key:       49  Size:     2769392 (   2.6 MB) Spool admin (SpoolWP+DiaWP)

As per logs, it is currently small that's might be the reason for error.

Thanks,

Sunny

benoit-schmid
Contributor
0 Kudos

Hello,

Sunny Pahuja wrote:

As per logs above, memories inside pool 40 should be greater than sum of below:

You have replied only partly to my questions.

Before restarting, could you explain me why it tries to allocate so much memory and shared memory ics?

Should I manually restart it or let SUM restart it?

Regards,

sunny_pahuja2
Active Contributor
0 Kudos

Hello,

Let SUM start it. Please refer to SAP 212902 - Calculated shared memory pool is too small which will answer your question about why you need so much memory.

Thanks,

Sunny

JPReyes
Active Contributor
0 Kudos

Error is clear,

***ERROR: Size of shared memory pool 40 too small
================================================================
SOLUTIONS: (1) Locate shared memory segments outside of pool 40
               with parameters like: ipc/shm_psize_<key> =0

SOLUTION: Increase size of shared memory pool 40
          with parameter: ipc/shm_psize_40 =484000000

Did you increased the size of your the shared memory pool?

Regards, Juan

benoit-schmid
Contributor
0 Kudos

Hello,

Juan Reyes wrote:

Did you increased the size of your the shared memory pool?

After increasing the value, SAP still does not start.

Regards,

Reagan
Advisor
Advisor
0 Kudos

Have you checked the work process trace file ?

Check dev_w0, dev_disp

Regards

RB

benoit-schmid
Contributor
0 Kudos

Hello,

For your info, now shared pool are large enough.

% sappfpar pf=EH7_DVEBMGS00_xxx check


================================================================================
==   Checking profile:     /sapmnt/EH7/profile/EH7_DVEBMGS00_xxx
================================================================================

***WARNING: Unexpected parameter: abap/preput_target_release =740_SP02
***WARNING: Unexpected parameter: rdisp/system_needs_spool =false
***WARNING: Unexpected parameter: rsdb/pmandt =000
***WARNING: Unexpected parameter: rslg/new_layout =9

Shared memory disposition overview
================================================================
Shared memories outside of pools
Key:        1  Size:        2500 (   0.0 MB) System administration       
Key:        2  Size:     4781824 (   4.6 MB) Disp. administration tables 
Key:        3  Size:   294912000 ( 281.2 MB) Disp. communication areas   
Key:        4  Size:      533848 (   0.5 MB) statistic area              
Key:        6  Size:   851968000 ( 812.5 MB) ABAP program buffer         
Key:        7  Size:       14838 (   0.0 MB) Update task administration  
Key:        8  Size:   134217828 ( 128.0 MB) Paging buffer               
Key:       11  Size:      500000 (   0.5 MB) Factory calender buffer     
Key:       12  Size:     6000000 (   5.7 MB) TemSe Char-Code convert Buf.
Key:       13  Size:    40500000 (  38.6 MB) Alert Area                  
Key:       14  Size:     4400000 (   4.2 MB) Presentation buffer         
Key:       16  Size:       22400 (   0.0 MB) Semaphore activity monitoring
Key:       18  Size:      917604 (   0.9 MB) Paging adminitration        
Key:       19  Size:   424463565 ( 404.8 MB) Table-buffer                
Key:       22  Size:       54272 (   0.1 MB) Unused3                     
Key:       30  Size:       55296 (   0.1 MB) Taskhandler runtime admin.  
Key:       33  Size:    42446848 (  40.5 MB) Table buffer, part.buffering
Key:       34  Size:    33554432 (  32.0 MB) Enqueue table               
Key:       41  Size:    25010000 (  23.9 MB) DB statistics buffer        
Key:       42  Size:    29232992 (  27.9 MB) DB TTAB buffer              
Key:       43  Size:    92207064 (  87.9 MB) DB FTAB buffer              
Key:       44  Size:    24293336 (  23.2 MB) DB IREC buffer              
Key:       45  Size:    15803352 (  15.1 MB) DB short nametab buffer     
Key:       46  Size:       20480 (   0.0 MB) DB sync table               
Key:       47  Size:     3073024 (   2.9 MB) DB CUA buffer               
Key:       48  Size:      300000 (   0.3 MB) Number range buffer         
Key:       49  Size:     2769392 (   2.6 MB) Spool admin (SpoolWP+DiaWP) 
Key:       51  Size:    18000000 (  17.2 MB) Extended memory admin.      
Key:       52  Size:      180000 (   0.2 MB) Message Server buffer       
Key:       54  Size:  1369028608 (1305.6 MB) Export/Import buffer        
Key:       55  Size:        8192 (   0.0 MB) Spool local printer+joblist 
Key:       57  Size:     1572864 (   1.5 MB) Profilparameter in shared mem
Key:       58  Size:        4096 (   0.0 MB) Enqueue ID for reset        
Key:       62  Size:   421527552 ( 402.0 MB) Memory pipes                
Key:       63  Size:      409600 (   0.4 MB) ICMAN shared memory         
Key:       64  Size:     4202496 (   4.0 MB) Online Text Repository Buf. 
Key:       65  Size:     4202496 (   4.0 MB) Export/Import Shared Memory 
Key:       81  Size:       21760 (   0.0 MB) Security Audit Log          
Key:     1002  Size:      400000 (   0.4 MB) Performance monitoring V01.0
Key: 58900100  Size:        4096 (   0.0 MB) SCSA area                   

Nr of operating system shared memory segments: 40

Shared memory resource requirements estimated
================================================================
Total Nr of shared segments required.....:         40
System-imposed number of shared memories.:        214
Shared memory segment size required min..: 1369028608 (1305.6 MB)
Currently available maximum segment size.: 13555990528 (12928.0 MB)

Swap space requirements estimated
================================================
Shared memory....................: 3677.0 MB
..not in pool: 3673.2 MB
Processes........................:  444.2 MB
Extended Memory .................: 8096.0 MB
------------------------------------------------
Total, minimum requirement.......: 12217.2 MB
Process local heaps, worst case..: 13056.0 MB
Total, worst case requirement....: 25273.2 MB

Errors detected..................:    0
Warnings detected................:    4

Regards,

benoit-schmid
Contributor
0 Kudos

Hello Benjamin,

Reagan Benjamin wrote:

Have you checked the work process trace file ?

Check dev_w0, dev_disp

Regards

RB

In dev_disp, there is the following error:

*** ERROR => DpHdlDeadWp: W0 (pid 3587) died (severity=0, status=65280) [dpxxwp.c     1266]
DpTraceWpStatus: child (pid=3587) exited with exit code 255

In dev_w0, the re is the following error:

B  ***LOG BB0=> buffer TBI64      started with length 513601454  bytes [dbtbxbuf
     11339]
B  DBI: init TBI BUFFER (data):  start=fffffffd00502000  length=493956480  end=f
ffffffd1dc14d80
B  dbprotocol: table logging switched off for all clients
B  db_tbi_install(): tbi_init_singletons() -> rc = false
B  db_tbiinit failed
M  *** ERROR => ThrtDatabaseEnvInit: db_init failed (4) [thrtDatabase 48]
M  *** ERROR => ThrtDatabaseEnvInit failed (4) [thxxext.c    181]
M  *** ERROR => ThCallHooks: event handler ThrtStartup for event CREATE_SHM failed (4) [thSos.c      2081]
M  *** ERROR => ThIPCInit: hook failed [thxxhead.c   1290]
M  ***LOG R19=> ThInit, ThIPCInit ( TSKH-IPC-000001) [thxxhead.c   1033]
M  in_ThErrHandle: 1
M  *** ERROR => ThInit: ThIPCInit (step TH_INIT, thRc ERROR-CORE-INIT_FAILED, action STOP_WP, level 1) [thxxhead.c   2153]

Regards,

JPReyes
Active Contributor
0 Kudos

ThrtStartup for event CREATE_SHM failed

That means that you probably do not have enough memory to allocate all the shared memory required by the pool.

Whats your physical and SWAP memory?, Did you run "cleanipc" before starting the system?

Regards, Juan

benoit-schmid
Contributor
0 Kudos

Hello,

Juan Reyes wrote:

ThrtStartup for event CREATE_SHM failed

That means that you probably do not have enough memory to allocate all the shared memory required by the pool.

Whats your physical and SWAP memory?, Did you run "cleanipc" before starting the system?

128 GB of Mem and 32 GB of Swap.

Regarding sappfpar check I should not need more than 13 GB to start.

Therefore I do not understand why it is having pb to create shm.

I have manually deleted the ipc shared memoies and semaphore before restarting SAP.

Regards,

JPReyes
Active Contributor
0 Kudos

Can you post the errors in dev_w0?

Regards, Juan

sunny_pahuja2
Active Contributor
0 Kudos

Could you please post INSTANCE.OUT after changing parameter and repeating the phase?

Thanks,

Sunny

benoit-schmid
Contributor
0 Kudos

Hello,

Juan Reyes wrote:

Can you post the errors in dev_w0?

Regards, Juan

Here it is:

---------------------------------------------------
trc file: "dev_w0", trc level: 1, release: "740"
---------------------------------------------------
*
*  ACTIVE TRACE LEVEL           1
*  ACTIVE TRACE COMPONENTS      all, MJ
*
M sysno      00
M sid        EH7
M systemid   370 (Solaris on SPARCV9 CPU)
M relno      7400
M patchlevel 0
M patchno    27
M intno      20020600
M make       multithreaded, ASCII, 64 bit, optimized
M profile    /usr/sap/EH7/SYS/profile/EH7_DVEBMGS00_xxx
M pid        27029
M

M Thu Nov 28 08:25:21 2013
M  kernel runs with dp version 183(ext=116) (@(#) DPLIB-INT-VERSION-183)
M  length of sys_adm_ext is 328 bytes
M  *** WARNING => NiIHdlSetParamNoSslSessionDone: call on non SSL connection [nixxi.cpp    11068]
M  ThStart: taskhandler started
M  ThInit: initializing DIA work process W0
M  ***LOG Q01=> ThInit, WPStart (Workp. 0 1 27029) [thxxhead.c   897]
M  ThInit: running on host xxx
I  MtxInit: 0 0 0
M  calling db_connect ...
B  Loading DB library '/usr/sap/EH7/DVEBMGS00/exe/dboraslib.so' ...
B  Library '/usr/sap/EH7/DVEBMGS00/exe/dboraslib.so' loaded
B  Version of '/usr/sap/EH7/DVEBMGS00/exe/dboraslib.so' is "740.10", patchlevel (0.22)
B  read_con_info_ssfs(): DBSL supports extended connect protocol
B   ==> connect info for default DB will be read from ssfs
C  Register application info.
C  Oracle client version: 11.2.0.3.0, V1, default build, (dbsl 740 190413, non-unicode)
C  Installed Oracle client patches:
C  # Patch  13508485     : Created on 21 Dec 2011, 13:23:38 hrs PST8PDT
C  # Patch Description: Created on 30 Dec 2011, 03:13:30 hrs PST8PDT
C  # Patch  11742262     : Created on  7 Mar 2012, 12:22:41 hrs CET
C  Client NLS setting (by OCINlsGetInfo(con=0)): 'AMERICAN_AMERICA.WE8DEC'
C  Connecting as SAPSR3/<pwd>@EH7 on connection 0 (nls 0) ... (dbsl 740 190413, non-unicode)
C  Attaching to database server EH7 (con=0, svchp=106799508, srvhp=10679a7c0)
C  Starting user session: OCISessionBegin(con=0, usr='SAPSR3', svc=106799508, srv=10679a7c0, usr=10686c120)

C Thu Nov 28 08:25:22 2013
C  Now 'SAPSR3/<pwd>@EH7' is connected: con=0, nls=0, session=645, time='2013-11-28 08:25:22'
C  DB instance EH7 is running on xxx with ORACLE version 11.2.0.3.0 since NOV 28, 2013, 08:25:08.
C  con=0, V$NLS_PARAMETERS: NLS_LANG=AMERICAN_AMERICA.WE8DEC, NLS_NCHAR=UTF8
C  Nls CharacterSet                      NationalCharSet                   EnvHp            ErrHp            ErrBt          
C    0 WE8DEC                            AL16UTF16                         10678c7b0        106798518        1067995e8      
B  Connection 0 opened (DBSL handle 0)
C     DbSlControl(DBSL_CMD_SAPRELEASE_SET,abap='701')
M  ThDbConnect: db_connect o.k.
X  EmInit: MmSetImplementation( 2 ).
X  MM global diagnostic options set: 0
X  <ES> client 0 initializing ....
X  Using implementation std
X  <ES> Info: use mapped file
X  <ES> Info: use normal pages (no huge table support available)
X  ES initialized.
X  mm.dump: set maximum dump mem to 96 MB

B Thu Nov 28 08:25:24 2013
B  db_con_shm_ini:  WP_ID = 0, WP_CNT = 53, CON_ID = -1

B Thu Nov 28 08:25:25 2013
B  Start CursorInit
B  TBI initializing lock manager ...
B  TBI locking          : multiple locks
B  TBI lock manager impl: semamphore
B  dbtbxbuf: Buffer TBI64 (addr: ffffffff698000e8, size: 513601454, end: ffffffff881cf096)
B  dbtbxbuf: Profile: max_objects = 91193, displace = 1, reorg = 0
B  dbtbxbuf: request_unit = 2000, sync_reload = 5, inval_reload = 5, parallel_penalty = 0
B  dbtbxbuf: protect_shm = 0, force_checks = 0
B  dbtbxbuf: tsize_retry = 0
B  dbtbxbuf: obj_entry_size = 200, nt_genkey_entry_size = 28
B  ***LOG BB0=> buffer TBI64      started with length 513601454  bytes [dbtbxbuf     11339]
B  DBI: init TBI BUFFER (data):  start=fffffffd00502000  length=493956480  end=fffffffd1dc14d80
B  dbprotocol: table logging switched off for all clients
B  db_tbi_install(): tbi_init_singletons() -> rc = false
B  db_tbiinit failed
M  *** ERROR => ThrtDatabaseEnvInit: db_init failed (4) [thrtDatabase 48]
M  *** ERROR => ThrtDatabaseEnvInit failed (4) [thxxext.c    181]
M  *** ERROR => ThCallHooks: event handler ThrtStartup for event CREATE_SHM failed (4) [thSos.c      2081]
M  *** ERROR => ThIPCInit: hook failed [thxxhead.c   1290]
M  ***LOG R19=> ThInit, ThIPCInit ( TSKH-IPC-000001) [thxxhead.c   1033]
M  in_ThErrHandle: 1
M  *** ERROR => ThInit: ThIPCInit (step TH_INIT, thRc ERROR-CORE-INIT_FAILED, action STOP_WP, level 1) [thxxhead.c   2153]

M  Info for wp 0

M    pid = 27029
M    severity = 0
M    status = 0
M    stat = WP_NEW
M    waiting_for = NO_WAITING
M    workerType = DP_WORKER_DIAWP
M    currentSession = T-1/U65535/M255
M    lastSession = T-1/U65535/M255
M    act_cs_count = 0
M    csTrack = 0
M    csTrackRwExcl = 0
M    csTrackRwShrd = 0
M    mode_cleaned_counter = 0
M    control_flag = 0
M    report = >                                        <
M    action = 0
M    tab_name = >                              <

M  ThIErrHandle: no current incoming request

M  PfRejectStatistic: clear statistic record
M  PfClearAllRec: clear statistic area
M  PfClearAllRec: statRecordAction = STAT_RECORD_ACTION_REJECT
M  Entering TH_CALLHOOKS
M  ThIErrHandle: entering ThSetStatError
M  ThIErrHandle: do not call ThrCoreInfo (no_core_info=0, in_dynp_env=0)
M  call ThrShutDown (1)...
M  ***LOG Q02=> wp_halt, WPStop (Workp. 0 27029) [dpuxtool.c   318]

---------------------------------------------------
trc file: "dev_w0", trc level: 1, release: "740"
---------------------------------------------------
*
*  ACTIVE TRACE LEVEL           1
*  ACTIVE TRACE COMPONENTS      all, MJ
*
M sysno      00
M sid        EH7
M systemid   370 (Solaris on SPARCV9 CPU)
M relno      7400
M patchlevel 0
M patchno    27
M intno      20020600
M make       multithreaded, ASCII, 64 bit, optimized
M profile    /usr/sap/EH7/SYS/profile/EH7_DVEBMGS00_xxx
M pid        29332
M

M Thu Nov 28 08:30:42 2013
M  kernel runs with dp version 183(ext=116) (@(#) DPLIB-INT-VERSION-183)
M  length of sys_adm_ext is 328 bytes
M  *** WARNING => NiIHdlSetParamNoSslSessionDone: call on non SSL connection [nixxi.cpp    11068]
M  ThStart: taskhandler started
M  ThInit: initializing DIA work process W0
M  ***LOG Q01=> ThInit, WPStart (Workp. 0 2 29332) [thxxhead.c   897]
M  ThInit: running on host xxx
I  MtxInit: 0 0 0
M  calling db_connect ...
B  Loading DB library '/usr/sap/EH7/DVEBMGS00/exe/dboraslib.so' ...
B  Library '/usr/sap/EH7/DVEBMGS00/exe/dboraslib.so' loaded
B  Version of '/usr/sap/EH7/DVEBMGS00/exe/dboraslib.so' is "740.10", patchlevel (0.22)
B  read_con_info_ssfs(): DBSL supports extended connect protocol
B   ==> connect info for default DB will be read from ssfs
C  Register application info.
C  Oracle client version: 11.2.0.3.0, V1, default build, (dbsl 740 190413, non-unicode)
C  Installed Oracle client patches:
C  # Patch  13508485     : Created on 21 Dec 2011, 13:23:38 hrs PST8PDT
C  # Patch Description: Created on 30 Dec 2011, 03:13:30 hrs PST8PDT
C  # Patch  11742262     : Created on  7 Mar 2012, 12:22:41 hrs CET
C  Client NLS setting (by OCINlsGetInfo(con=0)): 'AMERICAN_AMERICA.WE8DEC'
C  Connecting as SAPSR3/<pwd>@EH7 on connection 0 (nls 0) ... (dbsl 740 190413, non-unicode)
C  Attaching to database server EH7 (con=0, svchp=1067a0778, srvhp=1067a1a30)
C  Starting user session: OCISessionBegin(con=0, usr='SAPSR3', svc=1067a0778, srv=1067a1a30, usr=106873490)
C  Now 'SAPSR3/<pwd>@EH7' is connected: con=0, nls=0, session=1841, time='2013-11-28 08:30:42'
C  DB instance EH7 is running on xxx with ORACLE version 11.2.0.3.0 since NOV 28, 2013, 08:25:08.
C  con=0, V$NLS_PARAMETERS: NLS_LANG=AMERICAN_AMERICA.WE8DEC, NLS_NCHAR=UTF8
C  Nls CharacterSet                      NationalCharSet                   EnvHp            ErrHp            ErrBt          
C    0 WE8DEC                            AL16UTF16                         106793a20        10679f788        1067a0858      
B  Connection 0 opened (DBSL handle 0)
C     DbSlControl(DBSL_CMD_SAPRELEASE_SET,abap='701')
M  ThDbConnect: db_connect o.k.
X  EmInit: MmSetImplementation( 2 ).
X  MM global diagnostic options set: 0
X  <ES> client 0 initializing ....
X  Using implementation std
X  <ES> Info: use mapped file
X  <ES> Info: use normal pages (no huge table support available)
X  ES initialized.
X  mm.dump: set maximum dump mem to 96 MB
B  db_con_shm_ini:  WP_ID = 0, WP_CNT = 53, CON_ID = -1
B  Start CursorInit
B  TBI initializing lock manager ...
B  TBI locking          : multiple locks
B  TBI lock manager impl: semamphore
B  dbtbxbuf: Buffer TBI64 (addr: ffffffff458000e8, size: 513601454, end: ffffffff641cf096)
B  DBI: init TBI BUFFER (data):  start=fffffffd00502000  length=493956480  end=fffffffd1dc14d80
B  dbprotocol: table logging switched off for all clients
B  dbsync[db_syinit]: successfully attached to shared memory, sync_adm_p = ffffffff6b300000
B  dbsync[db_syinit]: Buffer synchronisation started with
B    sync_concept      = SEQ_NR
B    sendon            = 0
B    bufreftime        = 120
B    max_gap_wait_time = 60
B    ddlog_del_time    = 60
B    last_counter      = -2147478178
B    oldest_gap        = (2147483647,19700101010000)
B    time_of_last_sync = 20131128082525
B    MySysId           = 'xxx         00'
B  dbexpbuf[EXP_SHB]: successfully attached to shared memory
B  dbexpbuf[EXP_SHB]: buffer installed with the following properties
B    semKey             = 35
B    shmKey             = 54
B    wpCnt              = 53
B    blockSize          = 512
B    maxObjects         = 334234
B    maxObjectSize      = 316182528
B    freeListVectorSize = 17
B    hashVectorSize     = 668471
B    bufferSize         = 1369020416
B    maxBlocks          = 2470176
B    freeBlocksCnt      = 2470176
B    mutexVectorSize    = 668473, ADMIN_MUTEX = 668471, INVAL_MUTEX = 668472
B    tracing            = 0
B    forceChecks        = 0
B    protectShm         = 0
B  dbexpbuf[EXP_SHM]: successfully attached to shared memory
B  dbexpbuf[EXP_SHM]: buffer installed with the following properties
B    semKey             = 56
B    shmKey             = 65
B    wpCnt              = 53
B    blockSize          = 512
B    maxObjects         = 2000
B    maxObjectSize      = 890368
B    freeListVectorSize = 17
B    hashVectorSize     = 4001
B    bufferSize         = 4194304
B    maxBlocks          = 6956
B    freeBlocksCnt      = 6956
B    mutexVectorSize    = 4003, ADMIN_MUTEX = 4001, INVAL_MUTEX = 4002
B    tracing            = 0
B    forceChecks        = 0
B    protectShm         = 0
B  dbexpbuf[EXP_CUA]: successfully attached to shared memory
B  dbexpbuf[EXP_CUA]: buffer installed with the following properties
B    semKey             = 30
B    shmKey             = 47
B    wpCnt              = 53
B    blockSize          = 512
B    maxObjects         = 2000
B    maxObjectSize      = 608640
B    freeListVectorSize = 587
B    hashVectorSize     = 4001
B    bufferSize         = 3072000
B    maxBlocks          = 4755
B    freeBlocksCnt      = 4755
B    mutexVectorSize    = 4003, ADMIN_MUTEX = 4001, INVAL_MUTEX = 4002
B    tracing            = 0
B    forceChecks        = 0
B    protectShm         = 0
B  dbexpbuf[EXP_OTR]: successfully attached to shared memory
B  dbexpbuf[EXP_OTR]: buffer installed with the following properties
B    semKey             = 55
B    shmKey             = 64
B    wpCnt              = 53
B    blockSize          = 256
B    maxObjects         = 2000
B    maxObjectSize      = 890304
B    freeListVectorSize = 33
B    hashVectorSize     = 4001
B    bufferSize         = 4194304
B    maxBlocks          = 13911
B    freeBlocksCnt      = 13911
B    mutexVectorSize    = 4003, ADMIN_MUTEX = 4001, INVAL_MUTEX = 4002
B    tracing            = 0
B    forceChecks        = 0
B    protectShm         = 0
M  SHM_PRES_BUF            (addr: ffffffff44000000, size: 4400000)
M  ThCreateNoBuffer        allocated 360144 bytes for 1000 entries at ffffffff49300000
M  ThCreateNoBuffer        index size: 3000 elems
M  ThCreateVBAdm        allocated 17840 bytes (50 server) at ffffffff49200000
M  ICT: exclude compression: *.zip,*.rar,*.arj,*.z,*.gz,*.tar,*.lzh,*.cab,*.hqx,*.ace,*.jar,*.ear,*.war,*.css,*.pdf,*.gzip,*.uue,*.bz2,*.iso,*.sda,*.sar,*.gif,*.png,*.swc,*.swf
G  RelWritePermissionForShm( pLocation = 120, pEnforce = 0 )
G  GetWritePermissionForShm( pLocation =  99, pEnforce = 1 )
G  RelWritePermissionForShm( pLocation = 100, pEnforce = 1 )
S  *** init spool environment
S  TSPEVJOB updates outside critical section: event_update_nocsec = 1
S  initialize debug system
T  Stack direction is downwards.
T  debug control: prepare exclude for printer trace
T  new memory block 106a4a750
S  spool kernel/ddic check: Ok
S  using table TSP02FX for frontend printing
S  0 spool work process(es) found
S  frontend print via spool service enabled
S  printer list size is 150
S  printer type list size is 50
S  queue size (profile)   = 300
S  hostspool list size = 3000
S  option list size is 30
S      found processing queue enabled
S  found spool memory service RSPO-RCLOCKS at ffffffff45600060
S  doing lock recovery
S  setting server cache root
S  found spool memory service RSPO-SERVERCACHE at ffffffff45601488
S    using messages for server info
S  size of spec char cache entry: 165024 bytes (timeout 100 sec)
S  size of open spool request entry: 1376 bytes
S  immediate print option for implicitely closed spool requests is disabled
M  ThrCreateShObjects        allocated 109496 bytes at ffffffff44f00000
I  MPI: dynamic quotas disabled.
I  MPI init: pipes=4000 buffers=6395 reserved=1918 quota=10%
A  ***GENER* Trace switched on ***

A  ---PXA-------------------------------------------
A  PXA INITIALIZATION
A  System page size: 8kb, total admin_size: 53776kb, dir_size: 26296kb.
A  Attached to PXA (address fffffffc60000000, size 800000K, 2 fragments of 373112K )
A  PXA allocated (address fffffffc60000000, size 800000K)
A  abap/pxa = shared protect gen_remote
A  PXA: checking structure sizes: 744|208|8
A  PXA INITIALIZATION FINISHED
A  ---PXA-------------------------------------------

A  ATRA: pfclock execution time = 0
A  abap/force_local_update_task=0

A Thu Nov 28 08:30:43 2013
A  ABAP ShmAdm attached (addr=fffffffd1e44a000 leng=169836544 end=fffffffd28642000)
A  >> Shm MMADM area (addr=fffffffd1f5b9078 leng=1174784 end=fffffffd1f6d7d78)
A  >> Shm MMDAT area (addr=fffffffd1f6d8000 leng=150372352 end=fffffffd28640000)
A  RFC Destination> destination xxx host xxx system EH7 systnr 0 (xxx)
A  RFC Options> H=xxx,S=00,d=1,
A  RFC FRFC> fallback ist not active. Do nothing.
A  RFC rfc/signon_error_log = -1
A  RFC rfc/dump_connection_info = 0
A  RFC rfc/dump_client_info = 0
A  RFC rfc/cp_convert/ignore_error = 1
A  RFC rfc/cp_convert/conversion_char = 23
A  RFC rfc/wan_compress/threshold = 251
A  RFC rfc/recorder_pcs not set, use defaule value: 1
A  RFC rfc/delta_trc_level not set, use default value: 0
A  RFC rfc/no_uuid_check not set, use default value: 0
H  HTTP> Parameter icf/ssocookie_mandatory set to 0
A  ABCOV: Coverage Analyzer OFF due to incompatible kernel/ABAP release.
Y  dyWpInit
Y    ztta/dynpro_ara 800000
Y    ztta/cua_ara    250000
Y    ztta/diag_ara   250000
N  MskiInitLogonTicketCacheHandle: Logon Ticket cache pointer retrieved from shared memory.
N  MskiInitLogonTicketCacheHandle: Workprocess runs with Logon Ticket cache.
W  =================================================
W  === ipl_Init() called
W    ITSP ICMAN is not active: Disable Kernel Web GUI functionality
W  === ipl_Init() returns 2, ITSPE_DISABLED: Service is disabled (sapparam)
W  =================================================
N  VSI: WP init in ABAP VM completed with rc=0
N  SsfSapSecin: getenv(SECUDIR)=="/usr/sap/EH7/DVEBMGS00/sec"

N  =================================================
N  === SSF INITIALIZATION:
N  ===...SSF Security Toolkit name SAPSECULIB .
N  ===...SSF library is /usr/sap/EH7/DVEBMGS00/exe/libsapcrypto.so .
N  ===...SSF default hash algorithm is SHA1 .
N  ===...SSF default symmetric encryption algorithm is AES128-CBC .
N  ===...SECUDIR="/usr/sap/EH7/DVEBMGS00/sec"
N  ===...loading of Security Toolkit successfully completed.
N  ===   CommonCryptoLib (SAPCRYPTOLIB) Version 8.4.6 pl35 (2.0 SP1 Patch 2) (Jul 18 2013) MT-safe
N  =================================================
N  SignInit: successfully obtained handle for Security Context cache
N  SignInit: Not attempted to load Kerberos Library (ABAP parts missing, note 1798979)
M  JrfcVmcRegisterNativesDriver o.k.
E  EnqId_Initialize: local EnqId initialization o.k.

M Thu Nov 28 08:49:04 2013
M  in_ThErrHandle: 1
M  ThIErrHandle: new stat of W0 is WP_SHUTDOWN   
M  ThIErrHandle: I'm during shutdown
M  PfRejectStatistic: clear statistic record
M  PfClearAllRec: clear statistic area
M  PfClearAllRec: statRecordAction = STAT_RECORD_ACTION_REJECT
M  ThIErrHandle: entering ThSetStatError
M  PfSetError: clear statistic record
M  PfClearAllRec: clear statistic area
M  PfClearAllRec: statRecordAction = STAT_RECORD_ACTION_REJECT
M  ThWpSetCurrentSession: set WP's current session to NO SESSION (rq_cnt 0, last wp -1, last rq_id 0)
M  ThResetActRequestQueue: Reset queue in slot 63 (T1_U145_M0)
M  ThRqReleaseQueueSelectHandle: release selectable handle of queue 63 (T1_U145_M0) from [thRequest.c:783]
M  RqQQueueReleaseSelectableHandle: Queue <T1_U145_M0> in slot 63 does not have a selectable handle
M  RqQQueueReleaseSelectableHandle: Queue <T1_U145_M0> in slot 63 released selectable hdl -1
M  RqQQueueRelease: Return queue <T1_U145_M0> in slot 63
C  -->oci_break(con=0,Acon=-1,cb=0000NULL): cancel of current SQL
C  sc_p=106496c58,no=5,idc_p=10672d730,con=0,act=0,slen=101,smax=256,#vars=1,stmt=106bf25c0,table=DDNTF                        
C  Dumping stmt. cache (DBSL private attributes):
C  sch=106496c58, scp=10636b980, ups_sch=0000NULL, stp=106d6b630, r_c=0
C  prep=1, lit=0, nsql=0, lobret_cnt=0, fae_cnt=0, xop=1, dbcount=0
C  IN : col_cnt=1, row_max=1, row_xcnt=0, row_pcnt=0, row_i=0, row_total=0,
C       row_upto=0, row_size=30, vda_max=32, bound=1, itp=0000NULL, vda_arr=106d6bcd0
C       lob_anz=0, lob_max=0, lob_pw=0,  lobarr=0000NULL, rows_ret=0
C  OUT: col_cnt=4, row_max=1, row_xcnt=0, row_pcnt=0, row_i=0, row_total=0,
C       row_upto=0, row_size=32808, vda_max=32, bound=1, itp=0000NULL, vda_arr=106d6c540
C       lob_anz=0, lob_max=0, lob_pw=0,  lobarr=0000NULL, rows_ret=0
C  SELECT TABNAME, BLOCKNR, FIELDSLG, FIELDS FROM "DDNTF" WHERE TABNAME = :A0  ORDER BY TABNAME, BLOCKN\
C  R;
C  No OCI call running -> OCIBreak() not called
C  <--oci_break() -> Aorc=-24200
C  <--DbSlControl(con=0,cmd=57=DBSL_CMD_SQLBREAK), rc=1=DBSL_ERR_ACCESS
B  db_sqlbreak() = 1
M  ThCallDbBreak: no sql statement active
M  ThIErrHandle: action is STOP_WP, skip rollback
M  ThShutDownServer: shutdown server
M  PfWriteIntoFile: shared buffer is empty.
M  ThIErrHandle: do not call ThrCoreInfo (no_core_info=0, in_dynp_env=0)
M  call ThrShutDown (1)...
B  Disconnecting from ALL connections:
B  Wp  Hdl ConName          ConId     ConState     TX  BC  OC  HC  PRM RCT FRC TIM MAX OPT Date     Time   DBHost         
B  000 000 R/3              000000000 INACTIVE     NO  NO  000 NO  YES NO  NO  000 255 255 20131128 083042 xxx                                             
C  Disconnecting from connection 0 ...
C  Closing user session (con=0, svc=1067a0778, usr=106873490)
C  Server handle (con=0,svchp=1067a0778,srvhp=1067a1a30) detached
C  Disconnected (con=0) from ORACLE.
B  Disconnected from connection 0
B  statistics db_con_commit (com_total=2, com_tx=0)
B  statistics db_con_rollback (roll_total=0, roll_tx=0)
M  ***LOG Q02=> wp_halt, WPStop (Workp. 0 29332) [dpuxtool.c   318]

Regards,

benoit-schmid
Contributor
0 Kudos

Hello,

Sunny Pahuja wrote:

Could you please post INSTANCE.OUT after changing parameter and repeating the phase?

Thanks,

Sunny

As I manually starts sap there is no INSTANCE.OUT.

Do you agree with me?
Would you suggest something else?

Regards,

benoit-schmid
Contributor
0 Kudos

Hello Benjamin,

Reagan Benjamin wrote:

Have you checked the work process trace file ?

Check dev_w0, dev_disp

Regards

RB

I have done more, I have posted them in this thread...

You are not awake.

Regards,

benoit-schmid
Contributor
0 Kudos

Hello,

Reagan Benjamin wrote:

Have you checked the work process trace file ?

Check dev_w0, dev_disp

Regards

RB

Yes, the logs do not indicate any error.

% grep -i -i err dev_disp dev_w0
dev_w0:C  Nls CharacterSet                      NationalCharSet                   EnvHp            ErrHp            ErrBt          
dev_w0:A  RFC rfc/signon_error_log = -1
dev_w0:A  RFC rfc/cp_convert/ignore_error = 1

But the dispatcher does not reply to queries.

Regards,