SAP Servers slow performance

[Former Member]

Hi,

I'm newbie to sap basis, our SAP R/3 4.7 Enterprise suffer from performance issue; below results for SAP instances from RZ20; could it be I/O bottleneck?

DBGRP

OS->LAN->Broadcom->Packet_Out-> 2978 /S

OS->Network->NameResolving->Performance->AddressToHostname [1.1.1.1]-> 4531 msec

GSPCAPP6_CBP_06

OS->Paging->Page_Out-> 623 Pg/S

DatabaseClient->Abapsql->SqlError->SQL error 0 occurred when accessing program CX_SY_ in SNAP: 20110725090555gspcapp6

DatabaseClient?Slow SQL Statements->Longest execution time-> 150732 ms

DatabaseClient?Slow SQL Statements->Longest total execution and fetch time-> 150732 ms

R3Services->Dialog->FrontendResponseTime-> 1126 msec

R3Services->Update->PerformanceU1->ResponseTime-> 4547 msec

R3Services->Update->Update->AbapErrorInUpdate->

R3BasisSystem->Buffers->Program->SpaceUsed-> 100%

R3BasisSystem->Buffers->GenericKey->SpaceUsed-> 92%

R3BasisSystem->Buffers->Program->Swap-> 66 /min

R3BasisSystem->Buffers->Screen->SpaceUsed-> 98%

R3BasisSystem->Buffers->CUA->SpaceUsed-> 93%

R3BasisSystem->Buffers->InitialRecords->DirectoryUsed-> 91%

R3BasisSystem->Buffers->InitialRecords->SpaceUsed-> 94%

R3BasisSystem->Buffers->InitialRecords->Swap-> 21.1 /min

R3Abap->Shortdumps->

gspcapp2_CBP_01

DatabaseClient?Slow SQL Statements->Longest execution time-> 217491 ms

DatabaseClient?Slow SQL Statements->Longest total execution and fetch time-> 343678 ms

R3Services->Update->PerformanceU1->ResponseTime-> 5543 msec

R3BasisSystem->Buffers->Program->SpaceUsed-> 100%

R3BasisSystem->Buffers->Program->Swap-> 55.4 /min

R3Abap->Shortdumps->

R3Syslog->BasisSystem->Operating system call recv failed (error no. &>E5)

gspcapp4_CBP_04

OS->Paging->Page_Out-> 751 Pg/S

DatabaseClient->Abapsql->SqlError->SQL error 0 occurred when accessing program CX_SY_ in SNAP: 20110722072843gspcapp4

DatabaseClient?Slow SQL Statements->Longest execution time-> 160237 ms

DatabaseClient?Slow SQL Statements->Longest total execution and fetch time-> 230943 ms

R3Services->Dialog->ResponseTime-> 2033 msec

R3Services->Dialog->FrontendResponseTime-> 2106 msec

R3Services->Dialog->DBRequestTime-> 1677 msec

R3Services->Dialog->ProgramErrors-> ABAP error: 380000 kilo bytes of shared memory for PXA not ava in SNAP: 201107141

R3Services->Update->PerformanceU1->ResponseTime-> 5454 msec

R3Services->Update->Update->AbapErrorInUpdate->

R3BasisSystem->Buffers->Program->SpaceUsed-> 100%

R3BasisSystem->Buffers->GenericKey->SpaceUsed-> 92%

R3BasisSystem->Buffers->Program->Swap-> 151.7 /min

R3BasisSystem->Buffers->Screen->SpaceUsed-> 98%

R3BasisSystem->Buffers->CUA->SpaceUsed-> 94%

R3BasisSystem->Buffers->InitialRecords->DirectoryUsed-> 92%

R3BasisSystem->Buffers->InitialRecords->Swap-> 30.2 /min

R3Abap->Shortdumps->

sapgrp_CBP_00

DatabaseClient->Abapsql->SqlError->ABAP SQL error: An SQL error occurred when accesing a table. In SNAP: 20110723214718sapgrp, Red 23.

DatabaseClient?Slow SQL Statements->Longest execution time-> 414309 ms

DatabaseClient?Slow SQL Statements->Longest total execution and fetch time-> 511975 ms

R3Services->Dialog->ResponseTime-> 1146 msec

R3Services->Dialog->FrontendResponseTime-> 1504 msec

R3Services->Dialog->ProgramErrors-> ABAP error: Error Time_OUT occurred. P1=rdisp/max_wprun_time P2 in SNAP: (client)

R3Services->Update->PerformanceU1->ResponseTime-> 6518 msec

R3Services->Update->Update->AbapErrorInUpdate->

R3BasisSystem->Buffers->Program->SpaceUsed-> 100%

R3BasisSystem->Buffers->InitialRecords->DirectoryUsed-> 91%

R3Abap->Shortdumps->

R3Syslog->BasisSystem->Operating system call recv failed (error no. &>E5)

R3Syslog->Spool->DB_RTAB_ERROR at table TSP0K, Error 64 rspogdio 2

R/3 Services

Dialog->sapgrp_CBP_00->LogonLoadQuality->6

Database

Microsoft SQL Server->R/3 consistency->Items missing in DB->Views-> There are 1 view defined in the data directionary and missing from the DB

System Configuration

Operation Mode Status->system correctly configured?->No u2013 At least one instance is inactive (GSPCAPP2_CBP_01)

Instance Status->GSPCAPP2_CBP_01->Status->inactive u2013 configuration not checked

Instance Status->sapgrp_CBP_00-Status->Active u2013 Instance incorrectly configured (Instance profiles, work processes differ)

Thanks & Regards,

Kelvin

[Former Member · Accepted solution]

Welcome.

>>Instance Status->GSPCAPP2_CBP_01->Status->inactive

Have you checked the application server CAPP2 is up and responding? as above looks like its inactive.

[Former Member · Accepted solution]

Hi Sunil,

thanks for your reply.

active instance running on GSPCAPP2 application server was gspcapp2_CBP_01

Regards,

Kelvin

[former_member189546]

Hi,

Check memory with

88416 Zero admin

also db parameters with

879941 Configuration Parameters for SQL Server 2005

regards,

John Feely

[Former Member]

Hi John,

thanks for your reply. i will check on sap notes you provided.

from ST04,

Current memory -> 10,250,576

Maximum memory -> 10,250,576

Memory Setting -> FIXED-AWE

Procedure cache -> 191,422

hit ratio -> 99%

total SQL connections -> 448

R/3 connections -> 445

Free pages -> 3,907

Data cache size -> 10,059,138KB

hit ratio -> 98%

Total data size - 869,700MB

free space -> 397MB

Total log size -> 3,032MB

free space -> 2,980MB

CPU busy -> 5.675%

CPU idle -> 94.325%

IO busy -> 0.453

Physical reads -> 93.904%

writes -> 6.096%

errors -> 0.000

SQL batches -> 579.820 per sec

Read ahead pages -> 886.930 per sec

Request buffer pages -> 358213.810 per sec

reads -> 1689.330 per sec

writes -> 46.430 per sec

Total -> 3,472,532,341

Full tab/idx scans -> 0.006 %

Index range scans -> 33.969 %

Index searches -> 62.694 %

Probe scans -> 3.330 %

Lazy write -> 17.300 per sec

Regards,

Kelvin

[former_member188883]

Hi,

GSPCAPP6_CBP_06 & gspcapp4_CBP_04

=====================================

DatabaseClient->Abapsql->SqlError->SQL error 0 occurred when accessing program CX_SY_ in SNAP: 20110725090555gspcapp6

==> this seems to be issue in SNAP table. Go to st22.

From menu look for Option reorganize. Put no of days = 3.

After this problem should get resolved.

Regards,

Deepak Kori

[Former Member]

Hi

Pls goto each individual server and make sure you have sufficent physical memory free from ST06. Also look if any OS paging is happening

Tks

[Former Member]

Hi Anish,

thanks for your reply.

from ST06, how to view other application server? (i go to OS07 and click on each instance, it lead me to remote server)

for GSPCAPP6-CBP_06 instance which running on GSPCAPP6 application server;

Physical mem avail -> 2,094,972

Physical mem free -> 616,292

total paging file size currently allocate by windows system --> 6137MB (should i set manually to 1.5 of physical memory? like 3072MB)

for gspcapp2_CBP_01 instance which running on GSPCAPP2 application server ;

Physical mem avail -> 3,654,036

Physical mem free -> 1,026,744

total paging file set manually in Windows -> 8000MB

for gspcapp4_CBP_04 instance which running on GSPCAPP4 application server ;

Physical mem avail -> 4,182,456

Physical mem free -> 1,879,104

total paging file size currently allocate by windows system --> 8168MB (should i set manually to 1.5 of physical memory? like 6144MB)

for sapgrp_CBP_00 instance which running on GSPCDBSVR/GSPCAPP1SVR cluster server;

Physical mem avail -> 15,989,616

Physical mem free -> 13,399,596

each server page file set manually -> 25240MB on single RAID5 (OS + SWAP files)

Note: GSPCAPP2, GSPCAPP4, GSPCAPP6 -> all these 3 application serves are connected to local LAN but not to SAN. only GSPCDBSVR an GSPCAPP1SVR connected to SAN together with SAN Storage which database reside, could this be the bottleneck?

Regards,

Kelvin