cancel
Showing results for 
Search instead for 
Did you mean: 

optimal number records for our SAP PI(7.4 single stack) processing in JDBC Adapter?

former_member270261
Participant
0 Kudos

Hi Experts,

am using 7.4 single stack with JDBC adapter, need to advise Dlx(data base) to set the optimal number
records for our PI processing .can any one please tell me for this question.

Thanks

Narendra

Accepted Solutions (0)

Answers (3)

Answers (3)

iaki_vila
Active Contributor
0 Kudos

Hi Narendran,

The only way to know it is to work together with the DB team. You can prepare a SOAP - JDBC scenario for testing purposes and to prepare a set of request with (1 - 10 - 100 - 1000 and so on).

You make the requests and the DB team make a monitoring of the DB resources. Later with your requests and their monitoring you can figure out what is the best approach.

Regards.

Former Member
0 Kudos

Just adding to the other comments here, there are some factors that need to be considered before you can work out the ideal result set size. I'm assuming that because you need the DB team to configure the result set size that you're using stored procedures and not a query configured in the channel? Either way, the science is not exact and I generally employ a process like below:

  1. Remember that the result set is returned as XML so calculate the size of a single record XML payload
  2. When you have the smallest XML size, roughly calculate the payload size for 10 records, 100 records, 1000 records etc
  3. Try to limit the payload size to around 1-2MB however testing might allow for larger messages if you have a high amount of memory allocated to the Java heap
  4. Consider the message mapping complexity. Take sample messages from step 2 and run it through the mapping and find a balance between throughput and message size
  5. Consider the receiver's ability to handle the payload. Test with various message sizes before settling on the optimal number of records

Hope this helps.

former_member270261
Participant
0 Kudos


Hi Sritharan

yes,it is database side.

Thanks

Narendra

former_member186851
Active Contributor
0 Kudos

Hello Narendran,

It depends on how much data you wish to update and store.And also on the RAM size like how many queries can be handled.

You can refer the below link which similar to your query.

http://stackoverflow.com/questions/1276/how-big-can-a-mysql-database-get-before-performance-starts-t...

former_member186851
Active Contributor
0 Kudos

Hello Narendram

Where you would like to set the optimal size ,Is it In database?