File to SAP with huge ammount of data

[Former Member]

Hi,

what is the best way to store data, coming from file adapter, to a SAP Z-Table through XI/PI ?

Sender = File Adapter (one file with aprox. 1,5 million records)

Structure = simple structure with 5-10 fields

Receiver = SAP Z-Table (Mapping 1:1)

Thx,

Gordon

[Former Member]

Gordon,

Check out this blog...

/people/sravya.talanki2/blog/2005/11/29/night-mare-processing-huge-files-in-sap-xi

Hope this will help.

Thanks,

Nilesh

[Former Member]

Hello,

is not an explanation of how to do it....but.....there are cases. and in the 28 slide you can see the hardware requirement...is this help you.

https://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/c02b4fc0-be11-2a10-4984-9713585ca128&overrid...

Regards,

lpbuff

[Former Member]

Satish,

1. do you have some info about the proxy configuration for that scenario ?

2. what about using idoc instead of rfc / proxy ?

[Former Member]

Hi Gordon,

> 1. do you have some info about the proxy configuration for that scenario ?

You need to do some settings for proxy communication. Please check this blog for the same:

/people/vijaya.kumari2/blog/2006/01/26/how-do-you-activate-abap-proxies

>2. what about using idoc instead of rfc / proxy ?

Why do you want to create an idoc for updating one table. Its very simple logic. Just you need to load the data whatever you are getting. So it will be a simple proxy or rfc to create / update the table. It is the easiest route.

Regards,

---Satish

[Former Member]

Hi Gordon,

In your file communication channel you have the option recordsets per message. Here you can give a number like 10,000 here even if your file has a million records when it reads the file it takes 10,000 at a time so that your payload will gets divided and will be small so that its easy for processing. Once you read this you can load into ztable using an rfc or a proxy. Dont try to load the data into the table directly using jdbc adapter. Best always to go with proxy or an rfc.

Regards,

---Satish

[agasthuri_doss]

Hey,

>Sender = File Adapter (one file with aprox. 1,5 million records)

Is it fine to Chunk the file,

Cheers

Agasthuri

[Former Member]

Can i chunk this in XI ?

[Former Member]

hi,

If it is dev system then you can give a try. However SAP recommends the file size should be less than 5mb.

Regards,

Venu V

[agasthuri_doss]

Hey,

I was mentioning is it possible to chunk in source side,

Cheers

Agasthuri

[former_member181962]

Hi Gordon,

This discussion might give you some insights into your problem.

Regards,

Ravi Kanth Talagana