on 02-17-2009 6:46 PM
We are running a file adapter to collect xml files from a legacy system in a shared network location. The files are picked up, information is sorted and mapped, and then sent to a proxy on our CRM system to store the data. Very simple and not-complex.
Our initial data load will consist of somewhere in the neighborhood of 900k records, which is killing CRM.
A co-worker with a bit more experience was telling me that he believes there is a way to limit the number of files that will be pulled per iteration of the file communication channel. If this is the case, can someone share with me the parameters that need to be set?
My apologies if this is a duplicate post - I have tried to look for a good answer in the forums and have come up empty.
We are running PI 7.1, and I believe it is SP 6.
Thanks in advance for the help,
Ben
Hi Benjamin,
just send them in modus (quality of service) "Exactly Once In Order" (in sequence) to send one message after the other.
Regards,
Udo
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
I appreciate the responses. I thought that was the answer, but the validation is good to have.
As a note for those who are experiencing a similar situation, I have decided to use a unix shell script to rename files in batches that are manageable for CRM to process to facilitate the loading.
Benjamin Deaver
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi Ben,
There is no standard way to limit the number of files to be processed by the communication channel.
On the Sender File CC, there is a parameter " Maximum File Size" which restricts the files bigger than the specific size, but this is just a prevention not a solution.
If you have a single big size file, then somehow you have to create small sized files out of it.
Thanks,
Pooja Pandey
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi
Limiting is not possible by the File Adapter settings.
you have to use external logic (such as scripts etc) & use OS command option of FA or other scheduling mechanism.
Regards
Vishnu
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
User | Count |
---|---|
101 | |
13 | |
13 | |
11 | |
11 | |
7 | |
6 | |
5 | |
4 | |
4 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.