Exceptions on Port Load

[Former Member]

Hi all

We are loading using Port and we have some issues with data for a date field. What we would like to do is load all records that are correct and then reprocess only the records that have an invalid date later. e.g 5000 records with 25 records in error. We want to reprocess only the 25 records.

What I have seen so far is that we can block the port (optional setting, mds) but are forced to reprocess all the (5000) records fixing the error for the 25 records and then running to Import Manager create the 25 that were in error and skip the 4475 others.

Is this the only way?

Any suggestion?

Rgs

C

[Former Member]

Hi ccr,

If you are concerned about only the data in date field, which needs manual interaction.

I would suggest the following solution.

Lets define two maps.

1. Map all the fields with out the date

This way you can load all the 5000 excluding the date field using Port.

2. One with the date mapping

Use import manager to update the date field with the correct values.

Hope this helps.

Thanks and Regards

Subbu

[Former Member]

Hi ya

Thanks for your reply.

This we could do but our concern is that we will have a hugh volume of data to load (millions) and we want to run to import process and then process the data in error after.

We do not want to have to "intervene" prior to every load and adjust our mapping.

Regards

C

[Former Member]

Hi ccr,

<b>and then process the data in error after.</b>

currently how are you handling the records which are giving error or which has some problem with the date

What kind of data issues you are facing with the date field

Thanks and Regards

Subbu

[Former Member]

Hi ya

the date value is incorrect. We can convert in import manager and save this conversion as part of out map but this would would mean that we would have to process every incorrect value in the load like this which we don't want to do

The inmport server will reject to records that have this error but we still have to process all the file that was imported via the port if we want to correct the exceptions. Another example: So if we load in the port a file with 200,000 records and 800 are in error, what I have seen so far is that you need to reprocess the complete file of 200,000 and correct to 800.

What we want is just to isolate the 800 are reprocess at a later stage.