Importing when source file has a new line

[Former Member]

Hi,

While importing a pipe " | " delimted (will apply to any delimter) text file, I have Long text field from source system which is having Product Descriptions in it. Users have enterd the data in multiple lines in that field in the source system, which is a valid case .

When we have extracted the data from source & trying to Import in Import Manager, the "enter" is taking a new line & hence as a new row. How do I import the data keeping the new lines in MDM?

Product_Id|Description|Language

001|Test 1|EN

002|Test

2|EN

003|Test 3|GB

here the Product Id 002 should be imported in text large field with description having the new line character.

Thanks,

Ketan

[Former Member · Accepted solution]

This is not possible on text delimited format. I don't know why SAP never want to implement CSV format on their tools, there is the same issue in PI.

Instead, use excel or XML format to perform it, but do prefer XML format.

Do you use PI in front of MDM ? On my current project, we implement a workaround to handle carriage return in flat file.

[Former Member · Accepted solution]

No, I'm currently performing initial load of about 100,000 records & extracting data from a SQL server.

[former_member205403 · Accepted solution]

Hi Ketan,

Check if using any SQL command you can cleanup your data and remove new line characters before importing into MDM.

Regards,

Shiv

[Former Member]

Ok so the best way is to extract your data from SQL server as XML format into this kind of format:

<?xml version="1.0" encoding="UTF-8"?>

<Products>

<Product>

<Product_Id>001</Product_Id>

<Description><<![CDATA[ Test 1]]></Description>

<Language>EN</Language>

</Product>

<Product>

<Product_Id>002</Product_Id>

<Description><<![CDATA[ Test

2]]></Description>

<Language>EN</Language>

</Product>

<Product>

<Product_Id>003</Product_Id>

<Description><<![CDATA[ Test 3]]></Description>

<Language>GB</Language>

</Product>

</Products>

It is the only way to handle carriage return in Import Manager; with delimited text it is not possible.

Let us know.

Edited by: cau vianney on Mar 1, 2010 3:17 PM

Edited by: cau vianney on Mar 1, 2010 3:19 PM

[Former Member]

I cannot clean up the data using SQL as it will mean changing the source data & having new line is a business requirement

Is there any way to import this using text files only?

Regards,

Ketan

Edited by: Ketan Phanse on Mar 3, 2010 6:56 PM

[former_member205403]

Please can you provide us following details:

1. Is there any middleware in between MDM and SQL Server.

2. How MDM is connecting to SQL Server? Using text file or Directly to SQL server(no text file)?

3. In case SQL server is creating File for MDM, then how it is creating. Did you define some procedures in SQL to do so?

Regards,

Shiv

[Former Member]

Since this is the initial load, there is no middleware, we have taken a dump from SQL database to a text file & importing the same.

Thanks,

Ketan