MDM: Import automation issue

[Former Member]

I am facing issues implementing the import automation.

I have created a repository and a table to store supplier information(Table: supplier).

To make it simple, we have only 2 columns (Supplierid, suppliername ).

I was able to develop a map in import manager and able to execute the import.

However moving further I tried to automate this and created a port in console.

I also dropped the file(that was used to import manager earlier, again deleted rows in data manager) in ready, after few seconds, file is moved from ready folder to archive folder, and also logs are generated.

However I dont see any data getting imported when I look in data maanger.

I need guidance on where do I further check.

Thanks

Amit jain

[former_member182007 · Accepted solution]

Hey Amit -

Consider few points:

1. Check your user permission to import the data via MDIS and make sure password for it should be encrypted in MDIS ini file

2. Are you doing an auto import of Excel file ..? If you are with MDM 7.1 ..as per my understanding it doesn't support. go with IM manually. or convert it into some xml format for Auto import.

3. Make sure your port property has been set automatic in console and mapping has done correctly.

4. Check if your port status shows .."Has Data"

Hope this helps.

thx

Deep

[Former Member · Accepted solution]

Hi Guys,

<br>

I am putting a delimited (comma separated) file in the ready folder. I also did save - update, but did not help. Port has

status -- 'Empty'.

<br>

<br>

*Port definition*:

<br>

Name: mysupp<br>

code: mysupp<br>

Type Inbound<br>

Remote System: SRM<br>

Map: mysupp<br>

Format: Delimited Text<br>

Columns:<br>

Deloimiter: ,<br>

XML Schema:<br>

Processing Type: Automatic<br>

File Aggregation Count: Yes<br>

Block on Structural Exceptions: Yes<br>

Status: Empty<br>

<br>

<br>

Input file has 12 records:

<br>

<br>

*Log file*:<br>

<br>

<?xml version="1.0" encoding="utf-8"?><br>

<?xml-stylesheet type="text/xsl" href="MDM_Log.xsl"?><br>

<MDM_Log version="1.0" path="D:\usr\sap\MSD\MDIS21\exe\MDIS_Temp\MDIS_TASK4_20110915063253.xml"

><br>

<Open ts-long="06:32:53 GMT, Thursday, September 15, 2011" ts="2011/09/15 06:32:53.238 GMT" pid="10604" host="ldndsmsa0016" compile-type="WIN64_RELEASE"><br>

<Version ts="2011/09/15 06:32:53.254 GMT" tid="8620" entry-no="144"><Server>7.1.06.239</Server><Build>Built on 2011-Jun-10</Build></Version><br>

<Trace ts="2011/09/15 06:32:53.254 GMT" tid="8620" entry-no="145">[MDS=ldndsmsa0016 Repository=SRM_MDM_AKJ_Demo ClientSystem=MDM Port=mysupp]: Chunk size/parallel[2000/40]: Import Task Started.</Trace><br>

<Timer ts="2011/09/15 06:32:53.269 GMT" tid="8620" entry-no="146" name="GetInitializationInfoAllLanguages" total="6869.039265"/><br>

<Timer ts="2011/09/15 06:32:53.269 GMT" tid="8620" entry-no="147" name="Add User Dimensions" total="0.001896"/><br>

<Timer ts="2011/09/15 06:32:53.269 GMT" tid="8620" entry-no="148" name="Regular Table Load" total="0.135978"/><br>

<Timer ts="2011/09/15 06:32:53.269 GMT" tid="8620" entry-no="149" name="data Table Load " total="0.012587"/><br>

<Timer ts="2011/09/15 06:32:53.285 GMT" tid="8620" entry-no="150" name="relationship Table Load " total="0.003757"/><br>

<Timer ts="2011/09/15 06:32:53.285 GMT" tid="8620" entry-no="151" name="tuple Load " total="0.002281"/><br>

<Timer ts="2011/09/15 06:32:53.285 GMT" tid="8620" entry-no="152" name="Caching Repository info [SRM_MDM_AKJ_Demo]" total="6887.638981"/><br>

<Trace ts="2011/09/15 06:32:53.285 GMT" tid="8620" entry-no="153">1 Source file(s) retrieval + Repository Caching: 52.599948 milli-seconds.<LF/>-- mysupp.csv</Trace><br>

<Trace ts="2011/09/15 06:32:53.285 GMT" tid="8620" entry-no="154">Processing source file: mysupp.csv</Trace><br>

<Trace ts="2011/09/15 06:32:53.285 GMT" tid="9448" entry-no="154">xValueTransformer: Thread started.</Trace><br>

<Trace ts="2011/09/15 06:32:53.285 GMT" tid="11912" entry-no="156">xStructuralTransformer: Thread started.</Trace><br>

<Trace ts="2011/09/15 06:32:53.285 GMT" tid="11584" entry-no="157">xImporter: Thread started.</Trace><br>

<Trace ts="2011/09/15 06:32:53.285 GMT" tid="8620" entry-no="158">INEDX FIELD_NAME<LF/>----

---

<LF/>[0] id<LF/>[1] name<LF/></Trace><br>

<Trace ts="2011/09/15 06:32:53.285 GMT" tid="9476" entry-no="159">xFreeBlockTextStreamerThread: Thread started.</Trace><br>

<Timer ts="2011/09/15 06:32:53.285 GMT" tid="9476" entry-no="160" name="Chunk parse and population" total="0.000000">1</Timer><br>

<Trace ts="2011/09/15 06:32:53.285 GMT" tid="9476" entry-no="161">Parsed and populated Chunk No: 1 w/ 12 segments.</Trace><br>

<Trace ts="2011/09/15 06:32:53.285 GMT" tid="9476" entry-no="162">xFreeBlockTextStreamerThread: Thread finished; Start -&gt; End: 0.000000000 milli-seconds.</Trace><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="11912" entry-no="163" name="Structural Transformation" total="0.000000">1</Timer><br>

<Trace ts="2011/09/15 06:32:53.301 GMT" tid="11912" entry-no="164">Structural Transformation completed for Chunk No: 1 w/ 12 segments.</Trace><br>

<Timer ts="2011/09/15 06:32:<br>53.301 GMT" tid="9448" entry-no="165" name="Value Transformation PopulateValue stage 1" total="0.000000">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="9448" entry-no="166" name="Value Transformation LoadCompoundFieldTransformation" total="0.000000">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="9448" entry-no="167" name="Value Transformation PopulateFieldWithMap" total="0.000000">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="9448" entry-no="168" name="Value Transformation PopulateValue stage 2" total="0.000000">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="9448" entry-no="169" name="Get Flattened Source Records" total="0.000000">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="9448" entry-no="170" name="Value Transformation" total="0.000000">1</Timer><br>

<Trace ts="2011/09/15 06:32:53.301 GMT" tid="9448" entry-no="171">Value Transformation completed for Chunk No: 1 w/ 12 segments.</Trace><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="11584" entry-no="172" name="Get Lookup Field And Foreign Key Info" total="0.000000">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="11584" entry-no="173" name="Record Matching - Get Unique Fields" total="0.000000">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="11584" entry-no="174" name="Record Matching - Set Match Record Data" total="0.000000">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="11584" entry-no="175" name="Record Matching - Init Match Record" total="0.000000">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="11584" entry-no="176" name="Record Matching - GetSourceRecords" total="0.000000">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="11584" entry-no="177" name="Record Matching - GetMatchValues" total="0.000000">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.301 GMT" tid="11584" entry-no="178" name="Record Matching - [*** Time spent on MDS ***]" total="3.048244">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.316 GMT" tid="11584" entry-no="179" name="Record Matching - Match Record [Total]" total="0.000000"/><br>

<Trace ts="2011/09/15 06:32:53.316 GMT" tid="11584" entry-no="180">Importing: &apos;mysupp.csv.Root.Text_Table&apos; Table --&gt; &apos;SRM_MDM_AKJ_Demo.Supplier&apos; Table.</Trace><br>

<Timer ts="2011/09/15 06:32:53.332 GMT" tid="11584" entry-no="181" name="Import Records - Stage 1 - Prepare Import Records" total="0.000000">1</Timer><br>

<Timer ts="2011/09/15 06:32:53.332 GMT" tid="11584" entry-no="182" name="Import Records - Stage 2 - Filter/Merge" total="0.000000">1</Timer><br>

<Trace ts="2011/09/15 06:32:53.347 GMT" tid="11584" entry-no="183">Import action:<LF/>Skip: 0<LF/>Create: 0<LF/>Updated (NULL fields only): 0<LF/>Updated (all mapped fields): 0<LF/>Replace: 0<LF/>Delete [destination]: 0<LF/>Value Exceptions: 0<LF/>Import Exceptions: 0</Trace><br>

<Timer ts="2011/09/15 06:32:53.347 GMT" tid="11584" entry-no="184" name="Total chunk import time -" total="0.000000">1</Timer><br>

<Trace ts="2011/09/15 06:32:53.347 GMT" tid="11584" entry-no="185">xImporter: Total chunk import time: 0.000000000 milli-seconds.</Trace><br>

<Trace ts="2011/09/15 06:32:53.347 GMT" tid="11584" entry-no="186">12 Segments were Successfully imported.</Trace><br>

<Trace ts="2011/09/15 06:32:53.394 GMT" tid="11912" entry-no="187">xStructuralTransformer: : Start -&gt; End: 0.000000000 milli-seconds.</Trace><br>

<Trace ts="2011/09/15 06:32:53.394 GMT" tid="11912" entry-no="188">xStructuralTransformer: Thread signalled to stop: RC = 0x0</Trace><br>

<Trace ts="2011/09/15 06:32:54.285 GMT" tid="9448" entry-no="189">xValueTransformer: : Start -&gt; End: 0.000000000 milli-seconds.</Trace><br>

<Trace ts="2011/09/15 06:32:55.300 GMT" tid="11584" entry-no="190">xImporter: : Start -&gt; End: 0.000000000 milli-seconds.</Trace><br>

<Trace ts="2011/09/15 06:32:55.300 GMT" tid="8620" entry-no="191">[MDS=ldndsmsa0016 Repository=SRM_MDM_AKJ_Demo ClientSystem=MDM Port=mysupp]: Chunk size/parallel[2000/40]: Import Task Finished.</Trace><br>

</Open><br>

</MDM_Log><br>

Edited by: Amit Jain on Sep 15, 2011 12:13 PM

[former_member182007 · Accepted solution]

Your file is blocked ...and port doesn't have any data to process. make sure maps are proper and the remote system details you have given correctly.

thx

Deep

[Former Member · Accepted solution]

Hi Amit,

Check if you have exceptions.If yes sort them out.

Thanks,

Ravi

[Former Member · Accepted solution]

Hi,

Please check your Import Map for the Action to be taken on Match Records. You have to select either Create/Update/Skip on match of records based on your key field.

Read the Import Manager Reference guide for more details - page 28

http://help.sap.com/saphelp_mdm71/helpdata/en/4b/72b8e7a42301bae10000000a42189b/MDMImportManager71.p...

Thanks,

Shambhu.

[Former Member · Accepted solution]

Guys,

It worked like a miracle. I had the following issues and finally sorted based on your inputs.

1> We are on MDM 7.1 and the udpated the password from console which eventually updated the MDIS.ini file. Restarted the MDIS only

2> Import map defaulat action was set to Skip, so although the file was read, records were getting skipped. Now we change it to create for new and replace for existing and saved it.

Closing this thread. points awarded.

Thanks

Amit kumar Jain

[Former Member]

HI Amit,

Read assertions in the logs that will guide you the exact cause of this problem.

Also open the import map and do a "Save update",this should solve the issue.

Thanks,

Ravi