Import Server detects file in Ready folder but does not process

[Former Member]

I have a problem where MDIS detects a file in the ready folder, but it does not launch the import:

2772 2008/10/22 23:37:52.240 1.xml

Source file retrieval: Delta: 0.001451 seconds.

2772 2008/10/22 23:38:23.428 1.xml

Source file retrieval: Delta: 0.001151 seconds.

2772 2008/10/22 23:38:54.678 1.xml

Source file retrieval: Delta: 0.006335 seconds.

2772 2008/10/22 23:39:25.897 1.xml

Source file retrieval: Delta: 0.011595 seconds.

2772 2008/10/22 23:39:57.272 1.xml

Source file retrieval: Delta: 0.003268 seconds.

2772 2008/10/22 23:40:28.507 1.xml

Source file retrieval: Delta: 0.006276 seconds.

The log file shows the above. You can see it detects the file is there, but since it does not launch the import it does not process the file or even move it to the exception or archive folders. I have confirmed settings in the MDIS.ini file, e.g. password, etc. I can import the same file using Import Manager without any errors.

Please help!

[Former Member]

Hi,

Keep only one port for MDIS to process i.e. the current work you are working on. Set Processing Type = Manual for time being for all other inbound ports and then try.

Regards,

Jitesh Talreja

[Former Member]

Hi all,

Thanks for all the suggestions. Unfortunately the problem is not solved.

The PORT in Console shows "Has Data", so MDIS definitely detects that there is a file waiting to be processed. I have confirmed Port configuration, i.e. correct map and format settings, processing is set to automatic, etc. If I open the source file in Import Manager with the same map I am immediately able to import the file successfully without having to first change any mapping or record action settings.

4792 2008/10/23 08:33:44.888 22355-3-1-10-23-08-06-32-57_081023-063303_000.xml

Source file retrieval: Delta: 0.003527 seconds.

4792 2008/10/23 08:34:16.326 22355-3-1-10-23-08-06-32-57_081023-063303_000.xml

Source file retrieval: Delta: 0.005480 seconds.

4792 2008/10/23 08:34:47.592 22355-3-1-10-23-08-06-32-57_081023-063303_000.xml

Source file retrieval: Delta: 0.009986 seconds.

4792 2008/10/23 08:35:18.796 22355-3-1-10-23-08-06-32-57_081023-063303_000.xml

Source file retrieval: Delta: 0.006302 seconds.

It is as if MDIS detects the file is there and writes to the log file that the file is being retrieved, ... but then it does nothing. I have confirmed MDIS.ini file is correct, including user and password settings. If there was something wrong with the import file I would've expected MDIS to move it to one of the exception folders, not to leave it in the ready folder.

Your advice is appreciated.

[Former Member]

Hi Johann,

How many records are present in the import file?It could be that too many records are causing the problem.

Also check the Chunk size details and the number of records processing in parallel number it must be proportionately appropriate .

Also keep your processing interval to 0 for immediate importing.

Hope it helped

Thanks

Simona

[Former Member]

Hi Johann,

Please check the following:

1. Import actions( record import, add,update,manual)

2. Once again change the password in the MDIS.ini file and restart the import server.

3. Check the port configuraion.

Finally if there is any thing wrong in the import action it will be indicated in the LOG file as " import action failed". so please check the file you are importing.

Regards,

Vijay

[Former Member]

Hi,

1. Check the status of Port it should be empty or try with another Port.

2. Try for some other file type like Excel

3. Restart the Import Server once.

Regards,

Jitesh Talreja

[Former Member]

Hi Jitesh,

Your suggestion to try a different file type yielded positive reults. I created a simple tab delimited text file and import map and changed the existing Port from using XML based on the MATMAS05 schema to using the text file. The log shows:

6056 2008/10/23 17:32:34.066 [MDS=ROBLB2K1H2J Repos=JAN Master ClientSystem=U2K2_MDM Port=Materials_from_U2K2_MDM]: ImportTask: Task started. Chunk size[50000], No. parallel chunks[5]

4572 2008/10/23 17:32:34.144 [MDS=ROBLB2K1H2J Repos=JAN Master ClientSystem=U2K2_MDM Port=Materials_from_U2K2_MDM]: xStructuralTransformer: Thread started.

1160 2008/10/23 17:32:34.144 [MDS=ROBLB2K1H2J Repos=JAN Master ClientSystem=U2K2_MDM Port=Materials_from_U2K2_MDM]: xValueTransformer: Thread started.

4192 2008/10/23 17:32:34.144 [MDS=ROBLB2K1H2J Repos=JAN Master ClientSystem=U2K2_MDM Port=Materials_from_U2K2_MDM]: xImporter: Thread started.

4572 2008/10/23 17:32:34.144 [MDS=ROBLB2K1H2J Repos=JAN Master ClientSystem=U2K2_MDM Port=Materials_from_U2K2_MDM]: xStructuralTransformer: Thread finished; Start -> End: 0.000000000 seconds.

1160 2008/10/23 17:32:34.160 [MDS=ROBLB2K1H2J Repos=JAN Master ClientSystem=U2K2_MDM Port=Materials_from_U2K2_MDM]: xValueTransformer: Thread finished; Start -> End: 0.000000000 seconds.

4192 2008/10/23 17:32:34.660 Repository Load Successful. [JAN Master]: Delta: 0.085377 seconds.

4192 2008/10/23 17:32:35.958 [MDS=ROBLB2K1H2J Repos=JAN Master ClientSystem=U2K2_MDM Port=Materials_from_U2K2_MDM]: xImporter: Thread finished; Start -> End: 1.000000000 seconds.

6056 2008/10/23 17:32:36.458 [MDS=ROBLB2K1H2J Repos=JAN Master ClientSystem=U2K2_MDM Port=Materials_from_U2K2_MDM]: ImportTask: Task finished. Chunk size[50000], No. parallel chunks[5]

4192 2008/10/23 17:34:11.133 22355-3-1-10-23-08-06-32-57_081023-063303_999.xml

Source file retrieval: Delta: 0.006444 seconds.

4192 2008/10/23 17:34:11.242 Repository Load Successful. [JAN Master]: Delta: 0.028803 seconds.

4572 2008/10/23 17:34:43.825 22355-3-1-10-23-08-06-32-57_081023-063303_999.xml

Source file retrieval: Delta: 0.003005 seconds.

4572 2008/10/23 17:35:16.018 22355-3-1-10-23-08-06-32-57_081023-063303_999.xml

Source file retrieval: Delta: 0.010113 seconds.

4572 2008/10/23 17:35:47.742 22355-3-1-10-23-08-06-32-57_081023-063303_999.xml

Source file retrieval: Delta: 0.001994 seconds.

4572 2008/10/23 17:36:19.419 22355-3-1-10-23-08-06-32-57_081023-063303_999.xml

Source file retrieval: Delta: 0.012413 seconds.

The text file was immediately picked up and imported. This thus proves that (1) MDIS is functioning, (2) user / password is correct. Unfortunately you will also see from the log above that when I changed the port back to run on XML the problem has not been resolved.

Any ideas?

[Former Member]

Hi,

Lets drill down the problem. Uptill now MDIS is working fine. Lets try with some different XML containing two-three records with simple structure. If this simple XML picked by MDIS then there would be some problem with the file you are trying to import may be in structure or data.

Regards,

Jitesh Talreja

[Former Member]

what is the platform you have MDM on,

check Import manager reference guide pg 386 table 89 and see if your platform even supports XML processing , and is it complex xml that you are trying to process, what is the fiel size, try to set the poll interval at bit higher right now looks like it is the default 30 sec, give it some more time and see what happens?

-Sudhir

[Former Member]

I'm running MDM 5.5 SP6 build 5.5.63.73 on 32 bit Wintel.

As I said in my previous posts, I can open the XML file with the map assigned to the Port in Import Manager and import the file successfully. The only complex operation that I do on the XML is to create a Pivot Table from one of the repeating segments. In Import Manager it works fine.

If there was a problem with MDIS processing the file I would've expected it to move the file to one of the exception folders, not to leave it in the Ready folder and write to the log that is detecting the file.

I'll try the suggestion to increase the polling interval. I'll also try with a simpler XML.

Thanks for all the repsonses everybody!

[Former Member]

on second thoughts......server will actually log a message saying "this file type is not supported on the platform"

So try setting interval higher may be 10 mins and see if it works

[Former Member]

Hi everyone.

I think I have isolated the problem. The XML file that I'm trying to import is quite complex, it is based on MATMAS05 and has several repeating segments. Import Server can import the file successfully, as long as I do not create a Pivot table from the XMl file. I need to create a Pivot table because I have to flatten the data in one of the segments. It seems MDIS is unable to reproduce the Pivot table. I'm still puzzled on why I don't see some kind of error or warning message in the MDIS log, but at least I know now that MDIS works fine with the XML file, ... that is until there's a Pivot table created in the import map.

Any suggestions?

[Former Member]

Hi Johann,

Check for few things:

- Try restarting the Import server from the services .

- Check to see if you have made the correct configurations in the port settings like setting the processing type to Automatic.and given the correct map name and format.

- The name of the File in the map must match with the name of the source file other wise it wont get imported throwing an exception.Say for example when you created the map teh source file name was Sheet1 and when you are automatically importing the source file name is something differnt .then it will not import the file.

- Also note to see that teh correct username and password are given for the repository in MDIS.ini file.

Your logs shows that there seems to be some problem in the Import server or else the Import server configuration due to which it is not importing the source file.

Hope It Helped

Thanks & Regards

Simona Pinto