Msecs to wait before modification check

[Former Member]

Hi All,

We have a scenario where a job writes files in a folder from where PI picks it up. We are facing issue that we are picking up incomplete files. Tried changing frequency but on occasions it kept picking up incomplete files. We are using File Adapter and NFS option.

Can the Msecs to wait before modification check fix this. If so what should be the ideal value? Should it be 0 so that every moment it will check for any changes in size or anything to that file?

Thanks,

Shaibayan

[former_member183249]

if you are using usb 2.0  it will write at 25 -35 MB/sec.

Else on hard disks it varies from 25 - 300 MB/sec. It will have higher value for SSD disk.

So if your file size is about 50MB then on average you can give 5 -10 secs.

But again i would say it will totally depend on your drive type and file size.

Regards,

Rahul

[manoj_khavatkopp]

Check this interesting link ;

[former_member183249]

Hi Manoj,

Under Advanced tab  check Advance Mode check box in file Sender adapter. And enter the value in milliseconds ( max time limit in which file will be written) to check whether file has been modified in that period of time or not.

Below is the screenshot:

This will not work if you are using File Content Conversion.

Regards,

Rahul

[Former Member]

Hi Rahul,

So this option works as below.

A file is being written at 12:00

PI polling interval is 1minute.

Say the file is still being written at 12:01. So then the PI channel will wait for whatever Msecs is set check if seize has changed and then if size is still the same will pick up the file.

Is my understanding correct?

Thanks.

[former_member183249]

Hi Shaibayan,

Yes you are right. It will check whether file has been changed in that time interval.

If interval is greater than or equal to mentioned milliseconds then it will assume file writing has been done and file will be ready for pick in next polling interval.

Else channel will skip the file.

Regards,

Rahul

[Former Member]

What is a safe value of Msec if the Polling interval is of 60secs?

[former_member186851]

There is no safe value a such,

Get the requirement like within which time the last modified file will be ready and configure accordingly.