Problem reading multiple files using SFTP sender adapter

[Former Member]

Hi Everyone,

We are using a SFTP-PI-Proxy interface and I have a problem with our SFTP sender adapter as its not picking multiple files, I had used a wildcard in the filename of the format filename*.xml in the communication channel, but it's just picking up the first file and processing it, and the rest of the files are not processed.

Our authentication method is userid/password.

I've also checked the Seeburger monitor which shows, that the files have been polled and all the files have a status as 'Initiation to backend pending'.

Anybody has any ideas on how to make the SFTP adapter pick multiple files? or suggest another alternative?

Thanks,

Priya.

[Former Member]

Resolved

[gagandeep_batra]

Hi Priya

can you tell me how you resolve this issue?

Regards

Gagan

[Former Member]

Anybody with ideas/solutions??

[Former Member]

Hi Priya,

Currently I am also working on sFTP adapter & I have configured many sFTP channels, but none of them is facing such an issue.

All the channels are capable of handling the multiple files at a time.

Once the first file is processd, what do you see in channel? Is the channel still polling but no file is coming or channel simple stops polling?

-Supriya.

[Former Member]

Hi Priya,

Try to restart the communication channel and check.

Thanks,

[Former Member]

hi supriya,

what's the filename convention that u have been using??

The comm. channel monitoring looks like this for the first run with first file:

Polling finished

Task finished with success

c8f51e00-400b-11e0-afc7-00215a442028 Message initiated succesfully

Processing task

Polling started.

for next run its as follows

Polling finished

Task finished with success

Task finished with success

Processing task

Polling started.

and it keeps on polling but no message is initiated...but channel is up and running.

@hareenkumar,

I've put the CC on a Automatic control off : so currently for testing purposes I manually start or stop the channel.

P.S : we are using Seeburger SFTP adapter

thanks,

Priya.

[Former Member]

Hi Priya,

I am using a particular filename like, DELIVERY* & it is working fine.

Even I am using SEEBURGER sFTP adapter.

I think it is worth checking the naming conventions of the other files, if it is matching with what you have configured in channel.

Also, what if you off the channel & make it on again after every poll, is it then picking the files from folder? Please check this.

-Supriya.

[Former Member]

thanx for the reply...

our files are all named as file_sc_10.xml , file_sc_11.xml...that is they r all in a sequence and i have tried with the options

file* , file_sc* , file_sc_*.xml,

file_sc_* etc ..

if i switch off the channel n start it again, it starts polling depending on the interval set in the comm. channel. for ex: if i set the interval to 2, after starting it waits for 2 mins n starts polling

Edited by: Priya Parvathi Jammalamadaka on Feb 25, 2011 1:04 PM

[Former Member]

Hi Priya,

Check whether you have used Thread.sleep() in any of the UDF.

Thanks,

[aashish_sinha]

Check the filename of other files too.Look if your files have the common name.

Regards

Aashish Sinha

[Former Member]

hi chirag,

i tried but it doesnt work, only the first file gets picked up...

@Aashish

all the filenames are of the format: filename_50.xml,filename_51.xml...etc...

[aashish_sinha]

Hi,

Use filename* in sender communication channel. Can you please check what is happening for this Sender Communication Channel in Communication Channel monitoring? look, if you getting any error.

Regards

Aashish Sinha

[Former Member]

just to verify - can u put * and try ....need to verify whether * is picking all the files or not..

also check RWB- comm monitoring....what log it is showing...

chirag

[Former Member]

hi aashish,

I have been doing that ...i dont get any error:

The first file sequence is

Polling finished

Task finished with success

c8f51e00-400b-11e0-afc7-00215a442028 Message initiated succesfully

Processing task

Polling started.

for next run its as follows

Polling finished

Task finished with success

Task finished with success

Processing task

Polling started.

there is no mention of Message initiated succesfully and neither does it comes up in SXMB_MONI.

[aashish_sinha]

Hi ,

Here is the problem. Somehow, adapter is getting only one filename as a matching file name. otherwise if source contains multiple files with filename*, it should pick all the files in one fetch.

Please check the source directory if it contains the files as suggested filename. Because next pooling is not able to pull the file because source doesn't contains the desired files. Communication channel is running fine.

you will see only one message in moni coz only one message got processed.

Regards

Aashish Sinha

Edited by: Aashish Sinha on Feb 24, 2011 12:59 PM

[Former Member]

hi aashish,

The source directory has unique filenames as mentioned before and im giving the exact filename convention...

which in actual are : file_sc_98.xml, file_sc_99.xml...file_sc_100.xml...etc

sorry i mistyped before abt the filename format....

I;ve tried checking the delete file option,...but nothing works...if i uncheck that option it keeps on polling the first file continously...

currently i tried putting just * in the filename..but still its not working as per my need.

[Former Member]

can u check the permission of the other files also what is the polling intervals u have specified in file adapter - try to increase that and then check..

chirag

[aashish_sinha]

Ok. Now final try.

in Sender CC, fill these parameters.

Click on Advance Selection for Source File - Then on Directory - use same source Directory and File name mask - use same File*.

Check ftp parameters : data connection - Passive

connect mode - permanent.

Now try to fetch the data and see if you getting the files from source.

Regards

Aashish Sinha

[Former Member]

hey aashish...

Are u sure u r referring to SFTP sender CC?? coz i dont find those options for an SFTP sender.

[aashish_sinha]

No worry, if you don't find :). probably was available in FTP.

Whatever you see just try it. and next is, as suggested by chirag look out for permissions.

Regards

Aashish Sinha

[Former Member]

hi chirag,

we have full permissions on that directory...I;ve set an interval of 5min. and also, for testing purposes we have an test directory on which full permissions(including deleting the file).

Just for you info: its a SEEBURGER SFTP adapter.

Is multiple file handling possible at all with SEEBURGER SFTP adapter???

@aashish,

Whatever you see just try it. and next is, as suggested by chirag look out for permissions

I've posted here for some solution/alternative method to achieve our requirement....help me in pointing to relevant/proper info.

[Former Member]

have u tried with this file name - filename*

chirag