Neuron ESB User Network

The Service Bus for the Connected Business

FTP/FTPS - archive or timestamp comparison - best practices

Hello

We seem to be reading quite a lot of FTP/FTPS (not SFTP) files, I know it probably is a bit oldfashioned but this is our reality.

Now I am facing a few challenges:

FTP/FTPS adapter is monitoring a folder on a Remote FTPserver (30 sec. polling interval), publishes if there is a new file and the OnPublish starts a process (a couple of DB operations)

The FTP/FTPS adapter is set to archive the file to ArcheveFolder on the remote FTPserver.

This works very nicely 99% of the time.

1% of the time I see the an identical file being downloaded with e.g. 5 minutes between. 

I do not want this to happen.

I got a feeling that this might happen because of some work on the server hosting Neuron or the surrounding network but not certain. I know the server is not restarted. 

The explanation could be that if there is some work on the server that interrupts the process then perhaps the FTP/FTPSadapter never gets to archiving the file. 

The remote server could also be the problem: perhaps they are doing work there, which is difficult to get a fast answer about since they have outsourced their IT operations.

And I have started thinking about using timestamp comparion in stead.

So the question is:

Do any of you other Neuron folks have experience in the area and found e.g. TimeStamp comparison to be more stable/precise than using Archive Folder?

The files I want to downlaod all have unique filenames: named from the year+week they were built.

Views: 131

Reply to This

Neuron ESB Product Support Forums and Communities

Latest Activity

Anupama Nair posted a discussion

Marketo Adapter Invalid Token

Hi,We are using the Marketo adapter to push account updates to Marketo. It works well for some time then starts failing with Invalid Token unless restarted. Is there a configuration that can be done so it can auto refresh the token when required?Thanks!See More
Nov 6, 2023
Sayantini Basak posted a discussion

Maximum payload size(REST API) for requests interfacing to NeuronESB

I am new to Neuron ESB and in our current scenario,We need to process batch transactions comprising of ~1000 records and send them to Neuron ESB for further processing. I would like to understand what is the maximum size of payload that can be transferred using REST interface to Neuron ESB.See More
Jul 22, 2022
Profile IconRobert E Dunie and Sayantini Basak joined Neuron ESB User Network
Apr 28, 2022
Profile IconDayanand, Frederic C, Steffen Greve-Oksfeldt and 1 more joined Neuron ESB User Network
Mar 16, 2022
Profile IconCam Vong and Mitja Luznar joined Neuron ESB User Network
Jan 27, 2022
Profile IconWill Hitzges, Chad Parsons, michael larsen and 4 more joined Neuron ESB User Network
Jun 11, 2021
Anupama Nair posted a discussion

ODBC stored proc polling with temporary tables

We have set up an ODBC adapter to poll a stored proc.We found that if the stored proc has a temporary table defined the rows returned are always 0.Any idea why this would be and what we can do to get around it?See More
Dec 14, 2020
Prasanth Kharade is now a member of Neuron ESB User Network
Dec 30, 2019

Badge

Loading…

© 2024   Created by Neuron Admin.   Powered by

Badges  |  Report an Issue  |  Terms of Service