March 14, 2012 at 6:56 am
I have an FTP task in a package which connects to our live FTP site and pulls down backup files to our test server so we can refresh our local dev/test db's with live.
The task connects to the FTP site and starts downloading the files. It download the first three files which are less than 150MB fine, after that it tries to download the big DB for the instance which is over 7GB and around an hour in, it errors with the connection with the server was reset.
The FTP task is set to use passive mode, 0 for the timeout and 0 for retries yet it still fails. There are two other instances whos databases are over 6 times as big as this file, so if it cant download a 7GB file how will it download the 45GB file?
If anyone knows of a way you can stop FTP connections from being reset, please let me know
March 15, 2012 at 4:44 am
as a side note to this, apart from winrar, are there any bult in commands like winrar which will split the files into multiple chunks, just thinking if I can get them to 500mb chunks and FTP them and reassemble them at the other end would get around the connection resetting
March 15, 2012 at 5:09 am
Is it always exactly 1 hour? If so, sounds like it's hitting a timeout somewhere (maybe on a proxy, firewall or the ftp server?).
You could always try one of the 3rd Party SSIS FTP components[/url] - this one says it automatically resumes where the ftp server supports it.
If you are in control of both sides of the process, you could always backup to multiple files in the backup command to split the file down...
March 15, 2012 at 5:28 am
thanks Howard thats great, it is roughly an hour into downloading that it does decide to time out, i've resulted in trying a number of ftp clients with no luck and now in the process of creating a powershell script.
one question on the link you provided, once I download and install the program to my local machine to develop the SSIS package, and then deploy it to the server, does the server need the extra components installing or can it simple run from the dtsx without installing it on the server?
March 15, 2012 at 5:30 am
Nope, it needs installing on the server that's running SSIS (It's accessed from the GAC during runtime, the dtsx just holds the class ID)
March 15, 2012 at 5:35 am
thanks, will give it a go, the downloading server is a test server so dont think there will be a problem installing the extra component
Viewing 6 posts - 1 through 5 (of 5 total)
You must be logged in to reply to this topic. Login to reply