December 13, 2011 at 7:47 am
Hello,
I'm looking for a solution for moving large files across data centers (in the sense of making it faster). Has anyone had much luck with any programs out there? I've heard of a few but none of the names come to mind.
I currently use robocopy and f-secure ftp but need something faster. I'm wondering if there are any parallel systems out there that other DBA's have used.
Thank you.
December 13, 2011 at 7:56 am
Have you looked at:
[*]How much free bandwidth there is between the datacenters
[*]How much data is to be transferred
[*]Your time requirement
To see that it is actually possible to transfer the amount of data in the desired time frame? As far as I know, robocopy is a pretty efficient.
If you don't already do so, it will help to compress the backups of course, but that would add extra overhead on the SQL Server during backup. And if you should wonder: NTFS compression will not help here.
December 13, 2011 at 11:21 am
Tristan Chiappisi (12/13/2011)
Hello,I'm looking for a solution for moving large files across data centers (in the sense of making it faster). Has anyone had much luck with any programs out there? I've heard of a few but none of the names come to mind.
I currently use robocopy and f-secure ftp but need something faster. I'm wondering if there are any parallel systems out there that other DBA's have used.
Thank you.
what type of files are you referring too, just plain files or sql serevr backup files?
on a temporary basis or ongoing?
-----------------------------------------------------------------------------------------------------------
"Ya can't make an omelette without breaking just a few eggs" 😉
December 13, 2011 at 12:13 pm
You guys are getting side tracked! 🙂
Let me rephrase the question:
Has anyone used a parallel network file moving software that they would recommend?
Thanks!
-Tristan
December 13, 2011 at 6:59 pm
Tristan Chiappisi (12/13/2011)
You guys are getting side tracked! 🙂Let me rephrase the question:
Has anyone used a parallel network file moving software that they would recommend?
Thanks!
-Tristan
We purchase a product called RocketStream about a year ago. It definitely works - getting upwards of 50-60mb/sec throughput - and sometimes over 70mb/sec. A normal FTP process or file copy (Robocopy included) will generally get around 2-3mb/sec throughput.
It really depends on the latency between the centers what your actual speeds will be.
The last time I had to copy files - I was able to copy 250GB across the WAN in about 8 hours. Without this utility it would have taken more than 24 hours.
Unfortunately, the product is no longer available...it was purchased by another company and bundled or replaced by their product.
http://www.rocketstream.com/home/default.aspx
Jeffrey Williams
“We are all faced with a series of great opportunities brilliantly disguised as impossible situations.”
― Charles R. Swindoll
How to post questions to get better answers faster
Managing Transaction Logs
December 16, 2011 at 8:31 pm
DoubleTake is worth a look. Throughput was far superior than Windows Copy. I cannot speak for it from an admin perspective though because the two shops I have been in where it was running it was maintained by the Sys Admin Team, not the Database Team.
There are no special teachers of virtue, because virtue is taught by the whole community.
--Plato
Viewing 6 posts - 1 through 5 (of 5 total)
You must be logged in to reply to this topic. Login to reply