April 22, 2008 at 11:40 am
I help manage many Sybase databases running on AIX. I need to perform "data drops" that push production data out to test and development servers. Currently, this is done using BCP, tar, shell scripts, and DBArtisan.
I would like to automate all or most of this using SSIS, if possible. My biggest concern is that moving tens of gigabytes of data from AIX to the Windows server and then to another AIX server will totally devour our network bandwidth.
So, my question is, has anyone used SSIS to move data between non-SQL Server (Unix) boxes with fairly large volumes of data? I would love to hear of your experience.
TIA,
Mike
April 22, 2008 at 12:44 pm
I have moved lots of data between Oracle servers, and some data (1-2gb per night) from pretty old Sybase databases to SQL Servers.
SSIS will devour bandwidth as needed. No matter what you use, it is going to need to transfer the data. The down side in your case is that you have to move everything from your AIX server, to the windows server, and then to another AIX server. It would be nice to not have the extra hop - it is going to slow things significantly.
I had lots of problems with Sybase, but it was an older version that did not have any OLEDB drivers for it. So, I was stuck with ODBC which is just horrible for performance.
If I were in your position, I would probably look for an approach that did not require the transfer of everything to a third server before I settled on SSIS. If you cannot find anything that is usable from one of your Sybase servers, SSIS is certainly a viable solution.
Wouldn't it be nice if all database engines came with a full blown ETL product?
April 22, 2008 at 5:53 pm
Thanks! My idea was to create a parameter-driven package for each database, where I could change the source and target databases and then the package would handle everything else.
The problem for my team is that this currently is a very labor-intensive process and being able to automate it may not speed it up very much (because the data still has to travel throughout the network) but it would free up the DBAs to do other things.
Mike
Viewing 3 posts - 1 through 2 (of 2 total)
You must be logged in to reply to this topic. Login to reply