January 6, 2005 at 8:03 am
I have never used a splitting software for automation tasks but I'm pretty sure winrar could do it. Here's a search from download.com that could get you started on other file splitters :
Basically you take your huge file and split it to the desired size into X parts. Then you transfer each parts and after everything has been transfered you use the same program to rejoin the small chuncks into the original file.
Or another option could be to write a small activex script to use in dts to split the file and ftp it (I'm assuming you are transfering text files). Then you could rejoin the files on the other server using a vbs script or another dts.
However all this assumes you can send as many small files to the ftp server and that you won't be stopped again at 30 mbs.
P.S. If that still fails I would check if the ftp server blocks the account to 30 mb of drive space for uploads... but I guess you already thaught of that.
January 6, 2005 at 8:17 am
OK, I understand what you are saying....
I don't know if we could split the files on the UNIX box though.
My only problem is that this would be a work around, not a permanent solution. Currently I'm using the other node of our cluster to transfer the files via FTP then doing a Copy to our SQL box that needs the files.
Thank you very much for the ideas....I'd love to solve this one!
January 6, 2005 at 8:28 am
This could become an automated task... but the best option is to find out why you're stuck at 30 mb... I can't help you on that matter since I never worked on a network and I'm no ftp wiz.
However I'd be glad to provide help with a script to split the file if you want but that's all I can offer.
Good luck.
January 6, 2005 at 9:44 am
Don't worry about the script Remi, but thank you for all of your ideas. We are looking into some alternatives to FTP but security is a big factor in our decision.
Thanks for all the help...keep the ideas coming. I appriciate everyone's time.
January 10, 2005 at 7:18 am
January 11, 2005 at 1:11 pm
New ideas welcome....please help!
Thank you :: MATT
January 13, 2005 at 3:18 am
If security is a big factor. then you need to get to the bottom of this...
Work with everone, *NIX, cluster, firewall.. well, all that may be involved. Find out what has changed from before (and don't take 'nothing' as an answer - something has changed for sure)
This is not a normal behaviour, and you need to solve it, not hide it by switching from FTP to something else.
The truth is out there....
/Kenneth
January 13, 2005 at 3:38 am
But where?
January 13, 2005 at 4:30 am
I would guess closer to you than me
Good luck hunting - it seems to be a tricky one. Have no bright ideas at the moment, except that I do believe it to be permission related, one way or another.. (most of all problems are in fact permission related..)
/Kenneth
January 13, 2005 at 5:36 am
HAHA, The search is continuing....hopefully the end will come soon.
January 14, 2005 at 9:05 am
To the top!?!?
January 18, 2005 at 3:09 am
Perhaps ypu could give us some details of things you've done, stuff verified to work / be configured as expected, how it's configured, what's been tested, what's been not etc...
/Kenneth
January 18, 2005 at 1:10 pm
Please see the proceeding comments, I don't know what else to say about the problem.
Thanks :: MATT
January 19, 2005 at 2:36 am
Well, perhaps you could summarize it?
I'm asking, not because I'm too lazy to read, but because sometimes when backtracking and gathering together suggestions, what one have done etc, might bring some new light to a problem - something not thought of before, overlooked, people not spoken to about the problem or whatever. Sort of a 'fresh eyes' view so to speak. Most problems are solved (especially when one gets stuck) when reiterating them for the n th time. Also, the thread has become quite long, so a summarization would make it easier to spot what's been covered and what not.
/Kenneth
January 19, 2005 at 5:27 am
I will post something up later, I wasn't implying that you were too lazy to read back. It was more of a I don't have time to stop and write a summary right now.
Thanks for your thoughts Kenneth
:: MATT
Viewing 15 posts - 31 through 44 (of 44 total)
You must be logged in to reply to this topic. Login to reply