December 4, 2008 at 6:29 am
I have a Foreach loop that is copying a set of large files to different destinations. I would rather have the loop just start the copy and keep moving without waiting for it to complete. Is this possible?
December 4, 2008 at 7:23 am
Not that I know of. How many files do you have? If it's a small number of files, you could set up a sequence container containing a Filesystem Task and have each one run in parallel.
Tim Mitchell
TimMitchell.net | @tmitch.net | Tyleris.com
ETL Best Practices
December 4, 2008 at 7:37 am
It's a dynamic list so I can't do them statically in parallel.
December 4, 2008 at 7:45 am
What's the source of your dynamic file list?
Tim Mitchell
TimMitchell.net | @tmitch.net | Tyleris.com
ETL Best Practices
December 4, 2008 at 7:48 am
a SQL table
December 4, 2008 at 8:03 am
To do this in parallel, I think you'll need duplicate components. Perhaps you could create a few script tasks/components to do an alpha split (or other selective copy) and handle groups of files in parallel.
If you want to pursue this and need some help with the scripting, let me know.
Tim Mitchell
TimMitchell.net | @tmitch.net | Tyleris.com
ETL Best Practices
December 4, 2008 at 8:50 am
Thanks for your help. I think I can manage the scripting if that's the way I decide to go. I appreciate your input.
December 4, 2008 at 8:57 am
No problem. Good luck - it sounds like a fun project.
Tim Mitchell
TimMitchell.net | @tmitch.net | Tyleris.com
ETL Best Practices
Viewing 8 posts - 1 through 7 (of 7 total)
You must be logged in to reply to this topic. Login to reply