June 6, 2014 at 3:00 pm
I have a query that polls a table for scheduled ETL tasks to initiate. The query gives me the package name and the required parameters to be fed to it. I want to execute all of them in parallel, but because the number of scheduled tasks to run is dynamic, I'm using a ForEach looper to iterate through each row returned by my query, and likewise execute them dynamically. This seems most decidedly serial, not parallel. What I want to happen is for the Control Flow to start the SSIS package and continue on to the next iteration, start the next package, etc., instead of waiting for one package to finish before starting the next.
June 6, 2014 at 4:39 pm
Fire the packages off via command line and let them ignite as a 'shell'. That will keep the program from waiting for completion before moving to your next component. You don't want the execute process task for this as it waits for completion before moving on, you'll have to use a bit of C# or VB.NET.
On a side note... wouldn't it just be easier, and more comprehensive, to set them up as jobs with tracking, logging, etc? That sounds like going the long way around the block, but I assume there was a reason.
Never stop learning, even if it hurts. Ego bruises are practically mandatory as you learn unless you've never risked enough to make a mistake.
For better assistance in answering your questions[/url] | Forum Netiquette
For index/tuning help, follow these directions.[/url] |Tally Tables[/url]
Twitter: @AnyWayDBA
June 6, 2014 at 4:43 pm
Yeah, there is a reason for it. There's also a reason why I'm doing these through SSIS and not a command line. We developed a rather sophisticated queueing and throttling mechanism that has to take place in SSIS.
So...I'm guessing you're not aware of a way to do this?
June 9, 2014 at 12:54 pm
You misunderstand. I'm recommending you use the SSIS loop to fire the command line, not ignore SSIS. Execute Process Task or a Script task.
Never stop learning, even if it hurts. Ego bruises are practically mandatory as you learn unless you've never risked enough to make a mistake.
For better assistance in answering your questions[/url] | Forum Netiquette
For index/tuning help, follow these directions.[/url] |Tally Tables[/url]
Twitter: @AnyWayDBA
June 9, 2014 at 12:56 pm
Oh! I see! I will try that out, thanks!
Viewing 5 posts - 1 through 4 (of 4 total)
You must be logged in to reply to this topic. Login to reply