How To keep the Lookup Cache??
-
Hi All
I have created a dataflow in SSIS which is using a lookup table of 11 Million record size..
I have to use this dataflow several times based on some parameters (For Ex: Different source tables.).. Everything else is same..
While running these dataflows parallely 'Caching'(Pre-Execute step) for lookup table is happening only once..
But if I am going by a 'For each loop' Task for calling these dataflows, this caching is happening each time when Dataflow is executed
...Can any one suggest, how I can make this caching happens only once though I am calling dataflow several times???
Regards
Agson Chellakudam
-
This was removed by the editor as SPAM
-
You can't in SSIS at this time. I ran into the same problem. Some suggestions were to off-load the data into a flat file somewhere to read through and avoid the IO against the table or to do Lookups instead of trying to pull the cache for a merge join (which it sounds like you're doing). Just be sure your indexes are good if you want to do lookups.
If you need to cache it to take the load off of the server, writing out the columns you need to a flat file or a working table would probably be the best solution.
I agree that this is frustrating, especially when doing a loop like this. I guess submit a request to MS and see what happens. There may be one out there from me already, but I don't remember.
-Pete
Viewing 3 posts - 1 through 2 (of 2 total)
You must be logged in to reply to this topic. Login to reply