November 7, 2013 at 5:52 pm
My code stores a huge result set. It processes this result set and then loads it to the target. Lets not discuss about the efficiency of this technique now.
I need to know if the result set is stored fully or partly in RAM. If it is full, then I might have problems when the result set is very big. Otherwise, I don't think there will be a problem.
Also, does a result set remain in memory even after it is filled into a datatable ? If yes, then I will also have to deallocate this memory.
November 8, 2013 at 1:41 am
Depends on the code. But if you're using, for example, a data adaptor, that's using up RAM for sure.
The absence of evidence is not evidence of absence
- Martin Rees
The absence of consumable DDL, sample data and desired results is, however, evidence of the absence of my response
- Phil Parkin
November 8, 2013 at 3:12 am
I seem to remember having a similar question myself a while back, which broke down as follows:
If the data set it too large to fit in the RAM that SSIS is using, it pages it out to the location specified in the BufferTempStoragePath variable.
This is usually the %temp% Windows envrionment variable unless set explicity in the package configuration.
Try setting this property in the package and then monitoring the path to see if any files are created there during package execution. that should tell you if all your data is in RAM or being paged out.
See the following for further opinion:
[font="Courier New"]sqlmunkee[/font]
[font="Courier New"]Bringing joy and happiness via SQL Server since 1998[/font]
Viewing 3 posts - 1 through 2 (of 2 total)
You must be logged in to reply to this topic. Login to reply