Buffer error issue in ssis

  • Hi

    I am using two oledb sources which extract data from oracle tables, merge the records and put them into flat file.

    If i select three to four columns in a select statement in both the oledb sources, the package works fine. But i need to have at least 20 columns in a select statement in both oledb sources. When i do that, the error comes.

    I am getting following error:

    Error: The system reports 79 percent memory load. There are 8572342272 bytes of physical memory with 1764818944 bytes free.

    There are 4294836224 bytes of virtual memory with 479567872 bytes free. The paging file has 21428088832 bytes with 14858711040 bytes free.

    [Merge [2068]] Error: The input buffer could not be cloned. An out-of-memory condition occurred or there was an internal error.

    [SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "Merge" (2068) failed with error code 0xC0208296 while processing input "Merge Input 2" (2070).

    The identified component returned an error from the ProcessInput method.

    The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.

    There may be error messages posted before this with more information about the failure.

    [SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED.

    The ProcessInput method on component "Sort 1" (1821) failed with error code 0xC0047020 while processing input "Sort Input" (1822).

    The identified component returned an error from the ProcessInput method. The error is specific to the component,

    but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the failure.

    [SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.

    The PrimeOutput method on component "OLE DB Source 1" (16) returned error code 0xC02020C4.

    The component returned a failure code when the pipeline engine called PrimeOutput().

    The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.

    There may be error messages posted before this with more information about the failure.

    Any body having idea about this error.Is it a memory issue

  • Generally if the thing tells you that you have insufficient memory, then it means you have insufficient memory 😛

    Did you try loading all the records from each table individually, into a local SQL table, and then running the query as a SQL statement doing the joining instead of using the Merge Join?

    The problem with the Merge Join transform is that it is semi-blocking. It's not as bad as say, the Aggregate transform, where you will get no output until *all* rows have entered, but it could still cause memory problems.

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply