Post reply

SSIS Parallel processing of Multiple files

  • September 16, 2015 at 1:16 am

    #300491

    Hello All,

    I have an SSIS package, which loading 5 data files of same format into Single Destination Table by taking 3-4 Hours...

    Now my Manager asked me to change the Sequential Execution to at a time processing....

    The files are having 20 Column and of large volume of data....

    Thanks,

    Sasidhar P

  • September 16, 2015 at 2:21 am

    #1826993

    Hi Sasidhar

    I wonder how many rows are in those 5 files?

    Best regards

    Mike

  • September 16, 2015 at 3:04 am

    #1827001

    The total records are of 10-25 Millions...

  • September 16, 2015 at 3:11 am

    #1827003

    Pulivarthi Sasidhar (9/16/2015)

    Hello All,

    I have an SSIS package, which loading 5 data files of same format into Single Destination Table by taking 3-4 Hours...

    Now my Manager asked me to change the Sequential Execution to at a time processing....

    The files are having 20 Column and of large volume of data....

    Thanks,

    Sasidhar P

    What is your question?

    The absence of evidence is not evidence of absence
    - Martin Rees
    The absence of consumable DDL, sample data and desired results is, however, evidence of the absence of my response
    - Phil Parkin

  • September 16, 2015 at 3:48 am

    #1827009

    Thanks Sasidhar

    You can load it one by one with Foreach Loop Container.

    Regarding total time of execution, Imho it is a bit slow, how do you manage

    this process? (I mean - disable or drop indexes before load, access data mode - fast load,

    insert commit size, rows per batch)

    Br.

    Mike

Viewing 5 posts - 1 through 4 (of 4 total)

You must be logged in to reply to this topic. Login to reply