Post reply

devide source table into four equal parts

  • December 29, 2008 at 10:23 pm

    #129506

    I have One table with huge data.

    i AM PLANING APPLY THE PARALALISM.

    EXTRACT THE TABLE USING FOUR OLEDB SOURCES(SPLIT THE SOURCE TABLE INTO FOUR EQUAL PARTS).

    HOW TO GO BOUT IT?

  • December 30, 2008 at 8:17 am

    #919067

    surendra (12/29/2008)

    I have One table with huge data.

    i AM PLANING APPLY THE PARALALISM.

    EXTRACT THE TABLE USING FOUR OLEDB SOURCES(SPLIT THE SOURCE TABLE INTO FOUR EQUAL PARTS).

    HOW TO GO BOUT IT?

    You have to find suitable table column, to do splitting based on it. Another approach would be to make your table partitioned, if it is based on SQL 2005. This is actually recommended if you have huge table and you want to keep it maintenable. You can read more about table partitioning here.

    ---
    SSIS Tasks Components Scripts Services | http://www.cozyroc.com/

  • December 30, 2008 at 11:42 am

    #919182

    How exactly are you planning on applying parallelism with this source table?

    I see that you say you want 4 different Sources, but what will you be doing with these different sources? Are they all going to the same destination table? Is the source exactly the same for all four Source objects?

    If you're doing a 1-1 move, why do you feel the need to specifically split things out?

    Brandie Tarvin, MCITP Database AdministratorLiveJournal Blog: http://brandietarvin.livejournal.com/[/url]On LinkedIn!, Google+, and Twitter.Freelance Writer: ShadowrunLatchkeys: Nevermore, Latchkeys: The Bootleg War, and Latchkeys: Roscoes in the Night are now available on Nook and Kindle.

Viewing 3 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic. Login to reply