Insert In Batches in A Stored Proc

  • The scenario. I have a very large text file which I import to stage the data into Table dbo.tbStage using bulk insert and split the data into batches. dbo.tbStage contains 6o million rows.

    Once Staged I begin cleansing the data and inserting it into table tbHolding . I want to insert this data into tbHolding in batches and write into an audit table as I process the batches. How do I do that in a stored procedure

    Insert tbHolding

    Select ........... From dbo.tbStage

  • Add an identity column to the staging table and use that as a key to drive a large control loop to insert a couple of hundred thousand rows at a time.

    --Jeff Moden


    RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
    First step towards the paradigm shift of writing Set Based code:
    ________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.

    Change is inevitable... Change for the better is not.


    Helpful Links:
    How to post code problems
    How to Post Performance Problems
    Create a Tally Function (fnTally)

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply