Post reply

Check file name coming from FTP before loading to staging table

  • November 6, 2007 at 9:43 pm

    #748954

    The SSIS package should be able to check if incoming rows already exist previously, perform updates if there were changes on any columns, and insert a new row if data does not exist.Source files coming in would have fields in comma delimitered format.The final destination would be a table with updated rows from all 3 source files.

    I'm not sure why people go through such pains as the "merge" you describe... you're loading the data to a staging table... immediate contents of the staging table don't matter... they can contain dupes or whatever... load all 3 files without regard to dupes... when you're done loading just delete the dupes. Much faster than writing all that "merge" code.

    And wait for the last file to materialize before you do any importing.

    --Jeff Moden

    RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
    First step towards the paradigm shift of writing Set Based code:
    ________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.

    Change is inevitable... Change for the better is not.

    Helpful Links:
    How to post code problems
    How to Post Performance Problems
    Create a Tally Function (fnTally)

Viewing post 16 (of 15 total)

You must be logged in to reply to this topic. Login to reply