Post reply

Avoid Loading the same Excel File twice to a OLE DB Destination

  • April 26, 2014 at 7:02 pm

    #150645

    Hi Everyone,

    I have an SSIS package that loops through a folder looking for and then loading excel files into SQL Server.

    Does anyone have a method to stop SSIS from loading the same excel file twice.

    Kind Regards

  • April 27, 2014 at 3:14 am

    #1709024

    What do you mean by "loading twice"?

    Does the current loop perform the "double load" or does it happen when the SSIS package is restarted?

    There are several options to avoid the "reload":

    The easiest is to transfer the file to a different folder once it is processed.

    Another option would be to store the last execution time of the import task and load only files with a more recent creation or modification date.

    Yet another solution could be a table of files already imported and check against that table during import.


    Lutz
    A pessimist is an optimist with experience.

    How to get fast answers to your question[/url]
    How to post performance related questions[/url]
    Links for Tally Table [/url] , Cross Tabs [/url] and Dynamic Cross Tabs [/url], Delimited Split Function[/url]

  • April 27, 2014 at 6:30 am

    #1709032

    LutzM (4/27/2014)

    There are several options to avoid the "reload":

    The easiest is to transfer the file to a different folder once it is processed.

    Another option would be to store the last execution time of the import task and load only files with a more recent creation or modification date.

    Yet another solution could be a table of files already imported and check against that table during import.

    A hash / fingerprint such as MD5 would guard against a file being resubmitted with a different name or dates.

    😎

  • April 27, 2014 at 3:38 pm

    #1709049

    Thanks for all your help. I will try your suggestion.

Viewing 4 posts - 1 through 3 (of 3 total)

You must be logged in to reply to this topic. Login to reply