Post reply

SSIS package that can be changed dynamically

  • January 20, 2009 at 3:29 am

    #133645

    I have a requirement to load excel,csv or text files directly into a temp db for processing in to the live db. I have had a look at openrowset and openquery but they are very slow with lists of over 25000 records. I want to be able to load 1m records into the temp table as quickly as possible, as this may need to be done real time and the users are using a web app to access the data. Any help on this would be much appreciated.

    I am using Sql Server 2008.

  • January 20, 2009 at 10:24 pm

    #930090

    mgalgey (1/20/2009)

    I have a requirement to load excel,csv or text files directly into a temp db for processing in to the live db. I have had a look at openrowset and openquery but they are very slow with lists of over 25000 records. I want to be able to load 1m records into the temp table as quickly as possible, as this may need to be done real time and the users are using a web app to access the data. Any help on this would be much appreciated.

    I am using Sql Server 2008.

    Does these excel, csv files have simple tabular structure? If so, you may be able to use directly the bcp tool. You may have to implement a script to export the excel files into a csv file for this approach to work. Let us know how it goes.

    ---
    SSIS Tasks Components Scripts Services | http://www.cozyroc.com/

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply