Post reply

Deal with large database (150GB)

  • September 28, 2009 at 8:09 am

    #211422

    Hi all,

    I have a flat file 150GB. I'm using SSIS and Import/Export (2005) to import it to database but it seems to long. What is the best deal int this case?

    One thing, I tried import 20GB and it took me 22 minutes to run "select count(1) from table" query. That is really bad. My flat file does not include primary key in it.

    Note: I own window 2003 server, MSSQL 2005.

    Thanks for help,

    Eric.

  • September 28, 2009 at 12:04 pm

    #1059130

    I don't know about SSIS, but DTS allowed you to set a batch size. I used to do this for large imports and it seemed to process faster and hang up less. For instance, importing 5,000,000 rows, I might set the batch at 50,000 rows. Then it would not try to do the entire import in one transaction. Easier on RAM and T-log.

    P.S. Why is this in the "Backups" forum ?

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply