Post reply

Bulk Insert

  • October 8, 2003 at 10:29 am

    #176794

    I am trying to bulk insert the client's very large csv file into a table with designated PK fields. It appears to have duplicates in it, so I'd get PK issues and it stops. Thie import is done on a regular basis and their format often changes each time as well.

    I don't wish to remove the PK designation but I do anyway. After I do bulk inserts including the dups I then basically make a holding table containing only the dups in distinct mode. Then I'd remove the dups in original table, then reinsert the distinct dups. I wrote a stored procedure to do the removal of dups. Then I'd turn the PK association back on.

    Seems like a ha-ha comedy and that there ought to be a better way. Folks, is there a better way? If so, what is it?

  • October 8, 2003 at 5:29 pm

    #477650

    Import your data into a staging table first. Then do all your de-duping for insertion into the destination table. This way you don't have to fiddle with PK's.

    Hope this helps

    Phill Carter

    --------------------

    Colt 45 - the original point and click interface

    --------------------
    Colt 45 - the original point and click interface

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply