Capture Duplicate input enteries

  • Hello,

    I have to import an input file to SQL database using SSIS package .

    In one of the input files their is one column as Name.Ineed to capture the columns have same names to the exception log .

    How is that possible

    for eg:

    Record id name address

    1 Cat Milwaukee

    2 Bat Wisconsin

    3 Cat Chicago

    4 Rat Montreal

    I need to caputure the input date with duplicate names into exception log , from above example Name= Cat has duplicate enteries.

    Please suggest.

  • It's hard to do that directly in the dataflow, so I would suggest that you read all your data first and then write it to some sort of staging table (a permanent one or a temporary table, or just one that you create in the beginning of the package and drop again at the end of your package).

    Then you can either filter out the duplicates with T-SQL, which shouldn't be so hard to do.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply