Post reply

How to separate Unique and Duplicate rows in SSIS

  • December 20, 2007 at 8:58 pm

    #119304

    hi,

    I have a table which has duplicate rows. I want to separate that with the transformations in SSIS.

    let me with which transformation we can do that.

    giving me the syntax will be helpful for me.

    thanks in advance

  • December 21, 2007 at 11:56 am

    #762259

    If one of the columns in the dataset holds a key or date that is repeated you can use the SORT transformation. Set the sort on the key field, and at the bottom check the box "Remove rows with duplicate sort values". Set the rest of the fields in the dataset to "Pass Thru".

    The output of that will a distinct list based on the sorted column.

    Another method would be on the OLE DB Source

    Set the Data Access Mode to "SQL Command"

    Then executing a query such as

    SELECT DISTINCT * FROM MyTable

    You could also use the GROUP BY Function to the same end.

    Hope this Helps...Happy Holidays,

    Eric

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply