November 24, 2008 at 3:36 pm
Hi All,
I am having a requirement to remove the duplicates that are coming in my flow after the union all transformatin..
I am having 12 sources and am doing union all in 2 columns finally...
but they are fetching duplicates and even though i am doing lookup on the key that i am fetching as it will not found there in the lookup it is loading n times in the destination..
i used SORT transformation and removed duplicates...
but i dont like to use this transformation...
I there any other way to remove duplicate values in the flow..
Thanks for your help
Thanks [/font]
November 25, 2008 at 7:15 am
no option to remove duplicates?
Thanks [/font]
November 25, 2008 at 7:22 am
November 25, 2008 at 8:31 am
Try using UNION on its own rather than UNION ALL, which ensures that duplicates are retained in the output.
For fast, accurate and documented assistance in answering your questions, please read this article.
Understanding and using APPLY, (I) and (II) Paul White
Hidden RBAR: Triangular Joins / The "Numbers" or "Tally" Table: What it is and how it replaces a loop Jeff Moden
Viewing 4 posts - 1 through 3 (of 3 total)
You must be logged in to reply to this topic. Login to reply