November 9, 2006 at 11:06 am
Hi, We have a SSIS package that goes out to the web and downloads a CSV file
and then imports it into SqlServer. Now the file we download daily is a
file that gets appended. so when we download the file today we get all of
todays data plus the same data we already imported. The data we are
importing has a unique ID. What steps(or tasks) do we need so that the
package will NOT import the duplicate data but only take the new data. I
know in SQL this would be an insert where the unique ID is NOT in the table
already. But how do we go about doing this is SSIS? I would assume we
would need some kind of task before the data importing task. we are very
new to SSIS so any help would be greatly apperciated
November 9, 2006 at 11:18 am
In your data flow where you load the data, you would add a lookup task. You want the records where the lookup on the unique id fails to flow through to the insert and simply ignore those where the lookup succeeds.
Viewing 2 posts - 1 through 1 (of 1 total)
You must be logged in to reply to this topic. Login to reply