Incremental Update

  • I have built a package where my source is Oracle and Destination is SQL DB. In this package while transformation I have written functions in Active X script, also I am calling my lookups queries in Active X Script.

    Since I have lots of records. I am loading the data in chunks. The very first

    time I am loading 3months data starting today(ex if today is 12/1/2002 then 3 months data=from 9/1/2002 - 12/1/2002) and then 3 months before that(which will be from 6/1/2002 - 9/1/2002) plus modified data in first 3 months (from 9/1/2002 - 12/1/2002).

    I am not sure how should I achieve this since I want to do an incremental update for

    already loaded data in a table?

    Also, I am adding many additional columns in my destination table which contains values based on my Active X scripts so its not a direct copy of source.

    Thanks,

  • If you have so much data I would avoid Active-X scripts if you can as they are very slow. Perhaps you could do this using a data driven query task, the trick is being able to identify an insert and an update. Is this a one-off job or a regular update?

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply