November 10, 2014 at 8:46 am
I have an SSIS package that takes data from Oracle and inserts the new rows into my SQL db. I want to update this to normalize the data, instead of just inserting all the strings stored in the Oracle db. Is the solution just to send the lookup that finds new rows into a multicast and then perform a lookup for each field I want normalized? Can I then just perform a merge join? I haven't gotten this to work, so I'm wondering if my reasoning is faulty. Is there a better way to do this?
I've looked at a this post, but I'm afraid I don't understand what it's getting at.
http://www.sqlservercentral.com/Forums/Topic497529-148-1.aspx
November 10, 2014 at 8:52 am
If the tables you want to look up are in the destination SQL Server, I would insert the rows to a staging table at the destination and perform the lookups in T-SQL, the insert to the destination table. It will likely be much faster.
-- Gianluca Sartori
November 10, 2014 at 10:57 am
I hadn't considered that, but it sounds like a really good idea. Thanks!
Viewing 3 posts - 1 through 2 (of 2 total)
You must be logged in to reply to this topic. Login to reply