September 8, 2007 at 5:24 pm
Hi,
I have created 3 slowly changing dimension (SCD) SSIS packages following the methods outlined on the Microsoft Data Warehouse Toolkit (Kimball, et al.).
I have a problem in that the first SCD I made (call it Customers) worked well. It loaded new records for all the Type 2 changes and only for the Type 2 changes.
With the other 2 (Contact and GLAccount data), I have the same problem. When I change some Type 2 data in the source (1 or 2 records), it reloads ALL the records as if they were Type 2 changes. For example, if I have loaded 5403 records into the target DimGLAccount table, then I change a record in the gl_acct source table, it should just load 1 new record when I run the SCD SSIS package to load the DimGLAccounts data. The problem I am having is that it sets the IsCurrentRow flag for the first 5403 to 'N', loads the 5403 over again with an IsCurrentRow flag of 'Y'.
I have looked these packages over again and again. I can see no difference between the Customers (which works) SSIS package and the Contacts and GLAccounts packages (which don't work).
The ONLY difference I can see is that the Customer data has 1 business key (CustCode) and the Contacts and GLAccounts data each have more than one.
Has anyone seen this sort of behavior before? Any ideas what might be causing it?
Thanks in advance.
G. Milner
September 10, 2007 at 6:30 am
Show more info about those packages (Contacts and GLAccouns).
MP
Viewing 2 posts - 1 through 1 (of 1 total)
You must be logged in to reply to this topic. Login to reply