July 26, 2011 at 9:28 am
Hi Team,
I am very new to the SSIS.....
Problem Statement: Source table has 2 Million records (first time dump) and daily incremental is around 40000 records (Both New and Modified records). As the number records are huge I am trying to implement Kimball SCD.
I have followed the below steps:
I have installed Kimball SCD component 1.5 version.
The source has the primary key column and all other variables need to be update (Total 25 columns).
I have created OLEDB Source and destination and Mapped the corresponding tables.
I have defined primary key as Business Key and all other variables as SCD2 (As these variables needs to be updated).
Getting error message: Existing dimension has columns identified as SCD2, but no columns are identified as SCD2 Effective Date, SCD2 Expiry Date, Or SCD2 Current Record
Can anyone help me to configure the Kimball SCD for the above scenario. Hope above details will give you the clear picture of problem statement.
Thanks in advance,
JoyKing
July 26, 2011 at 9:38 am
Hi JoyKing
For SCD2 to work your destination table needs to have 3 extra columns - Effective Date (datetime), Expiry Date (datetime), and Current Record (bit). (You can use different names if you want). Then you need to specify these fields in the SCD component.
Hope this helps.
JF
July 26, 2011 at 1:23 pm
Hi Team,
Thanks for your reply...I have added those three columns in the destination table and configured the kimball SCD component. Also added derived column transformation for each of the kimball component output and finally mapped all these transformation to union all.
If I execute the package ...I am getting following error message:
TITLE: Package Validation Error
------------------------------
Package Validation Error
------------------------------
ADDITIONAL INFORMATION:
Error at Incremental Load [Row Count [298]]: The variable "(null)" specified by VariableName property is not a valid variable. Need a valid variable name to write to.
Error at Incremental Load [SSIS.Pipeline]: "component "Row Count" (298)" failed validation and returned validation status "VS_ISBROKEN".
Error at Incremental Load [SSIS.Pipeline]: One or more component failed validation.
Error at Incremental Load: There were errors during task validation.
(Microsoft.DataTransformationServices.VsIntegration)
If you have implemented kimball SCD, could you please share your dtsx package...
Thanks & regards,
Joyking
July 27, 2011 at 1:48 am
Looking at the error message, there isn't a problem with the SCD but a problem with the rowcount component. Apparently there isn't a variable assigned to that component.
Need an answer? No, you need a question
My blog at https://sqlkover.com.
MCSE Business Intelligence - Microsoft Data Platform MVP
Viewing 4 posts - 1 through 3 (of 3 total)
You must be logged in to reply to this topic. Login to reply