October 11, 2017 at 11:37 pm
I have created SSIS package which basically extract the dirty data from the table and using DQS Cleansing Transformation clean the data and load into tables according to Lookup Transformation criteria. I am getting below error at the end of the process.
Error: 0xC0202009 at Data Flow Task, CustomersDirtyNoMatch [109]: SSIS Error
Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code:0x80004005.
An OLE DB record is available. Source: "Microsoft SQL Server Native Client 11.0" Hresult: 0x80004005 Description: "Unspecified error".
Error: 0xC020901C at Data Flow Task, CustomersDirtyNoMatch [109]: There was an error with CustomersDirtyNoMatch.Inputs[OLE DB Destination Input].Columns[CustomerKey] on CustomersDirtyNoMatch.Inputs[OLE DB Destination Input]. The column status returned was: "The value violated the integrity constraints for the column.".
Error: 0xC0209029 at Data Flow Task, CustomersDirtyNoMatch [109]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "CustomersDirtyNoMatch.Inputs[OLE DB Destination Input]" failed because error code 0xC020907D occurred, and the error row disposition on "CustomersDirtyNoMatch.Inputs[OLE DB Destination Input]" specifies failure on error. An error occurred on the specified object of the specified component. There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "CustomersDirtyNoMatch" (109) failed with error code 0xC0209029 while processing input "OLE DB Destination Input" (122). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the failure.
Screen Shot of my Data Flow
For more information please refer this Document
Here's a table definition
CREATE TABLE dbo.CustomersDirty (
CustomerKey INT NOT NULL PRIMARY KEY,
FullName NVARCHAR(200) NULL,
StreetAddress NVARCHAR(200) NULL,
Updated INT NULL,
CleanCustomerKey INT NULL);
CREATE TABLE dbo.CustomersClean (
CustomerKey INT NOT NULL PRIMARY KEY,
FullName NVARCHAR(200) NULL,
StreetAddress NVARCHAR(200) NULL );
CREATE TABLE dbo.CustomersDirtyMatch (
CustomerKey INT ,
FullName NVARCHAR(200) NULL,
StreetAddress_Source NVARCHAR(200) NULL,
StreetAddress NVARCHAR(200) NULL,
StreetAddress_Status NVARCHAR(100) NULL,
StreetAddress_Confidence NVARCHAR(100) NULL,
StreetAddress_Reason NVARCHAR(4000) NULL,
Updated INT NULL,
CleanCustomerKey INT NULL,
Record_Status NVARCHAR(100) NULL );
CREATE TABLE dbo.CustomersDirtyNoMatch (
CustomerKey INT ,
FullName NVARCHAR(200) NULL,
StreetAddress_Source NVARCHAR(200) NULL,
StreetAddress NVARCHAR(200) NULL,
StreetAddress_Status NVARCHAR(100) NULL,
StreetAddress_Confidence NVARCHAR(100) NULL,
StreetAddress_Reason NVARCHAR(4000) NULL,
Updated INT NULL,
CleanCustomerKey INT NULL,
Record_Status NVARCHAR(100) NULL );
As recommended I did some change in configuration. I have added Flat File Destination adapter at the end of CustomerDirtyNoMatch destination adapter. Still data is not inserted in table though error data inserted in flat file.
Please refer this Flat File
updated data flow
October 12, 2017 at 1:45 pm
file seems to be missing a valid value for customerkey - when you preview the data on the source component does it show you values for the customerkey column?
If not that is your issue as it will most likely be complaining that you are trying to insert a null value on a non nullable field
October 12, 2017 at 3:40 pm
Data preview in source
Viewing 3 posts - 1 through 2 (of 2 total)
You must be logged in to reply to this topic. Login to reply