July 20, 2012 at 9:50 am
Hi everyone!
I'm looking for a few good design examples for how someone has thought about SSIS WRT contract management, data quality, and data lineage reporting.
For example, there are a lot of examples on the internet about how to construct a standard set of Extract, Transform, and Load packages. However I haven't found examples of best practices or standards for managing data contracts with source and destination systems (metadata definitions, trigger file processing, etc.). Those contracts could drive data quality standards and reporting (i.e. exception reporting) as well as data lineage reporting.
This seems to be a very grey area within SSIS that is automatically handled with other 3rd party ETL solutions like DataStage and Informatica.
Any good references online?
July 21, 2012 at 8:02 pm
Jeremy Brown (7/20/2012)
Hi everyone!I'm looking for a few good design examples for how someone has thought about SSIS WRT contract management, data quality, and data lineage reporting.
For example, there are a lot of examples on the internet about how to construct a standard set of Extract, Transform, and Load packages. However I haven't found examples of best practices or standards for managing data contracts with source and destination systems (metadata definitions, trigger file processing, etc.). Those contracts could drive data quality standards and reporting (i.e. exception reporting) as well as data lineage reporting.
This seems to be a very grey area within SSIS that is automatically handled with other 3rd party ETL solutions like DataStage and Informatica.
Any good references online?
Capture Data Lineage Package Sample
Data Cleaning Package Sample or if you're on 2012 Data Quality Services
What do you mean by contract management? SSIS stores metadata about the source and destination within the package itself. It also validates the source and destination at runtime and is hard-typed (a la .NET) so that is at least a piece of it, but what else did you have in mind?
There are no special teachers of virtue, because virtue is taught by the whole community.
--Plato
Viewing 2 posts - 1 through 1 (of 1 total)
You must be logged in to reply to this topic. Login to reply