ETL Antipattern: Skipping The Documentation
Documentation is an asset that is both loathed and loved. Creating technical and business documentation is often looked upon as a tedious chore, something that really ought to be...
2020-12-20
Tim Mitchell
- Interests: SQL Server, Data Warehousing, ETL, .NET development
- Twitter: @tim_mitchell
- Website: https://www.TimMitchell.net
ETL Antipattern: Load Processes that Don’t Scale
One of the most significant design considerations in ETL process development is the volume of data to be processed. Most ETL processes have time constraints that require them to...
2020-12-19
250 reads
ETL Antipattern: Load Processes that Don’t Scale
One of the most significant design considerations in ETL process development is the volume of data to be processed. Most ETL processes have time constraints that require them to...
2020-12-19
1 reads
ETL Antipattern: Failure to Test and Validate
“If it compiles, it works.” – An unemployed developer Building ETL processes is quite easy. Building ETL processes that deliver accurate results as quickly as possible is substantially more...
2020-12-18
8 reads
ETL Antipattern: Failure to Test and Validate
“If it compiles, it works.” – An unemployed developer Building ETL processes is quite easy. Building ETL processes that deliver accurate results as quickly as possible is substantially more...
2020-12-18
2 reads
ETL Antipattern: Failing to Treat ETL Logic as Source Code
In most data projects, building the extract-transform-load (ETL) logic takes a significant amount of time. Enterprise ETL processes must do several things well: retrieve enough data to satisfy the...
2020-12-17
8 reads
ETL Antipattern: Failing to Treat ETL Logic as Source Code
In most data projects, building the extract-transform-load (ETL) logic takes a significant amount of time. Enterprise ETL processes must do several things well: retrieve enough data to satisfy the...
2020-12-17
3 reads
ETL Antipattern: No Error Handling Logic
I usually avoid talking about technology in absolutes, but here’s one that I can share without reservation: On a long enough timeline, every single ETL process will eventually fail....
2020-12-16
6 reads
ETL Antipattern: Lazy Metadata
If data is a train, then metadata is the track on which it travels. A good metadata definition in ETL processes will help to ensure that the flow of...
2020-12-15
9 reads
ETL Antipattern: Performing Full Loads Instead of Incremental Loads
In my last post in the ETL Antipatterns series, I wrote about the common antipattern of ingesting or loading more data than necessary. This brief post covers one specific...
2020-12-14
33 reads
Blogs
T-SQL Tuesday #180: Good enough is perfect Roundup
This month, I prompted bloggers to discuss whether good enough is perfect. Thank you to all...
Using SQL Compare with Read-only Access
By Steve Jones
Recently a customer asked if SQL Compare and SQL Data Compare can be used...
Forums
how can i tell if our db2 driver is ms or ibm or other?
i see this in the definition of a linked server on our wh sql...
normal role member to be able to view list of other role members in his DB
Is this even possible ? Tried with grant but to no avail. [sys].[database_role_members] and...
Stairway to Snowflake Level 5 - Using Snowflake with SnowSQL and Visual Studio Code
Comments posted to this topic are about the item Stairway to Snowflake Level 5...
Question of the Day
A Strange Result
What does this code return in SSMS 20 from SQL Server 2019?
select '|' + CHAR(0)+'abc' + '|';See possible answers