Data Warehouse Considerations - SCD Type 2 vs Overwrite Dimension Tables
How we handle data warehousing updates to dimension tables is crucial and this article covers Slowly Changing Dimensions versus overwriting tables.
2024-12-20
Data Warehouse
The Load of Real Time Data Warehouses
How much load do real time updates place on a data warehouse? Steve has a few thoughts on the analysis of the Amazon Redshift dataset, Redset.
2024-10-07
133 reads
Dimensional Modelling Case Study Part 1 - Age Group
Learn how you can handle dimensional modeling in a data warehouse when your data uses different categorization for ages.
2024-01-12
2,493 reads
Time-Series Data Analysis with Apache Druid
Learn the basics of Apache Druid and how it can be used to ingest data into a data lake.
2023-11-10
14,419 reads
Upserts in Amazon Redshift
This article discusses different approaches of Upserts (update+inserts) in Amazon Redshift
2023-08-09
28,918 reads
A Overview of Amazon Redshift
This article gives an overview of Amazon Redshift, the cloud data warehouse in AWS.
2023-07-24
25,493 reads
How do you secure sensitive data in a modern Data Warehouse?
In 2019 Canadian Broadcasting Corporation (CBC) news reported a massive data breach at the Desjardins Group, which is a Canadian financial service cooperative and the largest federation of credit unions in North America. The report indicated, a "malicious" employee copied sensitive personal information collected by Desjardins from their data warehouse. The data breach compromised the […]
2022-03-30
3,041 reads
Infrastructure Planning for a SQL Server Data Warehouse
In this tip we look at some things you should think about when planning for a SQL Server data warehouse.
2019-02-12
2,879 reads
Modern Data Warehouse Design Pattern – Part I
The modern data warehouse design helps in building a hub for all types of data to initiate integrated and transformative solutions. To achieve these goals and to support modern designs, Microsoft has introduced a set of fully managed, cloud-based services that not only support modern data warehouse design patterns but also provide the advantages of inbuilt scalability, high availability, good performance, and flexibility.
2018-09-04
3,797 reads
Using the DbFit Framework for Data Warehouse Regression Testing
It is ironic that the users of database application need to rely on the very technologists that created the system to then devise and run their acceptance tests. Surely someone has devised a test system for databases that is simple enough for ordinary tech-savvy people to use and for them to create the tests? Yes they have. Fitnesse DbFit is a mature product that can, and does, test SQL Server databases, and Nat Sundar explains how to set it up and do it.
2017-05-18
3,142 reads
Blogs
My 2024 in Data: Music
By Steve Jones
This is my last week of the year working (I guess I come back...
A New Word: Suente
By Steve Jones
suente– n. the state of being so familiar with someone that you can be...
Side Projects
Anyone (everyone?) who has ever tried to learn a programming language knows that to...
Forums
Timeout Error while executing a TSQL statement in Sql server Express Edition
I am getting the below error when I execute a SQL command in SQL...
Timeout Error while executing a TSQL statement in Sql server Express Edition
I am getting the below error when I execute a SQL command in SQL...
Sql script replace and rearrange numbers
Hi everyone. I have this table and this information. (left side of the image)...