Data Warehouse Considerations - SCD Type 2 vs Overwrite Dimension Tables
How we handle data warehousing updates to dimension tables is crucial and this article covers Slowly Changing Dimensions versus overwriting tables.
2024-12-20
Data Warehouse
The Load of Real Time Data Warehouses
How much load do real time updates place on a data warehouse? Steve has a few thoughts on the analysis of the Amazon Redshift dataset, Redset.
2024-10-07
228 reads
Dimensional Modelling Case Study Part 1 - Age Group
Learn how you can handle dimensional modeling in a data warehouse when your data uses different categorization for ages.
2024-01-12
2,919 reads
Time-Series Data Analysis with Apache Druid
Learn the basics of Apache Druid and how it can be used to ingest data into a data lake.
2023-11-10
14,581 reads
Upserts in Amazon Redshift
This article discusses different approaches of Upserts (update+inserts) in Amazon Redshift
2023-08-09
30,224 reads
A Overview of Amazon Redshift
This article gives an overview of Amazon Redshift, the cloud data warehouse in AWS.
2023-07-24
25,600 reads
How do you secure sensitive data in a modern Data Warehouse?
In 2019 Canadian Broadcasting Corporation (CBC) news reported a massive data breach at the Desjardins Group, which is a Canadian financial service cooperative and the largest federation of credit unions in North America. The report indicated, a "malicious" employee copied sensitive personal information collected by Desjardins from their data warehouse. The data breach compromised the […]
2022-03-30
3,147 reads
Infrastructure Planning for a SQL Server Data Warehouse
In this tip we look at some things you should think about when planning for a SQL Server data warehouse.
2019-02-12
2,879 reads
Modern Data Warehouse Design Pattern – Part I
The modern data warehouse design helps in building a hub for all types of data to initiate integrated and transformative solutions. To achieve these goals and to support modern designs, Microsoft has introduced a set of fully managed, cloud-based services that not only support modern data warehouse design patterns but also provide the advantages of inbuilt scalability, high availability, good performance, and flexibility.
2018-09-04
3,797 reads
Using the DbFit Framework for Data Warehouse Regression Testing
It is ironic that the users of database application need to rely on the very technologists that created the system to then devise and run their acceptance tests. Surely someone has devised a test system for databases that is simple enough for ordinary tech-savvy people to use and for them to create the tests? Yes they have. Fitnesse DbFit is a mature product that can, and does, test SQL Server databases, and Nat Sundar explains how to set it up and do it.
2017-05-18
3,142 reads
Blogs
A New Word: Dolorblindness
By Steve Jones
dolorblindness – n. the frustration that you’ll never be able to understand another person’s...
Claude Code Helps Analyze Test Data Manager Log Files
By Steve Jones
I had a customer ask about analyzing their Test Data Manager (TDM) usage to...
PowerPoint to HTML with Claude AI
By Steve Jones
I had an idea for an animated view of a sales tool, and started...
Forums
SSIS with VS2022 64/32 issue with Excel files
Hi all, I'm trying to do classic scenario for loading multiple Excel files into...
Case part is sloooooow
Hi So the case statement is slowing this down - but for the life...
Why the following cmds in sequence do not work
I need to delete rows from both the temporal main and history tables. The...
Question of the Day
The String Distance I
In SQL Server 2025, what is returned by this code:
SELECT EDIT_DISTANCE('tim', 'tom')
Assume preview features are enabled. See possible answers