Data Warehouse Considerations - SCD Type 2 vs Overwrite Dimension Tables

How we handle data warehousing updates to dimension tables is crucial and this article covers Slowly Changing Dimensions versus overwriting tables.

The Load of Real Time Data Warehouses

How much load do real time updates place on a data warehouse? Steve has a few thoughts on the analysis of the Amazon Redshift dataset, Redset.

Dimensional Modeling Case Study Part 2 - Days Dimension

Learn how you can model days in a dimension that might need to be aggregated in different ways for your data warehouse operations.

A Overview of Amazon Redshift

This article gives an overview of Amazon Redshift, the cloud data warehouse in AWS.

How do you secure sensitive data in a modern Data Warehouse?

In 2019 Canadian Broadcasting Corporation (CBC) news reported a massive data breach at the Desjardins Group, which is a Canadian financial service cooperative and the largest federation of credit unions in North America. The report indicated, a "malicious" employee copied sensitive personal information collected by Desjardins from their data warehouse. The data breach compromised the […]

Pairing Data Vault and Biml for DW Agility

Agile data warehousing can be challenging. Pairing the right methodologies and tools can help. Here is how my team met the challenge by using Data Vault methodology and BIML scripting.

Exit Stage Right

Comparing Data Warehouse Design Methodologies for Microsoft SQL Server

In this article, Arshad Ali goes intp detail about how a data warehouse is different from operational data store and the different design methodologies for a data warehouse.

Track source dates when loading a data warehouse

A primer on how to reduce network and source system load when reading a relational source into the data warehouse.

Scaling Up Your Data Warehouse with SQL Server 2008 R2

SQL Server 2008 introduced many new functional and performance improvements for data warehousing, and SQL Server 2008 R2 includes all these and more. This paper discusses how to use SQL Server 2008 R2 to get great performance as your data warehouse scales up. We present lessons learned during extensive internal data warehouse testing on a 64-core HP Integrity Superdome during the development of the SQL Server 2008 release, and via production experience with large-scale SQL Server customers. Our testing indicates that many customers can expect their performance to nearly double on the same hardware they are currently using, merely by upgrading to SQL Server 2008 R2 from SQL Server 2005 or earlier, and compressing their fact tables. We cover techniques to improve manageability and performance at high-scale, encompassing data loading (extract, transform, load), query processing, partitioning, index maintenance, indexed view (aggregate) management, and backup and restore.