Data Warehouse Considerations - SCD Type 2 vs Overwrite Dimension Tables
How we handle data warehousing updates to dimension tables is crucial and this article covers Slowly Changing Dimensions versus overwriting tables.
2024-12-20
Data Warehouse
The Load of Real Time Data Warehouses
How much load do real time updates place on a data warehouse? Steve has a few thoughts on the analysis of the Amazon Redshift dataset, Redset.
2024-10-07
228 reads
Dimensional Modelling Case Study Part 1 - Age Group
Learn how you can handle dimensional modeling in a data warehouse when your data uses different categorization for ages.
2024-01-12
2,927 reads
Time-Series Data Analysis with Apache Druid
Learn the basics of Apache Druid and how it can be used to ingest data into a data lake.
2023-11-10
14,590 reads
Upserts in Amazon Redshift
This article discusses different approaches of Upserts (update+inserts) in Amazon Redshift
2023-08-09
30,244 reads
A Overview of Amazon Redshift
This article gives an overview of Amazon Redshift, the cloud data warehouse in AWS.
2023-07-24
25,602 reads
How do you secure sensitive data in a modern Data Warehouse?
In 2019 Canadian Broadcasting Corporation (CBC) news reported a massive data breach at the Desjardins Group, which is a Canadian financial service cooperative and the largest federation of credit unions in North America. The report indicated, a "malicious" employee copied sensitive personal information collected by Desjardins from their data warehouse. The data breach compromised the […]
2022-03-30
3,147 reads
Infrastructure Planning for a SQL Server Data Warehouse
In this tip we look at some things you should think about when planning for a SQL Server data warehouse.
2019-02-12
2,879 reads
Modern Data Warehouse Design Pattern – Part I
The modern data warehouse design helps in building a hub for all types of data to initiate integrated and transformative solutions. To achieve these goals and to support modern designs, Microsoft has introduced a set of fully managed, cloud-based services that not only support modern data warehouse design patterns but also provide the advantages of inbuilt scalability, high availability, good performance, and flexibility.
2018-09-04
3,797 reads
Using the DbFit Framework for Data Warehouse Regression Testing
It is ironic that the users of database application need to rely on the very technologists that created the system to then devise and run their acceptance tests. Surely someone has devised a test system for databases that is simple enough for ordinary tech-savvy people to use and for them to create the tests? Yes they have. Fitnesse DbFit is a mature product that can, and does, test SQL Server databases, and Nat Sundar explains how to set it up and do it.
2017-05-18
3,142 reads
Blogs
AI: Blog a Day – Day 8: RAG – Retrieval Augmented Generation
By Vinay Thakur
RAG — Retrieval Augmented Generation. we have covered so far — embeddings, vectors, vector...
AI: Blog a Day – Day 7: Vector and Vector Databases
By Vinay Thakur
Continuing from Day 6 we learned Embeddings, Semantic Search and Checks, on Day 7...
AI: Blog a Day – Day 6: Embeddings – How AI Understands
By Vinay Thakur
Continuing from Day 5 where we covered notebooks, HuggingFace and fine tuning AI now...
Forums
Not Just an Upgrade
Comments posted to this topic are about the item Not Just an Upgrade
Restoring On Top I
Comments posted to this topic are about the item Restoring On Top I
Designing Delta Tables with Liquid Clustering: Real-World Patterns for Data Engineers
Comments posted to this topic are about the item Designing Delta Tables with Liquid...
Question of the Day
Restoring On Top I
I am doing development work on a database and want to keep a backup so I can reset my database. I make some changes and want to restore over top of my changes. When I run this code, what happens?
USE Master BACKUP DATABASE DNRTest TO DISK = 'dnrtest.bak' GO USE DNRTest GO CREATE TABLE MyTest(myid INT) GO USE master RESTORE DATABASE DNRTest FROM DISK = 'dnrtest.bak' WITH REPLACESee possible answers