Revolutionizing Real-Time Data Management with SQL Server, Kafka, and Informatica
This article examines how one can structure a pipeline for processing real-time data using Kafka and Informatica.
2023-04-26
4,477 reads
ETL
Enhancing SSIS ETL Tools with SolarWinds Task Factory
SQL Server Integration Services (SSIS) has been the de facto ETL tool for over 15 years for DBAs, Developers and Business Intelligence Professionals to extract, transform and load data (i.e. ETL tasks) for specific business processes, data-centric applications, data warehousing, reporting and data exchange between organizations. SSIS is a great product with high adoption across the globe, but has some limitations related to modern data sources, performance and streamlining tedious tasks. How can we overcome these limitations and have SSIS provide greater value?
2023-04-10
Building an ETL with PowerShell
There are many ways to load data into a SQL Server database. In this article, Greg Moore demonstrates how to get PowerShell to do more of the work.
2021-10-11
Why Power Query as an Activity in Azure Data Factory and SSIS?
There is a Power Query activity in SSIS and Azure Data Factory, which can be more useful than other tasks in some situations.
2021-07-26
4,328 reads
Dynamically Add a Timestamp To Files in Azure Data Factory
This article will describe how to add your local timestamp at the end of the each file in Azure Data Factory (ADF). In general, ADF gets a UTC timestamp, so we need to convert the timestamp from UTC to EST, since our local time zone is EST. For example, if the input Source file name […]
2021-04-22
28,909 reads
Modular ETL Architecture Design in SSIS
Overview of ETL Architecture In a data warehouse, one of the main parts of the entire system is the ETL process. ETL is the system that reads data from the source system, transforms the data according to the business logic, and finally loads it into the warehouse. While fetching data from the sources can seem […]
2019-10-21
13,749 reads
Blogs
AI Innovation in Microsoft Keynote
By Chris Yates
I’m thrilled to be covering the Microsoft Keynote: Fuel AI Innovation with Azure Databases on Day...
Benefits of Migrating from Azure Synapse Analytics to Microsoft Fabric
By James Serra
Many customers ask me about the advantages of moving from Azure Synapse Analytics to...
PASS Summit 2024 – A Very Different World
By Brian Kelley
The last data centric conference I attended was the PASS Summit in 2019. A...
Forums
What does B6 Notebook mean?
B6 Notebook Size can be found in a few novels and stories. The dimensions...
Unencrypted connections in Always on Availability Group
Hi, In my Always On Availability environment, I am seeing two encrypt_option values as...
Error loading multiple CSV files in SSIS
Hi everyone I have a bunch of CSV files that I need to bulk...
Question of the Day
Using Outer Joins
I have this data in a SQL Server 2019 database:
Customer table CustomerID CustomerName 1 Steve 2 Andy 3 Brian 4 Allen 5 Devin 6 Sally OrderHeader table OrderID CustomerID OrderDate 1 1 2024-02-01 2 1 2024-03-01 3 3 2024-04-01 4 4 2024-05-01 6 4 2024-05-01 7 3 2024-06-07 8 2 2024-04-07I want a list of all customers and their order counts for a period of time, including zero orders. If I run this query, how many rows are returned?
SELECT c.CustomerName, COUNT(oh.OrderID) FROM dbo.Customer AS c LEFT JOIN dbo.OrderHeader AS oh ON oh.CustomerID = c.CustomerID WHERE oh.Orderdate > '2024/04/01' GROUP BY c.CustomerNameSee possible answers