Configuring an SSIS ForEach Loop for Multiple File Types
The ForEach loop works with only one file type at a time by default. Learn how you can add code to your packages to work with multiple types of files.
2023-12-18
3,110 reads
ETL/SSIS/Azure Data Factory
Using Pipeline Return Value in Azure Data Factory and Azure Synapse Analytics
Learn how you can return data from one ADF pipeline for use in another.
2023-11-01
4,517 reads
Trigger the Execution of an ADF Pipeline from an Email
Learn how you can configure an Azure Data Factory pipeline that is triggered by an email being sent to an address.
2023-11-03 (first published: 2023-10-27)
4,234 reads
Top 10 Methods to Improve ETL Performance Using SSIS
Extraction Transformation Load (ETL) is the backbone for any data warehouse. In the data warehouse world data is managed by the ETL process, which consists of three processes, Extraction-Pull/Acquire data from sources, Transformation-change data in the required format and Load-push data to the destination generally into a data warehouse or a data mart.
2023-10-25
What I Wish Everyone Knew About ETL Processes - Traditional to Modern Cloud Solutions
Learn about the evolutionary journey of ETL (Extract, Transform, Load) from traditional processes to modern cloud solutions.
2023-10-18
GIT Configuration and Automated Release for Azure Data Factory
Learn a step-by-step method to save your ADF pipelines in Git and automatically release new changes to test and production.
2024-09-23 (first published: 2023-10-16)
2,435 reads
Sending Multiple Attachments in Email from Azure Data Factory Pipeline
This article shows how you can have your Azure Data Factory (ADF) pipeline send an email using a Logic App.
2023-09-29
3,123 reads
How Effective Is Your Data Load Monitoring in SQL and Python?
Learn how you can use monitor your data warehouse load process with Python code and a structured process.
2023-10-06 (first published: 2023-09-20)
1,962 reads
Unpivot Data Using Python
This article looks at manipulating data using Python to unpivot data received in a cross tab format.
2023-06-30
3,256 reads
Advantages of Kappa architecture in the Modern Data Stack
A comparison of the lambda and kappa architectures for real time ingestion and analysis of big data.
2023-06-19
4,905 reads
Blogs
Why use XACT_ABORT?
This came up one day at my work when a developer was using it....
Using AI for Data Conversion
I’m sure I’ve never mentioned that I’m an amateur radio operator. Like Vegans and...
Advice I Like: Tipping
By Steve Jones
When in doubt, overtip – from Excellent Advice for Living This is close to...
Forums
Two Events, Two Worlds: A Week in the Life of a Technologist
Comments posted to this topic are about the item Two Events, Two Worlds: A...
Installing SQL Instance on a Clustered Virtual Disk
Hi Everyone, I have a question, I am trying to setup a Lab environment...
Upgrades to SQL Server 2022
Comments posted to this topic are about the item Upgrades to SQL Server 2022
Question of the Day
Upgrades to SQL Server 2022
What is the earliest version from which you can directly upgrade to SQL Server 2022?
See possible answers