Using Pipeline Return Value in Azure Data Factory and Azure Synapse Analytics
Learn how you can return data from one ADF pipeline for use in another.
2023-11-01
4,104 reads
ETL/SSIS/Azure Data Factory
Trigger the Execution of an ADF Pipeline from an Email
Learn how you can configure an Azure Data Factory pipeline that is triggered by an email being sent to an address.
2023-11-03 (first published: 2023-10-27)
3,857 reads
Top 10 Methods to Improve ETL Performance Using SSIS
Extraction Transformation Load (ETL) is the backbone for any data warehouse. In the data warehouse world data is managed by the ETL process, which consists of three processes, Extraction-Pull/Acquire data from sources, Transformation-change data in the required format and Load-push data to the destination generally into a data warehouse or a data mart.
2023-10-25
What I Wish Everyone Knew About ETL Processes - Traditional to Modern Cloud Solutions
Learn about the evolutionary journey of ETL (Extract, Transform, Load) from traditional processes to modern cloud solutions.
2023-10-18
GIT Configuration and Automated Release for Azure Data Factory
Learn a step-by-step method to save your ADF pipelines in Git and automatically release new changes to test and production.
2024-09-23 (first published: 2023-10-16)
2,322 reads
Sending Multiple Attachments in Email from Azure Data Factory Pipeline
This article shows how you can have your Azure Data Factory (ADF) pipeline send an email using a Logic App.
2023-09-29
2,879 reads
How Effective Is Your Data Load Monitoring in SQL and Python?
Learn how you can use monitor your data warehouse load process with Python code and a structured process.
2023-10-06 (first published: 2023-09-20)
1,905 reads
Unpivot Data Using Python
This article looks at manipulating data using Python to unpivot data received in a cross tab format.
2023-06-30
3,140 reads
Advantages of Kappa architecture in the Modern Data Stack
A comparison of the lambda and kappa architectures for real time ingestion and analysis of big data.
2023-06-19
4,768 reads
Python 3 Script for Generating SQL Insert Statements from CSV Data
This Python 3 script is designed to take CSV file data pasted into the csv_data variable and generate SQL insert statements that can be used to insert the data into a MySQL database. The script is easy to use and can save you a lot of time when working with large amounts of data.
2023-05-08 (first published: 2023-05-05)
4,811 reads
Blogs
My 2024 in Data: Music
By Steve Jones
This is my last week of the year working (I guess I come back...
A New Word: Suente
By Steve Jones
suente– n. the state of being so familiar with someone that you can be...
Side Projects
Anyone (everyone?) who has ever tried to learn a programming language knows that to...
Forums
Timeout Error while executing a TSQL statement in Sql server Express Edition
I am getting the below error when I execute a SQL command in SQL...
Timeout Error while executing a TSQL statement in Sql server Express Edition
I am getting the below error when I execute a SQL command in SQL...
Sql script replace and rearrange numbers
Hi everyone. I have this table and this information. (left side of the image)...