If you are working with ADF (Azure Data Factory) data flows, then you may have noticed there was a new feature released in November 2020, which is useful to capture any error while inserting/updating the records in a SQL database. This article will describe how to setup the error row handling feature and why it's […]
2021-06-16 (first published: 2021-05-02)
5,461 reads
Whether you work as a Data Engineer or a Data Scientist, a Jupyter Notebook is a helpful tool. One of the projects I was working required a comparison of two parquet files. This is mainly a schema comparison, not a data comparison. Though the two .parquet were created from two different sources, the outcome should […]
2021-05-17
5,350 reads
This article will describe how to add your local timestamp at the end of the each file in Azure Data Factory (ADF). In general, ADF gets a UTC timestamp, so we need to convert the timestamp from UTC to EST, since our local time zone is EST. For example, if the input Source file name […]
2021-04-22
29,614 reads
This article will help you to work with Store Procedure with output parameters in Azure data factory.
2021-04-06
33,490 reads
2021-01-14
45,560 reads
This post will describe how you use a CASE statement in Azure Data Factory (ADF). If you are coming from SSIS background, you know a piece of SQL statement will do the task. However let's see how do it in SSIS and the very same thing can be achieved in ADF. Problem statement For my […]
2020-11-12
22,090 reads
By Brian Kelley
Core skills depends on the position, but the point is that ensuring you have...
By Steve Jones
zverism – n. the wish that people could suspend their civility and indulge in...
By Kevin3NF
The Source Control Dilemma Every DBA has been there. Trying to keep track of...
Hi I have a task in my SSIS package that moves files from source...
We are migrating our environments to Azure, it will be a mix of SQL...
Comments posted to this topic are about the item The Inefficiencies of Kubernetes
How do I calculate the amount of space needed for I/O buffers during a backup operation?
See possible answers