Importing a CSV into SQL Server Shouldn't Be This Hard

A frustrating time importing CSV files leads Steve to test the different options.

Data Flow Error Handling in ADF

Migrating SSIS packages to Azure - Lift and Shift using Azure Data Factory

Unlike an on premises SQL Server, Integration Services (SSIS) works very differently on Azure. If there are requirements to run our existing SSIS packages on Azure, then we need to understand our options. In this article we will talk about our options for migrating SSIS to Azure and what components are required to migrate SSIS packages. […]

Microsoft Azure ADF - Dynamic Pipelines

Azure Data Factory (ADF) is a cloud based data integration service that allows you to create data-driven workflows in the cloud for orchestrating and automating data movement and data transformation. Azure Data Factory does not store any data itself. but it allows you to create data-driven workflows to orchestrate the movement of data between supported […]

How to Resolve Merge Conflicts in Git for SSIS Projects

In this part of the tip, we'll show you how to simulate a merge conflict when using Git for an Integration Services project.

Getting Informative SQL Agent Notifications from Failed SSIS Packages

Getting informative error messages when something goes wrong with an SSIS package is critical, especially if you are not in front of your computer.

How to simulate Case statement in Azure Data Factory (ADF) compared with SSIS?

This post will describe how you use a CASE statement in Azure Data Factory (ADF). If you are coming from SSIS background, you know a piece of SQL statement will do the task. However let's see how do it in SSIS and the very same thing can be achieved in ADF. Problem statement For my […]

Incremental Data Loading using Azure Data Factory

Introduction In my last article, Loading data in Azure Synapse Analytics using Azure Data Factory, I discussed the step-by-step process for loading data from an Azure storage account to Azure Synapse SQL through Azure Data Factory (ADF). ADF basics are covered in that article. In this article I will go through the process for the incremental […]

Downloading a CSV File from an API Using Azure Data Factory

In this article, learn how to use Azure Data Factory with a REST API to download files.

Modular ETL Architecture Design in SSIS

Overview of ETL Architecture In a data warehouse, one of the main parts of the entire system is the ETL process. ETL is the system that reads data from the source system, transforms the data according to the business logic, and finally loads it into the warehouse. While fetching data from the sources can seem […]