How to use a Script Activity in ADF as a Lookup
In Azure Data Factory (ADF, but also Synapse Pipelines and Fabric Pipelines), you have a typical scenario where you retrieve some metadata from a database and then loop over...
2024-06-27
77 reads
Koen Verbeeck
Database Build Error – Incorrect syntax near DISTINCT
I wrote a piece of SQL that had some new T-SQL syntax in it: IS DISTINCT FROM. This predicate checks if two expressions are equal taking NULL into account....
2025-01-03 (first published: 2024-06-24)
679 reads
Speaking at dataMinds Connect 2024
I’m very excited to announce I’ve been selected as a speaker for dataMinds Connect 2024, Belgium’s (and maybe/probably/most likely mainland Europe’s) best and greatest Microsoft data platform conference. My...
2024-06-17
4 reads
Dynamic Warehouse & Lakehouse Connections in Microsoft Fabric Data Pipelines
When you develop data pipelines in Microsoft Fabric (the Azure Data Factory equivalent in Fabric, not to be confused with deployment pipelines), you will most likely have some activities...
2024-07-01 (first published: 2024-06-13)
395 reads
System Views in Microsoft Fabric – Query references an object that is not supported in distributed processing mode
I have a metadata-driven ELT framework that heavily relies on dynamic SQL to generate SQL statements that load data from views into a respective fact or dimension. Such a...
2024-07-08 (first published: 2024-06-08)
295 reads
PostgreSQL error in Fabric Pipelines – No pg_hba.conf Entry for Host
I came across a bit of a weird error when I was trying to connect to a PostGreSQL database (hosted as an Azure DB for PostGreSQL), where “xx.xx.xx.xxx” is...
2024-06-07
184 reads
Book Review – Fundamentals of Data Engineering
This book was recommended by some of my colleagues, so I decided to give it a try. After finishing the book, I was pleased that I did. As the...
2024-06-24 (first published: 2024-06-05)
448 reads
Planview Portfolios REST API with ADF – Retrieving Actual Data
In the introduction of this blog post series, I explained the use case: extracting data from the Planview Portfolios REST API using Azure Data Factory. Any tool that can...
2024-06-19 (first published: 2024-05-26)
201 reads
Planview Portfolios REST API with ADF – Fetching the Access Token
In the introduction of this blog post series, I explained the use case: extracting data from the Planview Portfolios RESET API using Azure Data Factory. Any tool that can...
2024-05-28 (first published: 2024-05-26)
23 reads
Planview Portfolios REST API with ADF – The OData Feed
In the introduction, I explained the setup of the use case and why we need to use the OData feed: to get the list of Project IDs, because the...
2024-05-28 (first published: 2024-05-26)
13 reads
Blogs
Azure SQL offerings
By James Serra
There are three Azure SQL products with so many different deployment options, service tiers,...
T-SQL Tuesday #183 Roundup
By Steve Jones
I hosted this month’s T-SQL Tuesday party with my invitation asking about tracking permissions....
A Little Brainstorming with an AI
By Steve Jones
I was asked to do some a little thinking and brainstorming recently. Rather than...
Forums
MEMORYBROKER_FOR_RESERVE experience
Hi, Does anyone have experience with MEMORYBROKER_FOR_RESERVE ? when suddenly there is somehow constantly...
Moving Database Files
I just learned that my database was created on my C:\ drive in the...
Migrate MSSQL to MYSQL - Different Servers
I am needing to migrate a MSSQL db to MySQL, on a different server...
Question of the Day
Mixed Backups
I have a complex database with a few filegroups and files. Can I run a backup command like this? (assume file/filegroup names are valid).
BACKUP DATABASE [complex]
FILE = N'thirdone'
, FILE = N'thirdtwo'
, FILEGROUP = N'second'
TO DISK = N'C:\Program Files\Microsoft SQL Server\MSSQL16.SQL2022\MSSQL\Backup\complex.bak'
WITH NOFORMAT, NOINIT, NAME = N'complex-Full Database Backup', SKIP, NOREWIND, NOUNLOAD, STATS = 10
GO
See possible answers