Empowering Lakehouse Users – Data Engineering with Fabric
Learn how to use the OneLake Explorer and Data Wrangler extension in VS Code to empower users to work with data in Microsoft Fabric.
2024-05-22
1,570 reads
data engineering
Combining Silver Tables into a Model – Data Engineering with Fabric
This next article in the series creates objects at the gold layer for consumption by combining tables from the silver layer of the lake house.
2024-05-15
2,512 reads
Metadata Driven Pipelines – Data Engineering with Fabric
This article explains metadata driven pipelines and shows an example in Microsoft Fabric.
2024-05-01
3,295 reads
Full vs. Incremental Loads – Data Engineering with Fabric
Learn how to perform full and incremental loads in Fabric with a little SparkSQL.
2024-04-17
5,003 reads
Managing Files and Folders with Python – Data Engineering with Fabric
In this article, learn how you can manage files and folders for both full and incremental loading situations.
2024-03-27
3,073 reads
Managed Vs Unmanaged Tables – Data Engineering with Fabric
Learn how to get started with Microsoft Fabric along with the differences between managed and unmanaged tables.
2024-03-20
3,539 reads
Evolving Role of Data Professionals in Artificial Intelligence Era
Generative Al tools like Gemini and GPT promise to automate and augment knowledge-based work. Data professionals must adapt to this transformation by acquiring new skills and playing a central role in their organization's AI-driven future. Data preparation, curation, ethical sourcing and labeling, and collecting user feedback become crucial as high-quality data is essential for effective LLM based application.
2024-03-04
2,567 reads
What is OneLake in Microsoft Fabric?
Get ready to be blown away! The highly anticipated Microsoft Build in May 2023 has finally unveiled its latest and greatest creation: the incredible Microsoft Fabric - an unparalleled Data Intelligence platform that is guaranteed to revolutionize the tech world! fig 1: OneLake for all Data One of the most exciting things in Fabric I […]
2023-07-26
4,858 reads
Revolutionizing Real-Time Data Management with SQL Server, Kafka, and Informatica
This article examines how one can structure a pipeline for processing real-time data using Kafka and Informatica.
2023-04-26
4,477 reads
Step by Step Guide to Install Jupyter Notebook
Whether you work as a Data Engineer or a Data Scientist, a Jupyter Notebook is a helpful tool. One of the projects I was working required a comparison of two parquet files. This is mainly a schema comparison, not a data comparison. Though the two .parquet were created from two different sources, the outcome should […]
2021-05-17
5,241 reads
Blogs
AI Innovation in Microsoft Keynote
By Chris Yates
I’m thrilled to be covering the Microsoft Keynote: Fuel AI Innovation with Azure Databases on Day...
Benefits of Migrating from Azure Synapse Analytics to Microsoft Fabric
By James Serra
Many customers ask me about the advantages of moving from Azure Synapse Analytics to...
PASS Summit 2024 – A Very Different World
By Brian Kelley
The last data centric conference I attended was the PASS Summit in 2019. A...
Forums
What does B6 Notebook mean?
B6 Notebook Size can be found in a few novels and stories. The dimensions...
Unencrypted connections in Always on Availability Group
Hi, In my Always On Availability environment, I am seeing two encrypt_option values as...
Error loading multiple CSV files in SSIS
Hi everyone I have a bunch of CSV files that I need to bulk...
Question of the Day
Using Outer Joins
I have this data in a SQL Server 2019 database:
Customer table CustomerID CustomerName 1 Steve 2 Andy 3 Brian 4 Allen 5 Devin 6 Sally OrderHeader table OrderID CustomerID OrderDate 1 1 2024-02-01 2 1 2024-03-01 3 3 2024-04-01 4 4 2024-05-01 6 4 2024-05-01 7 3 2024-06-07 8 2 2024-04-07I want a list of all customers and their order counts for a period of time, including zero orders. If I run this query, how many rows are returned?
SELECT c.CustomerName, COUNT(oh.OrderID) FROM dbo.Customer AS c LEFT JOIN dbo.OrderHeader AS oh ON oh.CustomerID = c.CustomerID WHERE oh.Orderdate > '2024/04/01' GROUP BY c.CustomerNameSee possible answers