Empowering Lakehouse Users – Data Engineering with Fabric
Learn how to use the OneLake Explorer and Data Wrangler extension in VS Code to empower users to work with data in Microsoft Fabric.
2024-05-22
1,693 reads
data engineering
Combining Silver Tables into a Model – Data Engineering with Fabric
This next article in the series creates objects at the gold layer for consumption by combining tables from the silver layer of the lake house.
2024-05-15
2,835 reads
Metadata Driven Pipelines – Data Engineering with Fabric
This article explains metadata driven pipelines and shows an example in Microsoft Fabric.
2024-05-01
3,853 reads
Full vs. Incremental Loads – Data Engineering with Fabric
Learn how to perform full and incremental loads in Fabric with a little SparkSQL.
2024-04-17
5,695 reads
Managing Files and Folders with Python – Data Engineering with Fabric
In this article, learn how you can manage files and folders for both full and incremental loading situations.
2024-03-27
3,319 reads
Managed Vs Unmanaged Tables – Data Engineering with Fabric
Learn how to get started with Microsoft Fabric along with the differences between managed and unmanaged tables.
2024-03-20
4,052 reads
Evolving Role of Data Professionals in Artificial Intelligence Era
Generative Al tools like Gemini and GPT promise to automate and augment knowledge-based work. Data professionals must adapt to this transformation by acquiring new skills and playing a central role in their organization's AI-driven future. Data preparation, curation, ethical sourcing and labeling, and collecting user feedback become crucial as high-quality data is essential for effective LLM based application.
2024-03-04
2,617 reads
What is OneLake in Microsoft Fabric?
Get ready to be blown away! The highly anticipated Microsoft Build in May 2023 has finally unveiled its latest and greatest creation: the incredible Microsoft Fabric - an unparalleled Data Intelligence platform that is guaranteed to revolutionize the tech world! fig 1: OneLake for all Data One of the most exciting things in Fabric I […]
2023-07-26
5,011 reads
Revolutionizing Real-Time Data Management with SQL Server, Kafka, and Informatica
This article examines how one can structure a pipeline for processing real-time data using Kafka and Informatica.
2023-04-26
4,569 reads
Step by Step Guide to Install Jupyter Notebook
Whether you work as a Data Engineer or a Data Scientist, a Jupyter Notebook is a helpful tool. One of the projects I was working required a comparison of two parquet files. This is mainly a schema comparison, not a data comparison. Though the two .parquet were created from two different sources, the outcome should […]
2021-05-17
5,333 reads
Blogs
March 2025 SQL Challenge: Test Your Skills with Advanced SQL Scenarios
If you’re an experienced SQL user eager to sharpen your expertise with real-world challenges,...
SQL Saturday Atlanta BI Recap
By DataOnWheels
https://sqlsaturday.com/2025-03-08-sqlsaturday1102/#schedule SQL Saturday Atlanta BI is one of my favorite SQL Saturdays of the...
Mistakes IT Shops Without a DBA Make
By Kevin3NF
We get it. There’s no budget for a DBA on staff, or even a...
Forums
Dynamic T-SQL Script Parameterization Using Python
Comments posted to this topic are about the item Dynamic T-SQL Script Parameterization Using...
SQL 2017 server keeps locking up
I manage a two-node production SQL cluster running SQL Server 2017 CU31 on Windows...
Alternatiives to Junk Dimensions
Hello SSC, I am not sure if I posted this in the right spot,...
Question of the Day
Partial Backups II
What is a partial backup for a read-write database?
See possible answers