TF-IDF in .NET for Apache Spark Using Spark ML
Spark ML in .NET for Apache Spark Spark is awesome, .NET is awesome, machine learning (ML) is awesome, so what could be better than using .NET to write ML...
2020-07-07
10 reads
Ed Elliott
TF-IDF in .NET for Apache Spark Using Spark ML
Last Updated: 2020-10-18
NOTE: What you read here was before .NET for Apache Spark 1.0 which includes everything we need to do this purely in .NET - in this post...
2020-07-07
19 reads
Approaches to running Databricks ETL code from Azure ADF
Databricks is fantastic, but there is a small issue with how people use it. The problem is that Databricks is all things to all people. Data scientists and data...
2020-06-03
198 reads
Approaches to running Databricks ETL code from Azure ADF
Databricks is fantastic, but there is a small issue with how people use it. The problem is that Databricks is all things to all people. Data scientists and data...
2020-06-03
3 reads
The four tenets of ETL testing
Every ETL pipeline is only ever as reliable as the data that the upstream system provides. It is inevitable that assumptions you make about the data you are provided...
2020-03-06
15 reads
The four tenets of ETL testing
Every ETL pipeline is only ever as reliable as the data that the upstream system provides. It is inevitable that assumptions you make about the data you are provided...
2020-03-06
7 reads
2020-02-21
6 reads
Passing status messages and results back from Databricks to ADF
When we use ADF to call Databricks we can pass parameters, nice. When we finish running the Databricks notebook we often want to return something back to ADF so...
2020-02-05
52 reads
Passing status messages and results back from Databricks to ADF
When we use ADF to call Databricks we can pass parameters, nice. When we finish running the Databricks notebook we often want to return something back to ADF so...
2020-02-05
2 reads
Spark Delta Lake, Updates, Deletes and Time Travel
When you use delta lake there are a couple of interesting things to note based around the fact that the data is stored in parquet files which are read-only...
2020-01-20
13 reads
Blogs
Using Prompt AI for a Travel Data Analysis
By Steve Jones
I was looking back at my year and decided to see if SQL Prompt...
FinOps for Kubernetes: Leveraging OpenCost, KubeGreen, and Kubecost for Cost Efficiency
In the era of cloud-native applications, Kubernetes has become the default standard platform for...
2025 Wrapped for Steve
By Steve Jones
I’ve often done some analysis of my year in different ways. Last year I...
Forums
reaching ftp thru winscp but erroring in ssis ftp task connection
Hi, below i show various results trying to reach our ftp site (a globalscape...
Finding Motivation
Comments posted to this topic are about the item Finding Motivation
The Last Binary Value of the Year
Comments posted to this topic are about the item The Last Binary Value of...
Question of the Day
The Last Binary Value of the Year
What does this code return?
SELECT cast(0x2025 AS NVARCHAR(20))Image 1:
Image 2: 
Image 3: 
Image 4: 
See possible answers