SQLCover 0.5 - Fixes, smaller features and an exciting surprise
It has been a little while but I have updated SQLCover to include a number of fixes and small features, the majority of which are improvements to the html...
2019-10-16
1 reads
Ed Elliott
How to test ETL Processes in production
This is the final part in the four-part series into testing ETL pipelines, how exciting!
Part 1 - Unit Testing https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ Part 2 - Integration Testing https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/ Part 3...
2019-10-02
119 reads
How to test ETL Processes in production
This is the final part in the four-part series into testing ETL pipelines, how exciting!
Part 1 - Unit Testing https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ Part 2 - Integration Testing https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/ Part 3...
2019-10-02
How to connect spark to ms sql server without '[Error] [JvmBridge] java.sql.SQLException: No suitable driver'?
“[Error] [JvmBridge] java.sql.SQLException: No suitable driver” - unable to connect spark to Microsoft SQL Server.
In spark when you want to connect to a database you use Read() passing in...
2019-10-01
398 reads
How to connect spark to ms sql server without '[Error] [JvmBridge] java.sql.SQLException: No suitable driver'?
“[Error] [JvmBridge] java.sql.SQLException: No suitable driver” - unable to connect spark to Microsoft SQL Server.
In spark when you want to connect to a database you use Read() passing in...
2019-10-01
5 reads
How do test the upstream data is good in an etl process (etl testing part 3)?
In the first two parts of this series (https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ and https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/), I talked about how to unit test your business logic and integration test your ETL infrastructure code. Having...
2019-09-30
21 reads
How do test the upstream data is good in an etl process (etl testing part 3)?
In the first two parts of this series (https://the.agilesql.club/2019/07/how-do-we-test-etl-pipelines-part-one-unit-tests/ and https://the.agilesql.club/2019/08/how-do-we-prove-our-etl-processes-are-correct-how-do-we-make-sure-upstream-changes-dont-break-our-processes-and-break-our-beautiful-data/), I talked about how to unit test your business logic and integration test your ETL infrastructure code. Having...
2019-09-30
Visual Studio tSQLt Test Adapter
I finally got around to updating the tSQLt test adapter for visual studio, you can download it from:
https://marketplace.visualstudio.com/items?itemName=vs-publisher-263684.GoEddietSQLt2019
or the search in visual studio extensions thingy finds it as well.
For...
2019-09-02
80 reads
Visual Studio tSQLt Test Adapter
I finally got around to updating the tSQLt test adapter for visual studio, you can download it from:
https://marketplace.visualstudio.com/items?itemName=vs-publisher-263684.GoEddietSQLt2019
or the search in visual studio extensions thingy finds it as well.
For...
2019-09-02
Help! My Apache Spark configuration on windows isn't working (I think)
Steps needed Getting Apache Spark running on windows involves:
Installing a JRE 8 (Java 1.8/OpenJDK 8) Downloading and extracting SPARK and setting SPARK_HOME Downloading winutils.exe and setting HADOOP_HOME If...
2019-08-29
23 reads
Blogs
Simple Talks Episode 9–Data masking and subsetting
By Steve Jones
The episode on data masking and subetting is out. You can see it here:...
T-SQL Tuesday #180: Avoid Perfect for Good Enough
By Brian Kelley
I'm listening to Effortless by Greg McKeon (link to author's page) through Audible.com. He...
Book Review – Humanizing Data Strategy by Tiankai Feng
This book was making its rounds on social media, and the concept seems interesting...
Forums
Ingesting Data From REST API endpoints: Data Engineering with Fabric
Comments posted to this topic are about the item Ingesting Data From REST API...
Separate Reads
Comments posted to this topic are about the item Separate Reads
The Hash Join I
Comments posted to this topic are about the item The Hash Join I
Question of the Day
The Hash Join I
What are the two inputs called to a hash join operation in SQL Server? (choose 2)
See possible answers