Steps needed Getting Apache Spark running on windows involves:
Installing a JRE 8 (Java 1.8/OpenJDK 8) Downloading and extracting SPARK and setting SPARK_HOME Downloading winutils.exe and setting HADOOP_HOME If...
2019-08-29
When you run an application using spark-dotnet, to launch the application you need to use spark-submit to start a java virtual machine which starts the spark-dotnet driver which then...
2019-08-20
17 reads
When you run an application using spark-dotnet, to launch the application you need to use spark-submit to start a java virtual machine which starts the spark-dotnet driver which then...
2019-08-20
1 reads
ETL Testing Part 2 - Operational Data Testing
This is the second part of a series on ETL testing, the first part explained about unit testing, and in this part,...
2019-08-13
194 reads
ETL Testing Part 2 - Operational Data Testing
This is the second part of a series on ETL testing, the first part explained about unit testing, and in this part,...
2019-08-13
1 reads
I found this question on stack overflow that went something like this:
“I have a file that includes line endings in the wrong place and I need to parse the...
2019-08-06
8 reads
I found this question on stack overflow that went something like this:
“I have a file that includes line endings in the wrong place and I need to parse the...
2019-08-06
There was a breaking change with version 0.4.0 that changed the name of the class that is used to load the dotnet driver in Apache Spark.
To fix the issue...
2019-08-02
221 reads
There was a breaking change with version 0.4.0 that changed the name of the class that is used to load the dotnet driver in Apache Spark.
To fix the issue...
2019-08-02
2 reads
Why do we bother testing? Testing isn’t an easy thing to define, we all know we should do it, when something goes wrong in production people shout and ask...
2019-07-25
43 reads
By Steve Jones
The episode on data masking and subetting is out. You can see it here:...
By Brian Kelley
I'm listening to Effortless by Greg McKeon (link to author's page) through Audible.com. He...
This book was making its rounds on social media, and the concept seems interesting...
Comments posted to this topic are about the item Ingesting Data From REST API...
Comments posted to this topic are about the item Separate Reads
Comments posted to this topic are about the item The Hash Join I
What are the two inputs called to a hash join operation in SQL Server? (choose 2)
See possible answers