Holden Karau

Sep 09, 2017

  Testing & Validating Apache Spark Jobs As Spark continues to evolve, we need to revisit our testing techniques to support Datasets, streaming, and more. This talk expands on “Beyond Parallelize and Collect” (not…

Jacek Laskowski

Aug 23, 2017

From Basic to Advanced Aggregate Operators in Apache Spark SQL 2.2 and Spark Structured Streaming by Examples There are many different aggregate operators in Spark SQL. They range from the very basic groupBy and…

Hugh McKee

Aug 12, 2017

Safe Passage: Messaging in a distributed systems environment Building a distributed system is fun. Running a distributed system in production is, well, it can be fun, but it can also be challenging. It is…

Renato Cavalcanti

Aug 12, 2017

The Ubiquitous Language in Functional Programming Domain modelling in software is never pure. Next to the domain data and business logic there is a whole other universe of programing language constructs that we have…

Tomer Gabel

Jul 25, 2017

SCALA BACK TO BASICS: TYPE CLASSES Type classes are a fundamental feature of Scala, which allows you to layer new functionality on top of existing types externally, i.e. without modifying or recompiling existing code.…

Jon Pretty

Jul 25, 2017

The Totalitarian Ideology of State Governance We consider case classes and sealed traits to be Scala’s answers to product and coproduct types. But they’re not the only possible answer, and they come with their own choices:…