Apache Spark | Hackers and Slackers

Performing Macro Operations on PySpark DataFrames

Perform SQL-like joins and aggregations on your PySpark DataFrames.

Working with Spark's original data structure API: Resilient Distributed Datasets.

Become familiar with building a structured stream in PySpark using the Databricks interface.

Continuing to apply transformations to Spark DataFrames using PySpark.

Using PySpark to apply transformations to real datasets.

Easy DataFrame cleaning techniques, ranging from dropping problematic rows to selecting important columns.

Get started with Apache Spark in part 1 of our series, where we leverage Databricks and PySpark.