Join and Aggregate PySpark DataFrames Perform SQL-like joins and aggregations on your PySpark DataFrames.
Working with PySpark RDDs Working with Spark's original data structure API: Resilient Distributed Datasets.
Manage Data Pipelines with Apache Airflow Use Apache Airflow to create standardized and easily reproducible data pipelines in Python.
Structured Streaming in PySpark Become familiar with building a structured stream in PySpark using the Databricks interface.
Becoming Familiar with Apache Kafka and Message Queues Getting to know Apache Kafka: a horizontally scalable event streaming platform. Learn what makes Kafka critical to high-volume low-latency data pipelines.
Cleaning PySpark DataFrames Easy DataFrame cleaning techniques ranging from dropping rows to selecting important data.
Transforming PySpark DataFrames Apply transformations to PySpark DataFrames such as creating new columns, filtering rows, or modifying string & number values.
Learning Apache Spark with PySpark & Databricks Get started with Apache Spark in part 1 of our series, where we leverage Databricks and PySpark.
From CSVs to Tables: Infer Data Types From Raw Spreadsheets The quest to never explicitly set a table schema ever again.
