Data Engineering
The systematic collection and transformation of data via the creation of tools and pipelines.
Manage Data Pipelines with Apache Airflow
Use Apache Airflow to build and monitor better data pipelines.
Structured Streaming in PySpark
Become familiar with building a structured stream in PySpark using the Databricks interface.
DataFrame Transformations in PySpark (Continued)
Continuing to apply transformations to Spark DataFrames using PySpark.
Becoming Familiar with Apache Kafka and Message Queues
An overview of how Kafka works, as well as equivalent message brokers.
Executing Basic DataFrame Transformations in PySpark
Using PySpark to apply transformations to real datasets.
Learning Apache Spark with PySpark & Databricks
Get started with Apache Spark in part 1 of our series where we leverage Databricks and PySpark.
Building an ETL Pipeline: From JIRA to SQL
An example data pipeline which extracts data from the JIRA Cloud API and loads it to a SQL database.
Working With GraphQL Fragments and Mutations
Make your GraphQL queries more dynamic with Fragments, plus get started with Mutations.
Building a Client For Your GraphQL API
Now that we have an understanding of GraphQL queries and API setup, it's time to get that data.
Writing Your First GraphQL Query
Begin to structure complex queries against your GraphQL API.
