Extract and move data between BigQuery and relational databases using PyBigQuery: a connector for SQLAlchemy.
Use Apache Airflow to build and monitor better data pipelines.
Getting to know Apache Kafka: a horizontally scalable event streaming platform. Learn what makes Kafka critical to high-volume low-latency data pipelines.
Get started with Apache Spark in part 1 of our series, where we leverage Databricks and PySpark.
Build a pipeline which extracts raw data from the JIRA's Cloud API, transforms it, and loads the data into a SQL database.