Hackers and Slackers
Hackers and Slackers

Hackers and Slackers

  • About
  • Series
  • Join
  • Donate
Sign in Subscribe
  • Python
  • Software
  • DevOps
  • Architecture
  • Data Engineering
  • Pandas
  • Data Analysis
  • SQL
  • Data Science
  • REST APIs
  • JavaScript
  • Flask
  • AWS
  • NodeJS
  • Google Cloud
  • Apache
  • Frontend
  • MySQL
  • Data Vis
  • NoSQL
  • Home
  • About
  • Tags
    • Python
    • Software
    • DevOps
    • Architecture
    • Data Engineering
    • Pandas
    • Data Analysis
    • REST APIs
    • Data Science
    • SQL
    • JavaScript
    • Flask
    • AWS
    • NodeJS
    • Google Cloud
    • MySQL
  • Series
    • Data Analysis with Pandas
    • Build Flask Apps
    • Learning Apache Spark
    • Google Cloud Architecture
    • Mastering SQLAlchemy
    • GraphQL Tutorials
    • Welcome to SQL
    • Working with MySQL
    • Mapping Data with Mapbox
    • Web Scraping With Python
    • Python Concurrency with Asyncio
    • Getting Started with Django
  • Join
  • Donate
  • Sign in
  • Subscribe

ETL Pipelines

Create pipelines to extract, transform, and load data. Use Big Data tools like Apache Spark and Kafka to build horizontally scalable ETL pipelines.
Google BigQuery Cluster

Simplify BigQuery ETL jobs using SQLAlchemy

Extract and move data between BigQuery and relational databases using PyBigQuery: a connector for SQLAlchemy.
Todd Birchard
Todd Birchard
Nov 16, 2019 • 8 mins
Data Warehouses
Abstract depiction of an Apache Airflow pipeline

Manage Data Pipelines with Apache Airflow

Use Apache Airflow to create standardized and easily reproducible data pipelines in Python.
Todd Birchard
Todd Birchard
Jun 3, 2019 • 13 mins
Apache
Becoming Familiar with Apache Kafka and Message Queues

Becoming Familiar with Apache Kafka and Message Queues

Getting to know Apache Kafka: a horizontally scalable event streaming platform. Learn what makes Kafka critical to high-volume low-latency data pipelines.
Todd Birchard
Todd Birchard
May 4, 2019 • 6 mins
Apache
Learning Apache Spark with PySpark & Databricks

Learning Apache Spark with PySpark & Databricks

Get started with Apache Spark in part 1 of our series, where we leverage Databricks and PySpark.
Todd Birchard
Todd Birchard
Apr 25, 2019 • 13 mins
Spark
Building an ETL Pipeline: From JIRA's REST API to SQL

Building an ETL Pipeline: From JIRA's REST API to SQL

Build a pipeline which extracts raw data from the JIRA's Cloud API, transforms it, and loads the data into a SQL database.
Todd Birchard
Todd Birchard
Mar 28, 2019 • 11 mins
Data Engineering

Tags

Python Software DevOps Data Engineering Architecture Pandas Excel Data Analysis SQL Data Science REST APIs JavaScript Flask Code Snippet Corner AWS NodeJS Google Cloud Frontend MySQL Apache Data Vis BI NoSQL GraphQL Spark PostgreSQL ExpressJS ETL Pipelines Tableau PowerBI SQLAlchemy GatsbyJS Powerpivot Machine Learning Automation Big Data Atlassian Mapbox Golang Scraping JAMStack Data Warehouses Plotly Docker Concurrency Hashicorp Django ReactJS SaaS Products Frameworks Java FastAPI Terraform Microsoft

Newsletter

Create an account to receive occasional updates and interact with the community.

Great!

Check your inbox and click the link to complete the subscription.

Error

Loading...

Series'

Data Analysis with Pandas 11
Build Flask Apps 11
Learning Apache Spark 6
Google Cloud Architecture 6
Mastering SQLAlchemy 4
GraphQL Tutorials 4
Welcome to SQL 4
Working with MySQL 4
Mapping Data with Mapbox 3
Web Scraping With Python 2
Python Concurrency with Asyncio 2
Getting Started with Django 2
Hackers and Slackers

Community of hackers obsessed with data science, data engineering, and analysis. Openly pushing a pro-robot agenda.

Navigation

    • About
    • Series
    • Join
    • Donate
  • Sign in
  • Subscribe

Series'

  • Data Analysis with Pandas
  • Build Flask Apps
  • Learning Apache Spark
  • Google Cloud Architecture
  • Mastering SQLAlchemy
  • GraphQL Tutorials
  • Welcome to SQL
  • Working with MySQL
  • Mapping Data with Mapbox
  • Web Scraping With Python
  • Python Concurrency with Asyncio
  • Getting Started with Django

Authors

  • Todd Birchard
  • Matthew Alhonte
  • Max Mileaf
  • Ryan Rosado
  • Graham Beckley
  • David Aquino
  • Paul Armstrong
  • Dylan Castillo
©2023 Hackers and Slackers, All Rights Reserved.