Hackers and Slackers Logo
AboutSeriesJoinSearchDonate
Search results
No results for 'undefined'
mobile-menu
Search results
No results for ''
Trending Searches
HomeAboutSearch
Tags
PythonSoftwareDevOpsArchitectureData EngineeringPandasData AnalysisData ScienceREST APIsSQLCode Snippet CornerFlaskJavaScriptAWSGoogle CloudNodeJS
Series
Build Flask AppsData Analysis with PandasGoogle Cloud ArchitectureLearning Apache SparkCreate a REST API in AWSWorking with MySQLGraphQL TutorialsHacking Tableau ServerMastering SQLAlchemyMongoDB Atlas Cloud ArchitectureWelcome to SQLMapping Data with MapboxMicrosoft PowerPivotGetting Started with DjangoPython Concurrency with AsyncioWeb Scraping With Python
Authors
Todd BirchardMax MileafGraham BeckleyDavid AquinoMatthew AlhonteRyan RosadoPaul ArmstrongDylan Castillo
JoinRSS Donate
Data Engineering

Data Engineering (page 1)

Collect and transform data on a large scale. Build data pipelines, work with a horizontally scalable architecture, or simply scrape and collect data.

Create Google BigQuery Tables via the Python SDK

Create Google BigQuery Tables via the Python SDK

Use Google Cloud's Python SDK to insert large datasets into Google BigQuery, enjoy the benefits of schema detection, and manipulating data programmatically.

Todd
Todd
22 January, 2019•11 min read
Google Cloud
Scrape Structured Data with Python and Extruct

Scrape Structured Data with Python and Extruct

Supercharge your scraper to extract quality page metadata by parsing JSON-LD data via Python's extruct library.

Todd
Todd
28 June, 2020•13 min read
Python
Simplify BigQuery ETL jobs using SQLAlchemy

Simplify BigQuery ETL jobs using SQLAlchemy

Extract and move data between BigQuery and relational databases using PyBigQuery: a connector for SQLAlchemy.

Todd
Todd
15 November, 2019•8 min read
Data Warehouses
Using Amazon Redshift as your Data Warehouse

Using Amazon Redshift as your Data Warehouse

Get the most out of Redshift by performance tuning your cluster and learning how to query your data optimally.

Todd
Todd
09 June, 2019•12 min read
Data Warehouses
Join and Aggregate PySpark DataFrames

Join and Aggregate PySpark DataFrames

Perform SQL-like joins and aggregations on your PySpark DataFrames.

Todd
Todd
24 June, 2019•7 min read
Spark
Working with PySpark RDDs

Working with PySpark RDDs

Working with Spark's original data structure API: Resilient Distributed Datasets.

Todd
Todd
06 June, 2019•8 min read
Spark
Manage Data Pipelines with Apache Airflow

Manage Data Pipelines with Apache Airflow

Use Apache Airflow to build and monitor better data pipelines.

Todd
Todd
01 June, 2019•13 min read
Apache
Structured Streaming in PySpark

Structured Streaming in PySpark

Become familiar with building a structured stream in PySpark using the Databricks interface.

Todd
Todd
13 May, 2019•8 min read
Spark
Becoming Familiar with Apache Kafka and Message Queues

Becoming Familiar with Apache Kafka and Message Queues

Getting to know Apache Kafka: a horizontally scalable event streaming platform. Learn what makes Kafka critical to high-volume low-latency data pipelines.

Todd
Todd
01 May, 2019•6 min read
Apache
Cleaning PySpark DataFrames

Cleaning PySpark DataFrames

Easy DataFrame cleaning techniques ranging from dropping rows to selecting important data.

Todd
Todd
21 June, 2019•18 min read
Spark
Page 1 of 4
Next
Hackers and Slackers

Community of hackers obsessed with data science, data engineering, and analysis. Openly pushing a pro-robot agenda.

Trending Posts
Extract Nested Data From Complex JSONIntegrate Plotly Dash Into Your Flask AppManaging Multiple Versions of Python on Ubuntu 18.04Scraping Data on the Web with BeautifulSoupMake Your First API Calls with JQuery AJAXConnecting Pandas to a Database with SQLAlchemySSH & SCP in Python with ParamikoConfiguring Python Projects with INI, TOML, YAML, and ENV files

Tags

PythonSoftwareDevOpsArchitectureData EngineeringPandasExcelData AnalysisData ScienceREST APIsSQLCode Snippet CornerFlaskJavaScriptAWSGoogle CloudNodeJSMySQLApacheFrontendData VisNoSQLBIExpressJSGraphQLPostgreSQLSparkETL PipelinesTableauAtlassianAutomationBig DataGatsbyJSMachine LearningSQLAlchemy

Newsletter

Donations

Quinn
1

last year I was trying to learn flask and got good tips from your site, although my journey with flask was suspended for a while, now I come back on track again, and with the interests to integrate plotly dash into flask with flask-login to protect dash, possible?

Michele Urbani
1

Good work! A nice starting point for many of my projects. Thank you!

tekwizz123
5

Awesome website on Flask and how it all works, thanks for making such a detailed walkthrough!

Phaidrosz
1

this is something

Hackers and Slackers Logo

Community of hackers obsessed with data science, data engineering, and analysis. Openly pushing a pro-robot agenda.

PagesAboutSeriesJoinSearchDonateSign up
SeriesBuild Flask AppsData Analysis with PandasGoogle Cloud ArchitectureLearning Apache SparkWorking with MySQLEmbracing GraphQLMastering SQLAlchemyWelcome to SQL
AuthorsTodd BirchardMax MileafGraham BeckleyDavid AquinoMatthew AlhonteRyan RosadoPaul ArmstrongDylan Castillo
©2021 Hackers and Slackers, All Rights Reserved.