Skip to content

Implementation of projects from Data Pipelines Pocket Reference (Densmore)

Notifications You must be signed in to change notification settings

gavin-crowley/Data-Pipeline-Projects

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 

Repository files navigation

Data-Pipeline-Projects

Data Ingestion: Extracting Data

  • Extracting data from a MySQL database
  • Extracting data from a PostgreSQL Database
  • Extracting data from MongoDB
  • Extracting data from a REST API

Data Ingestion: Loading Data

  • Loading data into a Redshift Warehouse
  • Loading data into a Snowflake Warehouse

Transforming Data

  • Deduplicate records in a table
  • Parsing URLs

Orchestration

  • Building an Airflow DAG

Releases

No releases published

Packages

No packages published

Languages