Skip to content

Latest commit

 

History

History
18 lines (14 loc) · 445 Bytes

README.md

File metadata and controls

18 lines (14 loc) · 445 Bytes

Data-Pipeline-Projects

Data Ingestion: Extracting Data

  • Extracting data from a MySQL database
  • Extracting data from a PostgreSQL Database
  • Extracting data from MongoDB
  • Extracting data from a REST API

Data Ingestion: Loading Data

  • Loading data into a Redshift Warehouse
  • Loading data into a Snowflake Warehouse

Transforming Data

  • Deduplicate records in a table
  • Parsing URLs

Orchestration

  • Building an Airflow DAG