Data engineering projects from udacity

General Purpose

Contain all implemented projects i submitted when i was coursing the 'data engineering' nanodegree udacity's.

Personal Purpose

• Get a theoretical knowledge to walk in Data engineering world.
• Learn about AWS service and how to use it.
• Prepare to junior data engineering job.

About the project

This project contain all codes using in workspace of nanodegree to resolve this project challenges. the main objective is to evolve the data reception and processing system for music streaming based app in startup.

Skills and tools.

• AWS Cloud (Redshift, S3, IAM & EMR).
• Airflow apache.
• Database: PostgreSQL and Cassandra.
• Model Database schema.
• build DAGs.
• Write a good and understandable technical documentation of process.
• Understand requirements of stakeholders.

Project list

• Data modeling with Postgresql
• Data modeling with Cassandra
• Data Warehouse
• Data lake
• Data pipeline
• Capstone

Info

Coursing Dates : 2020/Nov/19 - 21/Jan/20