Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)

Generative AI & Recommendation Engine --- Firat University / Faculty of Technology / Software Engineering / Final Project

This project is designed to handle data read/write to any database and works well as an ETL engine

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.

Personal Spotify Wrapped using Airflow, Django and Docker

Finnhub data streaming pipline for real-time Bitcoin trades analysis.

Airflow ETL project to extract raw data by developing ETL pipeline to draw meaningful insights through visualization with Tableau.

Callback-based iterators for Go language.

This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow orchestration tool on AWS EC2 instance.

ML pipeline to categorize emergency messages based on the needs communicated by the sender.

No-code LLM Platform to launch APIs and ETL Pipelines to structure unstructured documents

Airflow DAGs for the Stellar ETL project

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.

fluent iteration in Python

Proyecto sobre retención de empleados. Análisis de datos en Power BI. Modelos de machine learning y análisis de sentimientos.

Real-Time Event Streaming & Change Data Capture

Flow PHP - data processing framework

App for news articles summarizing.

This project demonstrates the integration of data from multiple sources into a unified data lake. The project showcases the use of AWS Glue for ETL tasks, Amazon S3 as a data lake, AWS Data Pipeline for data movement automation, Amazon RDS for relational data storage, and Amazon Redshift for data warehousing and analysis.

The goal of this project is to perform comprehensive data analytics on Uber trip data using a modern data engineering stack on Google Cloud Platform (GCP).