Example end to end data engineering project.
-
Updated
Dec 8, 2022 - Python
Example end to end data engineering project.
Replicate data from MySQL, Postgres and MongoDB to ClickHouse
For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR
Explore Apache Kafka data pipelines in Kubernetes.
🏥 A simple healthcheck wrapper to monitor Kafka Connect.
🎼 Docker compose files for various kafka stacks
A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.
Udacity Data Streaming Nanodegree Program
Playground for Kafka / Confluent Kubernetes experimentations
A simple demo showing how to use Ably and fastAPI to route messages into Kafka for stream processing
Streaming Data from Kafka to Postgres with Kafka Connect, AVRO, Schema Registry and Python
Web UI for Apache Kafka Connect (vue-connect)
Deploy Kafka pipelines to Kubernetes
Big data technologies
Guardian for your Kafka Connect connectors. It check status of connectors and tasks and restart if they are failed
My project submission for Udacity Data Streaming Nanodegree
A tool to manage Apache Kafka Connect connectors and tasks
Store events and publish to Kafka
Udacity Data Streaming - Project Optimizing Public Transportation
Add a description, image, and links to the kafka-connect topic page so that developers can more easily learn about it.
To associate your repository with the kafka-connect topic, visit your repo's landing page and select "manage topics."