This is a data engineering project for log analytics using kafka and spark
To get started and runing this program
- python producer.py
- spark-submit --packages org.apache.spark:spark-sql-kafka-0-10_2.12:3.4.1 consumer_2gb.py
-
Notifications
You must be signed in to change notification settings - Fork 0
ZCai25/de_kafka_spark
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
data engineering class projects for log analytics using kafka and spark
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published