Apache Spark™ and Scala Workshops

Provides a cherrypy dashboard to bind access to Spark SQL.

Code from Ralph Winters book Packt/Practical-Predictive-Analytics

Big Data Analytics for anazon.com using Spark Framework and Scala Programming Language

Music prediction using PySpark

Ralph Winters Website

Sample analysis done using pyspark on parking violations issued for fiscal year 2017 using the databricks platform

End-to-end real-time credit card transactions application. Made with Kafka, Spark, Bootstrap, ECharts, RxJS.

Recommendation System written in Python, using the pySpark framework and other Data Science libraries

This project extracts list, information and statistics from Wikipedia articles of current and past NBA players. I used Spark SQL to extract information from html documents and save it to a csv file. In the nearby future, I will post the same objective achieved using Pig

Capstone Project in the Udacity Data Scientist Nanodegree program. We manipulate large and realistic datasets with Spark to engineer relevant features for predicting churn. We'll learn how to use Spark MLlib to build machine learning models with large datasets, far beyond what could be done with non-distributed technologies like scikit-learn.

Analysis for a streaming daily retail data using Spark structured streaming and querying this data to get insights

IOT Sensors RealTime Analysis with Apache Spark, Kafka, Python and SQL.

Analysis of a dataset of flights, using the SparkSQL framework and extra web scraping techniques

An investigatory analysis of restaurant sales data using Apache Spark in an attempt to give some insights as to how to boost up the sales of less frequently sold items. This is a real-world dataset from an actual restaurant.

Exploring World Development Indicators: Identifying relationship between Health Indicators using Linear Regression & Classification of Income Group based on Health Indicators using Logistic Regression.

This is a PolyU COMP 4442 project to design a web service based on Spark SQL.

These are some code examples