Collection of Databricks and Jupyter Notebooks

My notebook on using Python with Jupyter Notebook, PySpark etc

Implementation of Spark code in Jupyter notebook. Topics include: RDDs and DataFrame, exploratory data analysis (EDA), handling multiple DataFrames, visualization, Machine Learning

This repo contains my learnings and practice notebooks on Spark using PySpark (Python Language API on Spark). All the notebooks in the repo can be used as template code for most of the ML algorithms and can be built upon it for more complex problems.

PySpark & Jupyter Notebooks Deployed On Kubernetes

Jupyter notebook server prepared for running Spark with Scala kernels on a remote Spark master

Repositório contendo todo o projeto de engenharia de dados realizado na Databricks conectando com o redshift na aws

Spark and Spark ML notebooks

Spark Python Programs on Jupyter notebook

Jupiter notebooks for my spark tutorials.

Explains the implementation of spark concepts using pyspark API from jupyter notebook

This notebook contains detailed code for spark and machine learning and databricks

The repository contains notebook templates for the purposes of the data science course at the Cracow University of Economics.

Performed Big Data Analysis on Bundesliga Football League Dataset using tools PySpark, spark-SQL, and numpy and done in Jupyter Notebook.

Pyspark tutorial with different query that you can use on notebook using pyspark. It is very useful tool to analyze large amount of data.

This SparkSQL project analyzes home sales data, optimizing queries and calculating average prices. Results are saved in a Jupyter Notebook and uploaded to a GitHub repository named "Home_Sales."

Análise de dataset gerado em projeto de 100 dias da Organização "Our World in Data" que acompanhou e tabulou dados mundiais da epidemia de "varíola dos macacos" no ano de 2022. Desenvolvido em Pyspark no ambiente notebook do Google Colab.

In this notebook I’ll use the HMP dataset and perform some basic operations using Apache SparkML Pipeline component. This dataset is a public collection of labelled accelerometer data recordings to be used for the creation and validation of acceleration models of human motion primitives.