README.md

Navigating this repository

This guide contains the information on Spark that has been valuable to previous semesters. Additional examples and guides are also stored in our DataBricks environment.

• Overview of Spark
• Overview of DataBricks
• Pyspark notes: It is a work in progress
  • Aggregate Calculations
• Using Spark in Docker
• Databricks Examples
• Machine Learning Notes
• Background on Parquet Files