Course Wiki
6.3.1 First Look at Spark/PySpark — Data Engineering Zoomcamp Module 6
Recorded lesson: 6.3.1 First Look at Spark/PySpark.
Related Pages
Data Engineering Zoomcamp › Module 6: Batch Processing › 6.3.1 First Look at Spark/PySpark
Notes
The recorded lesson for 6.3.1 First Look at Spark/PySpark in module 6 of Data Engineering Zoomcamp.
Key concepts
Related notes
- dez-m06-6-1-1-introduction-to-batch-processing
- dez-m06-6-1-2-introduction-to-spark
- dez-m06-6-3-2-spark-dataframes
- dez-m06-6-3-3-optional-preparing-yellow-and-green-taxi-d
- dez-m06-6-3-4-sql-with-spark
- dez-m06-6-4-1-anatomy-of-a-spark-cluster
- dez-m06-6-4-2-groupby-in-spark
- dez-m06-6-4-3-joins-in-spark
- dez-m06-6-5-1-operations-on-spark-rdds
- dez-m06-6-5-2-spark-rdd-mappartition
- dez-m06-6-6-1-connecting-to-google-cloud-storage
- dez-m06-6-6-2-creating-a-local-spark-cluster
- dez-m06-6-6-3-setting-up-a-dataproc-cluster
- dez-m06-6-6-4-connecting-spark-to-big-query