Homework 1: Pre-Requisites (Docker, Terraform, SQL)
Score: 7 = 7 (questions) + 0 (FAQ) + 0 (learning in public)
Homework URL: View submission
Data Engineering Zoomcamp 2024
Digamber Deshmukh
Total Score
86
Homework submissions
Homework 2: Mage
Score: 2 = 1 (questions) + 0 (FAQ) + 1 (learning in public)
Homework URL: View submission
Learning in public links
Workshop 1: Data Ingestion
Score: 8 = 4 (questions) + 1 (FAQ) + 3 (learning in public)
Homework URL: View submission
Homework 3: Data Warehouse
Score: 11 = 6 (questions) + 1 (FAQ) + 4 (learning in public)
Homework URL: View submission
Learning in public links
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Data_Warehouse_big_query.sql
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Data_warehouse_big_query_ml.sql
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Data_warehouse_tables_and_queries.sql
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Data_warehouse_extra_web_to_gcs.py
Homework 4: Analytics Engineering
Score: 14 = 6 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links
- https://github.com/Digu01/Data-Engineering-Zoomcamp/tree/main/Week4_Analytics%20Engineering/Models
- https://github.com/leonardocerliani/de_zoomcamp_2024/tree/main/04_analytics_engineering
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Week%204_dbt_project
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/macros/get_payment_type_description.sql
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Week4_Analytics%20Engineering/Models/fact_trips_period.sql
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Week4_Analytics%20Engineering/Models/fact_trips.sql
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Week4_Analytics%20Engineering/Models/fact_fhv_trips.sql
Homework 5: Batch processing
Score: 13 = 5 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links
- https://github.com/Digu01/Data-Engineering-Zoomcamp/tree/main/Week5_batch_processing/Code
- https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/05-batch/setup/pyspark.md
- https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/05-batch/setup/hadoop-yarn.md
- https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/05-batch/setup/linux.md
- https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/05-batch
- https://github.com/aaalexlit/medium_articles/blob/main/Spark_in_Colab.ipynb
- https://colab.research.google.com/github/aaalexlit/medium_articles/blob/main/Spark_in_Colab.ipynb#scrollTo=vZaeQd0va3h1
Homework 6: Streaming
Score: 15 = 7 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Week%206%20Streaming/Docker/kafka/docker-compose.yml
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Week%206%20Streaming/Docker/spark/build.sh
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Week%206%20Streaming/Docker/spark/cluster-base.Dockerfile
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Week%206%20Streaming/Docker/spark/docker-compose.yml
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Week%206%20Streaming/Docker/spark/jupyterlab.Dockerfile
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Week%206%20Streaming/Docker/spark/spark-base.Dockerfile
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/Week%206%20Streaming/Docker/spark/spark-master.Dockerfile
Only scored homework submissions appear here.
Project submissions
Project Attempt 2
FailedScore: 16 = 1 (project) + 9 (peer review) + 5 (learning in public / project) + 0 (learning in public / peer review) + 1 (FAQ)
Project URL: View project
Learning in public links
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/data-engineering-capstone-project/Dataset
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/data-engineering-capstone-project/Dataset-feature-file
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/data-engineering-capstone-project/capstone_notebook.ipynb
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/data-engineering-capstone-project/Project-code
- https://github.com/Digu01/Data-Engineering-Zoomcamp/blob/main/.github/workflows/python-publish.yml
Only completed project submissions appear here.