Homework 1: Pre-Requisites (Docker, Terraform, SQL)
Score: 7 = 7 (questions) + 0 (FAQ) + 0 (learning in public)
Homework URL: View submission
Data Engineering Zoomcamp 2024
Brave Stonebraker
Total Score
76
Homework submissions
Homework 2: Mage
Score: 7 = 6 (questions) + 0 (FAQ) + 1 (learning in public)
Homework URL: View submission
Learning in public links
Workshop 1: Data Ingestion
Score: 7 = 4 (questions) + 0 (FAQ) + 3 (learning in public)
Homework URL: View submission
Homework 3: Data Warehouse
Score: 13 = 6 (questions) + 0 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links
- https://cloud.google.com/bigquery/docs/create-cloud-storage-table-biglake#create-biglake-partitioned-data
- https://cloud.google.com/bigquery/docs/reference/standard-sql/data-definition-language#table_option_list
- https://cloud.google.com/bigquery/docs/working-with-connections#console
- https://www.atlassian.com/data/sql/how-countdistinct-field-works-in-google-bigquery
- https://cloud.google.com/bigquery/docs/external-tables
- https://cloud.google.com/bigquery/docs/materialized-views-intro
- https://cloud.google.com/bigquery/docs/creating-partitioned-tables
Homework 4: Analytics Engineering
Score: 12 = 4 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links
- https://docs.getdbt.com/reference/resource-configs/bigquery-configs
- https://docs.getdbt.com/docs/build/jinja-macros
- https://discourse.getdbt.com/t/parameterising-the-dbt-model-variable-sql-in-clause/10401
- https://support.google.com/looker-studio/answer/6292570?hl=en#zippy=%2Cin-this-article
- https://cloud.google.com/bigquery/docs/samples/bigquery-pandas-gbq-to-gbq-simple
- https://docs.getdbt.com/sql-reference/date-trunc
- https://www.simplilearn.com/tutorials/sql-tutorial/row-number-funtion-in-sql
Homework 5: Batch processing
Score: 13 = 6 (questions) + 1 (FAQ) + 6 (learning in public)
Homework URL: View submission
Learning in public links
- https://spark.apache.org/docs/latest/configuration.html
- https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql/api/pyspark.sql.DataFrameWriter.parquet.html
- https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql/functions.html
- https://www.datacamp.com/tutorial/datediff-sql-function
- https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.RDD.html
- https://www.machinelearningplus.com/pyspark/run-sql-queries-with-pyspark/
Workshop 2: Streaming with SQL
Score: 6 = 3 (questions) + 0 (FAQ) + 3 (learning in public)
Homework URL: View submission
Homework 6: Streaming
Score: 11 = 7 (questions) + 1 (FAQ) + 3 (learning in public)
Homework URL: View submission
Learning in public links
Only scored homework submissions appear here.
Project submissions
No project submissions found.
Only completed project submissions appear here.