Homework 1: Pre-Requisites (Docker, Terraform, SQL)

Score: 6 = 6 (questions) + 0 (FAQ) + 0 (learning in public)

Homework URL: View submission

Homework 2: Mage

Score: 8 = 6 (questions) + 0 (FAQ) + 2 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://docs.docker.com/compose/
• https://stackoverflow.com/questions/62732504/google-cloud-403-error-the-billing-account-for-the-owning-project-is-disabled-in

Workshop 1: Data Ingestion

Score: 7 = 4 (questions) + 0 (FAQ) + 3 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://dlthub.com/docs/blog/dlt-aws-taktile-blog
• https://dlthub.com/docs/blog/semantic-modeling-tools-comparison
• https://medium.com/odicis-data-engineering/exploring-data-integration-frontiers-airbyte-and-data-load-tool-dlt-b882446bea23

Homework 3: Data Warehouse

Score: 12 = 6 (questions) + 0 (FAQ) + 6 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://cloud.google.com/bigquery/docs/loading-data-cloud-storage-parquet
• https://cloud.google.com/blog/topics/developers-practitioners/bigquery-explained-working-joins-nested-repeated-data
• https://cloud.google.com/blog/products/data-analytics/new-blog-series-bigquery-explained-overview
• https://cloud.google.com/bigquery/docs/streaming-data-into-bigquery#bigquery_table_insert_rows-python
• https://cloud.google.com/bigquery/docs/materialized-views-intro
• https://panoply.io/data-warehouse-guide/bigquery-architecture/

Homework 4: Analytics Engineering

Score: 5 = 2 (questions) + 0 (FAQ) + 3 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://courses.getdbt.com/courses/fundamentals
• https://docs.getdbt.com/guides/bigquery?step=1
• https://docs.getdbt.com/docs/introduction

Homework 5: Batch processing

Score: 11 = 6 (questions) + 0 (FAQ) + 5 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://www.youtube.com/watch?v=_C8kWso4ne4&ab_channel=freeCodeCamp.org
• https://domino.ai/data-science-dictionary/pyspark
• https://spark.apache.org/docs/latest/api/python/user_guide/index.html
• https://spark.apache.org/docs/latest/api/python/user_guide/pandas_on_spark/best_practices.html
• https://spark.apache.org/docs/latest/rdd-programming-guide.html

Workshop 2: Streaming with SQL

Score: 2 = 0 (questions) + 0 (FAQ) + 2 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://medium.com/@RisingWave_Engineering/mastering-risingwave-a-comprehensive-tutorial-for-stream-processing-enthusiasts-0cbd6717b345
• https://docs.risingwave.com/docs/current/real-time-ad-performance-analysis/

Public Leaderboard

Score: 0 = 0 (questions) + 0 (FAQ) + 0 (learning in public)

Project Attempt 2

Project score: 20 Passed

Score: 41 = 20 (project) + 9 (peer review) + 7 (learning in public / project) + 5 (learning in public / peer review) + 0 (FAQ)

Project URL: View project

Learning in public links: Show

• https://www.kaggle.com/discussions/general/194531
• https://medium.com/@jaitechie05/part-1-unleash-the-magic-in-your-data-pipelines-with-mage-ai-5f4fc80b53cb#:~:text=Mage-AI%20is%20an%20open,addressing%20some%20of%20its%20complexities.
• https://www.getdbt.com/analytics-engineering
• https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&cad=rja&uact=8&ved=2ahUKEwis8qjzmMaFAxU9gP0HHc0zCMIQFnoECBkQAQ&url=https%3A%2F%2Fsupport.google.com%2Flooker-studio%2Fanswer%2F9171315%3Fhl%3Den&usg=AOvVaw0obd1bArT0f_BWPJo5bnJz&opi=89978449
• https://blog.coupler.io/google-data-studio-tutorial-for-beginners/
• https://github.com/dbt-labs/dbt-core/issues
• https://www.getdbt.com/analytics-engineering/use-cases