Homework 1: Docker, SQL and Terraform

Score: 6 = 6 (questions) + 0 (FAQ) + 0 (learning in public)

Homework URL: View submission

Homework 2: Workflow Orchestration

Score: 7 = 5 (questions) + 0 (FAQ) + 2 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://kestra.io/vs/airflow
• https://kestra.io/docs/workflow-components/triggers/schedule-trigger

Workshop 1: Ingestion with dlt

Score: 9 = 4 (questions) + 0 (FAQ) + 5 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://colab.research.google.com/drive/1plqdl33K_HkVx0E0nGJrrkEUssStQsW7
• https://dlthub.com/docs/intro
• https://docs.getdbt.com/blog/serverless-dlt-dbt-stack
• https://dlthub.com/docs/dlt-ecosystem/transformations/dbt/
• https://dlthub.com/docs/build-a-pipeline-tutorial

Homework 3: Data Warehousing

Score: 11 = 8 (questions) + 0 (FAQ) + 3 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://cloud.google.com/bigquery/docs/storage_overview
• https://cloud.google.com/blog/products/data-analytics/new-bigquery-partitioning-and-clustering-recommendations
• https://docs.rivery.io/docs/partitioning-and-clustering-in-bigquery

Homework 4: Analytics Engineering

Score: 10 = 8 (questions) + 0 (FAQ) + 2 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://docs.getdbt.com/docs/build/projects
• https://docs.getdbt.com/docs/build/sql-models

Homework 5: Batch

Score: 9 = 6 (questions) + 0 (FAQ) + 3 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://myapollo.com.tw/blog/pyspark-1/#google_vignette
• https://www.kaggle.com/code/tirendazacademy/data-manipulation-with-pyspark
• https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.RDD.mapPartitions.html

Homework 6: Streaming

Score: 7 = 6 (questions) + 0 (FAQ) + 1 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/tableapi/