Homework 1: Docker, SQL and Terraform

Score: 14 = 7 (questions) + 0 (FAQ) + 7 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://stackoverflow.com/questions/30494050/how-do-i-pass-environment-variables-to-docker-containers
• https://stackoverflow.com/questions/76007264/no-kernel-appearing-in-vs-code-in-jupyter-notebook
• https://stackoverflow.com/questions/8588126/sqlalchemy-or-psycopg2
• https://stackoverflow.com/questions/49127834/removing-conda-environment
• https://www.youtube.com/watch?v=l5k1ai_GBDE
• https://jhooq.com/gcp-invalid-function-argument-credential-file/
• https://stackoverflow.com/questions/348170/how-do-i-undo-git-add-before-commit

Homework 2: Workflow Orchestration

Score: 10 = 6 (questions) + 0 (FAQ) + 4 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://kestra.io/docs/how-to-guides/loop
• https://stackoverflow.com/questions/73315685/error-response-from-daemon-mkdir-c-program-files-git-opt-access-is-denied
• https://stackoverflow.com/questions/49726272/what-is-the-rm-flag-doing
• https://stackoverflow.com/questions/36765138/bind-to-docker-socket-on-windows

Workshop 1: Ingestion with dlt

Score: 7 = 4 (questions) + 1 (FAQ) + 2 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://dlthub.com/docs/dlt-ecosystem/verified-sources/sql_database/configuration
• https://dlthub.com/docs/tutorial/rest-api

Homework 3: Data Warehousing

Score: 11 = 8 (questions) + 1 (FAQ) + 2 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://stackoverflow.com/questions/13525482/how-to-check-if-file-exists-in-google-cloud-storage
• https://stackoverflow.com/questions/53743989/python-filter-function-with-none-as-filter-argument

Homework 4: Analytics Engineering

Score: 7 = 7 (questions) + 0 (FAQ) + 0 (learning in public)

Homework URL: View submission

Homework 5: Batch

Score: 10 = 6 (questions) + 0 (FAQ) + 4 (learning in public)

Homework URL: View submission

Learning in public links: Show

• https://stackoverflow.com/questions/33813815/how-to-read-a-parquet-file-into-pandas-dataframe
• https://stackoverflow.com/questions/78966390/parquet-column-cannot-be-converted-in-file-parquet-path-column-year-expect
• https://spark.apache.org/docs/latest/api/sql/index.html#date_format
• https://ghoshsoumya.substack.com/p/spark-timestamp-diff-functions