Zealous Ptolemy
Total Score: 171
Homework submissions
Homework 1: Docker, SQL and Terraform
Score: 10 = 7 (questions) + 0 (FAQ) + 3 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://www.linkedin.com/posts/mafalda-rodriguess_dataengineering-dataengineeringzoomcamp-activity-7289409794338152448-K2U2?utm_source=share&utm_medium=member_desktop
- https://www.w3schools.com/sql/sql_syntax.asp
- https://stackoverflow.com/questions/36692861/avoiding-error-from-pd-to-datetime-in-pandas
Homework 2: Workflow Orchestration
Score: 14 = 6 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://www.linkedin.com/posts/mafalda-rodriguess_dataengineering-kestra-dezoomcamp-activity-7292528091493507072-1v_F?utm_source=share&utm_medium=member_desktop&rcm=ACoAACA9Q4YBHA1LPigfCqkWsv4YZMjB_MF6WOY
- https://www.youtube.com/playlist?list=PLEK3H8YwZn1oPPShk2p5k3E9vO-gPnUCf
- https://kestra.io/docs/workflow-components/triggers/schedule-trigger
- https://docs.getdbt.com/best-practices
- https://www.w3schools.com/sql/sql_like.asp
- https://cloud.google.com/storage/docs
- https://cloud.google.com/bigquery/docs
Workshop 1: Ingestion with dlt
Score: 12 = 4 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://www.linkedin.com/posts/mafalda-rodriguess_dezoomcamp-dataengineering-dezoomcamp-activity-7296989885528236033-xQ8A?utm_source=share&utm_medium=member_desktop&rcm=ACoAACA9Q4YBHA1LPigfCqkWsv4YZMjB_MF6WOY
- https://www.youtube.com/live/pgJWP_xqO1g
- https://dlthub.com/docs/intro
- https://www.youtube.com/watch?v=Kj3EKmdD3ig
- https://dlthub.com/docs/walkthroughs/create-a-pipeline
- https://dlthub.com/docs/reference/explainers/how-dlt-works
- https://medium.com/@arjun.anand1/rest-api-ingestions-made-easy-with-dlt-d77b2bf1d50b
Homework 3: Data Warehousing
Score: 16 = 8 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://cloud.google.com/bigquery/docs/bq-command-line-tool
- https://www.youtube.com/watch?v=jrHljAoD6nM&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb&index
- https://www.linkedin.com/posts/mafalda-rodriguess_dataengineering-dezoomcamp-bigquery-activity-7295531935873835010-vAd0?utm_source=share&utm_medium=member_desktop&rcm=ACoAACA9Q4YBHA1LPigfCqkWsv4YZMjB_MF6WOY
- https://cloud.google.com/bigquery/docs/materialized-views-intro
- https://cloud.google.com/bigquery/docs/reference/standard-sql/bigqueryml-syntax-create-glm
- https://cloud.google.com/bigquery/docs/preprocess-overview
- https://hoffa.medium.com/bigquery-optimized-cluster-your-tables-65e2f684594b
Homework 4: Analytics Engineering
Score: 12 = 4 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://www.linkedin.com/posts/mafalda-rodriguess_dezoomcamp-dataengineering-dezoomcamp-activity-7300641746617536512-lbaf?utm_source=share&utm_medium=member_desktop&rcm=ACoAACA9Q4YBHA1LPigfCqkWsv4YZMjB_MF6WOY
- https://docs.getdbt.com/reference/dbt-jinja-functions/env_var
- https://www.w3schools.com/sql/
- https://www.youtube.com/watch?v=ueVy2N54lyc&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb
- https://stackoverflow.com/questions/72956095/dbt-environment-variables-and-running-dbt
- https://cloud.google.com/storage/docs
- https://cloud.google.com/bigquery/docs
Homework 5: Batch
Score: 14 = 6 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://www.youtube.com/watch?v=dcHe5Fl3MF8&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb
- https://www.w3schools.com/sql/
- https://www.youtube.com/watch?v=FhaqbEOuQ8U&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb
- https://www.youtube.com/watch?v=hqUbB9c8sKg&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb
- https://www.youtube.com/watch?v=r_Sf6fCB40c&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb
- https://www.youtube.com/watch?v=ti3aC1m3rE8&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb&index=48
- https://www.youtube.com/watch?v=uAlp2VuZZPY&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb&index=50
Homework 6: Streaming
Score: 6 = 6 (questions) + 0 (FAQ) + 0 (learning in public)
Homework URL: View submission
Project submissions
Project Attempt 2
Project score: 21 Passed
Score: 42 = 21 (project) + 9 (peer review) + 11 (learning in public / project) + 0 (learning in public / peer review) + 1 (FAQ)
Project URL: View project
Learning in public links: Show
- https://kestra.io/
- https://www.youtube.com/watch?v=Yyz293hBVcQ&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb&index=56&ab_channel=DataTalksClub%E2%AC%9B
- https://cloud.google.com/storage/docs
- https://cloud.google.com/bigquery/docs
- https://cloud.google.com/looker/docs/intro
- https://www.linkedin.com/posts/mafalda-rodriguess_dataengineering-bigquery-kestra-activity-7319117116945633281-7rbu?utm_source=share&utm_medium=member_desktop&rcm=ACoAACA9Q4YBHA1LPigfCqkWsv4YZMjB_MF6WOY
- https://www.w3schools.com/sql/
- https://www.youtube.com/watch?v=nKqjjLJ7YXs&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb&index=23&ab_channel=Kestra
- https://medium.com/@kestra-io/how-to-create-robust-data-pipeline-for-bigquery-and-google-cloud-62ed16b2c3
- https://www.youtube.com/watch?v=Q2JD3_YBaRc&t=80s&ab_channel=GoogleCloudTech
- https://x.com/rodriguesmaf/status/1913359523672395989?s=46&t=mXx-P5Oxiq8m9_yve5KqWA
Project Attempt 3
Project score: 25 Passed
Score: 45 = 25 (project) + 9 (peer review) + 11 (learning in public / project) + 0 (learning in public / peer review) + 0 (FAQ)
Project URL: View project
Learning in public links: Show
- https://kestra.io/
- https://cloud.google.com/bigquery/docs
- https://cloud.google.com/storage/docs
- https://docs.getdbt.com/docs/build/documentation
- https://developer.hashicorp.com/terraform/docs
- https://www.youtube.com/watch?v=ueVy2N54lyc&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb&index=37&ab_channel=Victoria
- https://www.youtube.com/watch?v=nKqjjLJ7YXs&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb&index=23&ab_channel=Kestra
- https://www.youtube.com/watch?v=Y2ux7gq3Z0o&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb&index=12&ab_channel=DataSlinger
- https://www.youtube.com/watch?v=ae-CV2KfoN0&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb&index=14&ab_channel=DataTalksClub%E2%AC%9B
- https://x.com/rodriguesmaf/status/1916987562100723759?s=46&t=mXx-P5Oxiq8m9_yve5KqWA
- https://cloud.google.com/looker?hl=en