AbdulHafeez S.
About me: CAE Engineer during the day and crunching data by night.
Total Score: 168
Homework submissions
Homework 1: Docker, SQL and Terraform
Score: 12 = 6 (questions) + 1 (FAQ) + 5 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://dev.to/pizofreude/notes-on-data-engineering-zoomcamp-2025-launch-stream-4mpm
- https://dev.to/pizofreude/data-engineering-zoomcamp-2025-cohort-introduction-self-study-notes-44a4
- https://dev.to/pizofreude/study-notes-de-zoomcamp-121-introduction-to-docker-bj4
- https://dev.to/pizofreude/study-notes-de-zoomcamp-122-ingesting-ny-taxi-data-to-postgres-2h34
- https://dev.to/pizofreude/study-notes-123-connecting-pgadmin-and-postgresql-21p6
Homework 2: Workflow Orchestration
Score: 14 = 6 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://dev.to/pizofreude/study-notes-221-workflow-orchestration-with-kestra-2pap
- https://dev.to/pizofreude/study-notes-222-learning-kestra-484f
- https://dev.to/pizofreude/study-notes-223-setting-up-an-etl-pipeline-with-kestra-and-postgres-3nhc
- https://dev.to/pizofreude/study-notes-224-managing-scheduling-and-backfills-with-postgres-in-kestra-1pen
- https://dev.to/pizofreude/study-note-225-orchestrate-dbt-models-with-postgres-in-kestra-2dl9
- https://dev.to/pizofreude/study-note-226-etl-pipelines-in-kestra-on-google-cloud-platform-4e4k
- https://dev.to/pizofreude/study-notes-227-managing-schedules-and-backfills-with-bigquery-in-kestra-1hl9
Workshop 1: Ingestion with dlt
Score: 11 = 4 (questions) + 0 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://dev.to/pizofreude/study-note-dlt-fundamentals-course-lesson-1-quick-start-1jac
- https://dev.to/pizofreude/study-note-dlt-fundamentals-course-lesson-2-dlt-sources-and-resources-create-first-dlt-pipeline-2ap4
- https://dev.to/pizofreude/study-notes-dlt-fundamentals-course-lesson-3-4-pagination-authentication-dlt-configuration-3582
- https://dev.to/pizofreude/study-notes-dlt-fundamentals-course-lesson-5-6-write-disposition-incremental-loading-how-dlt-429j
- https://dev.to/pizofreude/study-notes-dlt-fundamentals-course-lesson-7-inspecting-adjusting-schema-169h
- https://dev.to/pizofreude/study-notes-dlt-fundamentals-course-lesson-8-understanding-pipeline-metadata-and-state-4ame
- https://dev.to/pizofreude/study-notes-dlt-workshop-api-warehouses-data-lakes-34k4
Homework 3: Data Warehousing
Score: 15 = 8 (questions) + 0 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://dev.to/pizofreude/study-note-de-zoomcamp-311-data-warehouse-and-bigquery-59ol
- https://dev.to/pizofreude/study-notes-312-partitioning-and-clustering-in-bigquery-oe
- https://dev.to/pizofreude/study-note-321-bigquery-best-practices-15o2
- https://dev.to/pizofreude/study-notes-322-bigquery-internal-architecture-94g
- https://dev.to/pizofreude/study-notes-331-bigquery-machine-learning-bqml-3khc
- https://dev.to/pizofreude/study-note-332-bigquery-machine-learning-model-deployment-using-docker-4ddl
- https://dev.to/pizofreude/study-notes-data-query-on-s3-bucket-using-athena-31dh
Homework 4: Analytics Engineering
Score: 15 = 7 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://dev.to/pizofreude/study-notes-411-analytics-engineering-basics-pgn
- https://dev.to/pizofreude/study-notes-412-what-is-dbt-3774
- https://dev.to/pizofreude/study-notes-421-422-dbt-project-setup-2d4d
- https://dev.to/pizofreude/study-notes-431-build-the-first-dbt-models-2nl3
- https://dev.to/pizofreude/study-notes-432-testing-and-documenting-the-project-5fjn
- https://dev.to/pizofreude/study-notes-441-442-deployment-using-dbt-cloud-and-locally-dga
- https://dev.to/pizofreude/study-notes-452-visualizing-data-with-metabase-alternative-b-2g4c
Homework 5: Batch
Score: 14 = 6 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://dev.to/pizofreude/study-notes-511-2-introduction-to-batch-processing-spark-glb
- https://dev.to/pizofreude/study-notes-531-2-first-look-at-sparkpyspark-spark-dataframes-3od4
- https://dev.to/pizofreude/study-notes-533-4-data-processing-sql-with-spark-4ljm
- https://dev.to/pizofreude/study-notes-541-3-anatomy-of-a-spark-cluster-groupby-joins-in-spark-4loj
- https://dev.to/pizofreude/study-notes-551-2-operations-on-spark-rdds-spark-rdd-mappartition-337k
- https://dev.to/pizofreude/study-notes-561-2-spark-on-cloud-local-2mnc
- https://dev.to/pizofreude/study-notes-563-4-setting-up-a-dataproc-cluster-connecting-spark-to-big-query-2pef
Homework 6: Streaming
Score: 14 = 6 (questions) + 1 (FAQ) + 7 (learning in public)
Homework URL: View submission
Learning in public links: Show
- https://dev.to/pizofreude/study-notes-61-2-introduction-to-stream-processing-ff0
- https://dev.to/pizofreude/study-notes-63-4-what-is-kafka-confluent-cloud-gfm
- https://dev.to/pizofreude/study-notes-65-6-kafka-producer-consumer-configuration-2a0l
- https://dev.to/pizofreude/study-notes-67-10-kafka-stream-basics-join-testing-windowing-5bn
- https://dev.to/pizofreude/study-notes-611-12-kafka-ksqldb-connect-schema-registry-2g9n
- https://dev.to/pizofreude/study-notes-613-14-kafka-streaming-with-python-pyspark-structured-streaming-with-kafka-1i9h
- https://dev.to/pizofreude/study-notes-615-kafka-flink-streaming-51ai
Project submissions
Project Attempt 2
Project score: 20 Failed
Score: 22 = 20 (project) + 0 (peer review) + 1 (learning in public / project) + 0 (learning in public / peer review) + 1 (FAQ)
Project URL: View project
Learning in public links: Show
Project Attempt 3
Project score: 26 Passed
Score: 51 = 26 (project) + 9 (peer review) + 9 (learning in public / project) + 6 (learning in public / peer review) + 1 (FAQ)
Project URL: View project
Learning in public links: Show
- https://dev.to/pizofreude/insightflow-part-1-building-an-integrated-retail-economic-data-pipeline-project-introduction-d74
- https://dev.to/pizofreude/insightflow-part-2-setting-up-the-cloud-infrastructure-with-terraform-368k
- https://dev.to/pizofreude/insightflow-part-3-building-the-data-ingestion-layer-with-aws-batch-4k44
- https://dev.to/pizofreude/insightflow-part-4-data-exploration-understanding-the-datasets-4hdi
- https://dev.to/pizofreude/insightflow-part-5-designing-the-data-model-schema-with-dbt-for-insightflow-3fb6
- https://dev.to/pizofreude/insightflow-part-6-implementing-etl-processes-with-aws-glue-for-insightflow-1gaj
- https://dev.to/pizofreude/insightflow-part-7-data-quality-implementation-best-practices-for-insightflow-27cp
- https://dev.to/pizofreude/insightflow-part-8-setting-up-aws-athena-for-data-analysis-in-insightflow-4aoo
- https://dev.to/pizofreude/insightflow-part-9-workflow-orchestration-with-kestra-3cge