Data Engineering Zoomcamp 2024

Data Engineering Zoomcamp 2024 Dashboard

Course-level participation, homework, and project statistics.

View Leaderboard

Course overview

Total enrollments: 2048
Project submissions: 397
Project completion rate: 18.3%
Average total score: 20.5
Median total score: 7
Overall completion rate: 26.4%

Project outcomes

Score to pass: 0
Passed: 360
Failed: 37
Median project score: 33

View All Project Submissions

Homework statistics

Median time and score by homework. Hover values on desktop for interquartile ranges.

Homework	Submissions	Completion	Lecture time	Homework time	Total time	Median score
Homework 1: Pre-Requisites (Docker, Terraform, SQL)	1198	58.5%	7h	3h	11h	7
Homework 2: Mage	844	41.2%	5h	3h	8h	6
Workshop 1: Data Ingestion	608	29.7%	2h	1.5h	4h	4
Homework 3: Data Warehouse	719	35.1%	3h	2h	6h	7
Homework 4: Analytics Engineering	507	24.8%	6h	4h	11.5h	5
Homework 5: Batch processing	446	21.8%	6h	2h	9h	6
Workshop 2: Streaming with SQL	245	12.0%	3h	2h	6h	3
Homework 6: Streaming	199	9.7%	6h	4h	9.5h	7
Public Leaderboard	102	5.0%	-	-	-	-

Homework 1: Pre-Requisites (Docker, Terraform, SQL)

Submissions: 1198
Completion: 58.5%
Median score: 7
Lecture time: 7h
Homework time: 3h
Total time: 11h

Homework 2: Mage

Submissions: 844
Completion: 41.2%
Median score: 6
Lecture time: 5h
Homework time: 3h
Total time: 8h

Workshop 1: Data Ingestion

Submissions: 608
Completion: 29.7%
Median score: 4
Lecture time: 2h
Homework time: 1.5h
Total time: 4h

Homework 3: Data Warehouse

Submissions: 719
Completion: 35.1%
Median score: 7
Lecture time: 3h
Homework time: 2h
Total time: 6h

Homework 4: Analytics Engineering

Submissions: 507
Completion: 24.8%
Median score: 5
Lecture time: 6h
Homework time: 4h
Total time: 11.5h

Homework 5: Batch processing

Submissions: 446
Completion: 21.8%
Median score: 6
Lecture time: 6h
Homework time: 2h
Total time: 9h

Workshop 2: Streaming with SQL

Submissions: 245
Completion: 12.0%
Median score: 3
Lecture time: 3h
Homework time: 2h
Total time: 6h

Homework 6: Streaming

Submissions: 199
Completion: 9.7%
Median score: 7
Lecture time: 6h
Homework time: 4h
Total time: 9.5h

Public Leaderboard

Submissions: 102
Completion: 5.0%
Median score: -
Lecture time: -
Homework time: -
Total time: -

Assignment difficulty

Ranked by lowest median question score relative to the maximum achievable. Normalizing by question count makes homeworks of different lengths comparable; a lower percentage indicates a harder assignment.

Rank	Homework	Median score	Score %	Completion
1	Homework 4: Analytics Engineering	5 / 6	83.3%	24.8%
2	Homework 1: Pre-Requisites (Docker, Terraform, SQL)	7 / 7	100.0%	58.5%
3	Homework 2: Mage	6 / 6	100.0%	41.2%
4	Homework 3: Data Warehouse	7 / 7	100.0%	35.1%
5	Workshop 1: Data Ingestion	4 / 4	100.0%	29.7%
6	Homework 5: Batch processing	6 / 6	100.0%	21.8%
7	Workshop 2: Streaming with SQL	3 / 3	100.0%	12.0%
8	Homework 6: Streaming	7 / 7	100.0%	9.7%

Question difficulty

Share of submitted answers that were correct, per question. A lower percentage points to a harder or more confusing question. Participation-only questions are excluded.

Homework	Question	Correct	Answers	% correct
Homework 1: Pre-Requisites (Docker, Terraform, SQL)	Docker tags	1173	1198	97.9%
	Docker run: version of wheel	1139	1198	95.1%
	Count records	1009	1198	84.2%
	Largest trip for each day	1103	1198	92.1%
	Three biggest pickups	1061	1198	88.6%
	Largest tip	1036	1198	86.5%
Homework 2: Mage	Data Loading	822	844	97.4%
	Data Transformation	816	844	96.7%
	Data Transformation	834	844	98.8%
	Data Transformation	824	844	97.6%
	Data Transformation	806	844	95.5%
	Data Exporting	773	844	91.6%
Workshop 1: Data Ingestion	What is the sum of the outputs of the generator for limit = 5?	599	608	98.5%
	What is the 13th number yielded by the generator?	595	608	97.9%
Homework 3: Data Warehouse	What is count of records for the 2022 Green Taxi Data?	697	719	96.9%
	What is the estimated amount of data in the tables?	653	719	90.8%
	How many records have a fare_amount of 0?	697	719	96.9%
	What is the best strategy to make an optimized table in Big Query?	682	719	94.9%
	What's the size of the tables?	649	719	90.3%
	Where is the data stored in the External Table you created?	678	719	94.3%
	It is best practice in Big Query to always cluster your data	568	719	79.0%
Homework 4: Analytics Engineering	Dbt build	306	507	60.4%
	Code for the CI job	334	507	65.9%
	Count of records in fhv trips	383	507	75.5%
	Service with the most rides	401	507	79.1%
Homework 5: Batch processing	FHV October 2019 partition size	412	446	92.4%
	Count records on 15th of October	433	446	97.1%
	The longest trip	412	446	92.4%
	Spark UI port	436	446	97.8%
	Least frequent pickup location zone	421	446	94.4%
Workshop 2: Streaming with SQL	Highest average trip time	224	245	91.4%
	Number of trips	213	245	86.9%
	Top 3 busiest zones	218	245	89.0%
Homework 6: Streaming	Connecting to the Kafka server	192	199	96.5%
	Sending data to the stream	151	199	75.9%
Public Leaderboard	Update the certificate name ("Edit course profile" button) - we will use it for the public leaderboard	0	102	0.0%
	What's your GitHub?	0	102	0.0%
	Your LinkedIn	0	102	0.0%
	Do you want to include the link to your project(s) in the public leaderboard?	0	102	0.0%
	Any comment you want to publicly write?	0	102	0.0%
	I realize that this is my last chance to update the certificate name and that we will not regenerate certificates afterwards	0	102	0.0%

Submission timing

When homework submissions arrive relative to the deadline, across all assignments.

A week or more early: 969 (19.9%)
3-7 days early: 660 (13.6%)
1-3 days early: 610 (12.5%)
Final day: 358 (7.4%)
After the deadline: 2271 (46.7%)

Engagement over time

Homework submissions per week, across all assignments. Bars are scaled to the busiest week.

Jan 29, 2024: 1198
Feb 05, 2024: 1300
Feb 12, 2024: 820
Feb 19, 2024: 508
Feb 26, 2024: 249
Mar 04, 2024: 326
Mar 11, 2024: 171
Mar 18, 2024: 75
Mar 25, 2024: 25
Apr 01, 2024: 38
Apr 08, 2024: 56
Apr 29, 2024: 77
May 06, 2024: 16
May 13, 2024: 6
May 20, 2024: 3