Homework 1: Introduction
- Submissions
- 831
- Completion
- 66.4%
- Median score
- 6
- Lecture time
- 2h
- Homework time
- 2h
- Total time
- 4h
MLOps Zoomcamp 2024
MLOps Zoomcamp 2024 Dashboard
Course-level participation, homework, and project statistics.
Course overview
- Total enrollments
- 1251
- Project submissions
- 171
- Project completion rate
- 12.3%
- Average total score
- 15.8
- Median total score
- 7
- Overall completion rate
- 32.5%
- Graduates
- 134
Project outcomes
- Score to pass
- 0
- Passed
- 138
- Failed
- 33
- Median project score
- 31
Homework statistics
Median time and score by homework. Hover values on desktop for interquartile ranges.
| Homework | Submissions | Completion | Lecture time | Homework time | Total time | Median score |
|---|---|---|---|---|---|---|
| Homework 1: Introduction | 831 | 66.4% | 2h | 2h | 4h | 6 |
| Homework 2: Experiment Tracking | 589 | 47.1% | 4h | 3h | 7h | 6 |
| Homework 3: Training Pipelines | 308 | 24.6% | 5h | 4h | 10h | 6 |
| Homework 4: Deployment | 298 | 23.8% | 4h | 3h | 7h | 6 |
| Homework 5: Monitoring | 253 | 20.2% | 4h | 3h | 8h | 6 |
| Homework 6: Best Practices | 158 | 12.6% | 5h | 4h | 9h | 6 |
Homework 2: Experiment Tracking
- Submissions
- 589
- Completion
- 47.1%
- Median score
- 6
- Lecture time
- 4h
- Homework time
- 3h
- Total time
- 7h
Homework 3: Training Pipelines
- Submissions
- 308
- Completion
- 24.6%
- Median score
- 6
- Lecture time
- 5h
- Homework time
- 4h
- Total time
- 10h
Homework 4: Deployment
- Submissions
- 298
- Completion
- 23.8%
- Median score
- 6
- Lecture time
- 4h
- Homework time
- 3h
- Total time
- 7h
Homework 5: Monitoring
- Submissions
- 253
- Completion
- 20.2%
- Median score
- 6
- Lecture time
- 4h
- Homework time
- 3h
- Total time
- 8h
Homework 6: Best Practices
- Submissions
- 158
- Completion
- 12.6%
- Median score
- 6
- Lecture time
- 5h
- Homework time
- 4h
- Total time
- 9h
Assignment difficulty
Ranked by lowest median question score relative to the maximum achievable. Normalizing by question count makes homeworks of different lengths comparable; a lower percentage indicates a harder assignment.
| Rank | Homework | Median score | Score % | Completion |
|---|---|---|---|---|
| 1 | Homework 1: Introduction | 6 / 6 | 100.0% | 66.4% |
| 2 | Homework 2: Experiment Tracking | 6 / 6 | 100.0% | 47.1% |
| 3 | Homework 3: Training Pipelines | 6 / 6 | 100.0% | 24.6% |
| 4 | Homework 4: Deployment | 6 / 6 | 100.0% | 23.8% |
| 5 | Homework 5: Monitoring | 6 / 6 | 100.0% | 20.2% |
| 6 | Homework 6: Best Practices | 6 / 6 | 100.0% | 12.6% |
Question difficulty
Share of submitted answers that were correct, per question. A lower percentage points to a harder or more confusing question. Participation-only questions are excluded.
| Homework | Question | Correct | Answers | % correct |
|---|---|---|---|---|
| Homework 1: Introduction | Downloading the data | 812 | 831 | 97.7% |
| Computing duration | 773 | 831 | 93.0% | |
| Dropping outliers | 805 | 831 | 96.9% | |
| One-hot encoding | 759 | 831 | 91.3% | |
| Training a model. RMSE on train | 772 | 831 | 92.9% | |
| Evaluating the model. RMSE on validation | 669 | 831 | 80.5% | |
| Homework 2: Experiment Tracking | Download and preprocess the data | 570 | 589 | 96.8% |
| Train a model with autolog | 541 | 589 | 91.9% | |
| Launch the tracking server locally | 490 | 589 | 83.2% | |
| Tune model hyperparameters | 538 | 589 | 91.3% | |
| Promote the best model to the model registry | 501 | 589 | 85.1% | |
| Homework 3: Training Pipelines | Creating a project | 285 | 308 | 92.5% |
| Creating a pipeline | 289 | 308 | 93.8% | |
| Data preparation | 287 | 308 | 93.2% | |
| Train a model | 252 | 308 | 81.8% | |
| MLFlow | 201 | 308 | 65.3% | |
| Homework 4: Deployment | Notebook | 285 | 298 | 95.6% |
| Preparing the output | 272 | 298 | 91.3% | |
| Parametrize the script | 268 | 298 | 89.9% | |
| Docker container | 196 | 298 | 65.8% | |
| Homework 5: Monitoring | Prepare the dataset | 241 | 253 | 95.3% |
| Monitoring | 212 | 253 | 83.8% | |
| Dashboard | 201 | 253 | 79.4% | |
| Homework 6: Best Practices | Writing first unit test | 125 | 158 | 79.1% |
| Mocking S3 with Localstack | 146 | 158 | 92.4% | |
| Creating test data | 133 | 158 | 84.2% | |
| Finish the integration test | 120 | 158 | 75.9% |
Submission timing
When homework submissions arrive relative to the deadline, across all assignments.
- A week or more early
- 259 (10.6%)
- 3-7 days early
- 782 (32.1%)
- 1-3 days early
- 534 (21.9%)
- Final day
- 441 (18.1%)
- After the deadline
- 421 (17.3%)
Engagement over time
Homework submissions per week, across all assignments. Bars are scaled to the busiest week.
- May 13, 2024
- 287
- May 20, 2024
- 682
- May 27, 2024
- 475
- Jun 03, 2024
- 157
- Jun 10, 2024
- 216
- Jun 17, 2024
- 271
- Jun 24, 2024
- 201
- Jul 01, 2024
- 99
- Jul 08, 2024
- 49
Graduates
134 students completed the course and received certificates.