Homework 1: Agentic RAG
- Submissions
- 628
- Completion
- 45.0%
- Median score
- 6
- Lecture time
- 5h
- Homework time
- 3h
- Total time
- 8h
LLM Zoomcamp 2026
LLM Zoomcamp 2026 Dashboard
Course-level participation, homework, and project statistics.
Course overview
- Total enrollments
- 1395
- Project submissions
- 0
- Project completion rate
- 0.0%
- Average total score
- 5.0
- Overall completion rate
- 20.3%
Project outcomes
- Score to pass
- 11
- Passed
- 0
- Failed
- 0
- Median project score
- -
Homework statistics
Median time and score by homework. Hover values on desktop for interquartile ranges.
| Homework | Submissions | Completion | Lecture time | Homework time | Total time | Median score |
|---|---|---|---|---|---|---|
| Homework 1: Agentic RAG | 628 | 45.0% | 5h | 3h | 8h | 6 |
| Homework 2: Vector Search | 505 | 36.2% | 5h | 2h | 7.8h | 6 |
| Homework 3: Orchestration | 431 | 30.9% | 3h | 1.5h | 5h | - |
| Homework 4: Evaluation | 135 | 9.7% | 4h | 3h | 8h | - |
| Homework 5: Monitoring | 0 | 0.0% | - | - | - | - |
| dlt Workshop | 0 | 0.0% | - | - | - | - |
Homework 2: Vector Search
- Submissions
- 505
- Completion
- 36.2%
- Median score
- 6
- Lecture time
- 5h
- Homework time
- 2h
- Total time
- 7.8h
Homework 3: Orchestration
- Submissions
- 431
- Completion
- 30.9%
- Median score
- -
- Lecture time
- 3h
- Homework time
- 1.5h
- Total time
- 5h
Homework 4: Evaluation
- Submissions
- 135
- Completion
- 9.7%
- Median score
- -
- Lecture time
- 4h
- Homework time
- 3h
- Total time
- 8h
Homework 5: Monitoring
- Submissions
- 0
- Completion
- 0.0%
- Median score
- -
- Lecture time
- -
- Homework time
- -
- Total time
- -
dlt Workshop
- Submissions
- 0
- Completion
- 0.0%
- Median score
- -
- Lecture time
- -
- Homework time
- -
- Total time
- -
Assignment difficulty
Ranked by lowest median question score relative to the maximum achievable. Normalizing by question count makes homeworks of different lengths comparable; a lower percentage indicates a harder assignment.
| Rank | Homework | Median score | Score % | Completion |
|---|---|---|---|---|
| 1 | Homework 3: Orchestration | 0 / 6 | 0.0% | 30.9% |
| 2 | Homework 4: Evaluation | 0 / 6 | 0.0% | 9.7% |
| 3 | Homework 1: Agentic RAG | 6 / 6 | 100.0% | 45.0% |
| 4 | Homework 2: Vector Search | 6 / 6 | 100.0% | 36.2% |
Question difficulty
Share of submitted answers that were correct, per question. A lower percentage points to a harder or more confusing question. Participation-only questions are excluded.
| Homework | Question | Correct | Answers | % correct |
|---|---|---|---|---|
| Homework 1: Agentic RAG | How many lesson pages | 608 | 628 | 96.8% |
| Indexing and searching | 597 | 628 | 95.1% | |
| RAG | 578 | 628 | 92.0% | |
| Chunking | 598 | 628 | 95.2% | |
| RAG with chunking | 536 | 628 | 85.4% | |
| Turning it into an agent | 552 | 628 | 87.9% | |
| Homework 2: Vector Search | Embedding a query | 492 | 505 | 97.4% |
| Cosine similarity | 484 | 505 | 95.8% | |
| Chunking and search by hand | 484 | 505 | 95.8% | |
| Vector search with minsearch | 477 | 505 | 94.5% | |
| Text search vs vector search | 452 | 505 | 89.5% | |
| Hybrid search | 447 | 505 | 88.5% | |
| Homework 3: Orchestration | After trying the same prompt in ChatGPT vs Kestra AI Copilot, what is the primary reason AI Copilot generates better Kestra flows? | 0 | 431 | 0.0% |
| The non-RAG response about Kestra 1.1 features is best described as: | 0 | 431 | 0.0% | |
| What is the approximate output token count for multilingual_agent when running with summary_length = short? | 0 | 431 | 0.0% | |
| With summary_length = long, roughly how many times more output tokens does multilingual_agent use compared to the short summary? | 0 | 431 | 0.0% | |
| After changing english_brevity to ask for 3 sentences instead of 1, how does the output token count compare to the original 1-sentence version? | 0 | 431 | 0.0% | |
| For production workflows requiring deterministic, repeatable results with strict compliance requirements, which approach is most appropriate? | 0 | 431 | 0.0% | |
| Homework 4: Evaluation | When generating questions for the first 3 lesson pages, what is the average number of input tokens across these 3 calls? | 0 | 135 | 0.0% |
| After running text_search for the first ground truth question, what is the filename of the first result? | 0 | 135 | 0.0% | |
| After running vector_search for the same question, what is the filename of the first result? | 0 | 135 | 0.0% | |
| After evaluating text_search on the ground truth, what is the Hit Rate? | 0 | 135 | 0.0% | |
| After evaluating vector_search on the ground truth, what is the MRR? | 0 | 135 | 0.0% | |
| When evaluating hybrid_search for k values 1, 50, 100, and 200, which k gives the best MRR? | 0 | 135 | 0.0% |
Submission timing
When homework submissions arrive relative to the deadline, across all assignments.
- A week or more early
- 186 (10.9%)
- 3-7 days early
- 307 (18.1%)
- 1-3 days early
- 335 (19.7%)
- Final day
- 634 (37.3%)
- After the deadline
- 237 (13.9%)
Engagement over time
Homework submissions per week, across all assignments. Bars are scaled to the busiest week.
- Jun 01, 2026
- 1
- Jun 08, 2026
- 61
- Jun 15, 2026
- 231
- Jun 22, 2026
- 569
- Jun 29, 2026
- 519
- Jul 06, 2026
- 318