LLM Zoomcamp 2025

Homework 3: Evaluation Statistics

Distribution of scores and reported study time for this homework.

Submissions

191

Median total score

Average total score

Score distribution

All values are points.

Metric	Min	Q1	Median	Average	Q3	Max
Questions score	1	5.0	6.0	5.2	6.0	6
Learning in public score	-	0.0	0.0	0.6	0.0	7
Total score	1	5.0	6.0	5.9	6.0	14

Questions score

Min: 1
Median: 6.0
Max: 6
Q1: 5.0
Avg: 5.2
Q3: 6.0

Learning in public score

Min: -
Median: 0.0
Max: 7
Q1: 0.0
Avg: 0.6
Q3: 0.0

Total score

Min: 1
Median: 6.0
Max: 14
Q1: 5.0
Avg: 5.9
Q3: 6.0

Time distribution

All values are hours reported by students.

Metric	Min	Q1	Median	Average	Q3	Max
Lectures	0.0	3.0	4.0	7.2	8.0	72.0
Homework	1.0	2.0	3.3	5.3	5.0	48.0

Lectures

Min: 0.0
Median: 4.0
Max: 72.0
Q1: 3.0
Avg: 7.2
Q3: 8.0

Homework

Min: 1.0
Median: 3.3
Max: 48.0
Q1: 2.0
Avg: 5.3
Q3: 5.0

Question breakdown

Correctness and answer distribution per question.

1. Hitrate for minsearch text

176 / 191 correct (92.1%)

1 0.64 7 (3.7%)

2 0.74 4 (2.1%)

3 0.84 176 (92.1%)

4 0.94 4 (2.1%)

2. MRR Vector search (question field)

164 / 191 correct (85.9%)

1 0.25 13 (6.8%)

2 0.35 164 (85.9%)

3 0.45 10 (5.2%)

4 0.55 4 (2.1%)

3. Hitrate Vector search (question + text fields)

167 / 191 correct (87.4%)

1 0.62 6 (3.1%)

2 0.72 9 (4.7%)

3 0.82 167 (87.4%)

4 0.92 8 (4.2%)

4. MRR Qdrant

149 / 191 correct (78.0%)

1 0.65 16 (8.4%)

2 0.75 15 (7.9%)

3 0.85 149 (78.0%)

4 0.95 8 (4.2%)

5. Average cosine

173 / 191 correct (90.6%)

1 0.64 4 (2.1%)

2 0.74 12 (6.3%)

3 0.84 173 (90.6%)

4 0.94 0 (0.0%)

6. Average Rouge-1 F1

171 / 191 correct (89.5%)

1 0.25 2 (1.0%)

2 0.35 171 (89.5%)

3 0.45 14 (7.3%)

4 0.55 2 (1.0%)

Calculated: 12 September 2025, 19:19