LLM Zoomcamp 2024

Homework 4: Evaluation and monitoring Statistics

Distribution of scores and reported study time for this homework.

Submissions

288

Median total score

6

Average total score

6

Score distribution

All values are points.

Questions score

Min
1
Median
6.0
Max
6
Q1
6.0
Avg
5.6
Q3
6.0

Learning in public score

Min
-
Median
0.0
Max
7
Q1
0.0
Avg
0.7
Q3
0.0

Total score

Min
1
Median
6.0
Max
14
Q1
6.0
Avg
6.4
Q3
6.0

Time distribution

All values are hours reported by students.

Lectures

Min
0.0
Median
4.0
Max
48.0
Q1
3.0
Avg
6.1
Q3
6.0

Homework

Min
0.0
Median
2.0
Max
40.0
Q1
1.0
Avg
2.3
Q3
3.0

Question breakdown

Correctness and answer distribution per question.

1. Embedding first value

278 / 288 correct (96.5%)

1 -0.42 278 (96.5%)
2 -0.22 4 (1.4%)
3 -0.02 4 (1.4%)
4 0.21 2 (0.7%)

2. Dot product: 75 percentile

276 / 288 correct (95.8%)

1 21.67 5 (1.7%)
2 31.67 276 (95.8%)
3 41.67 4 (1.4%)
4 51.67 3 (1.0%)

3. Cosine 75 percentile

271 / 288 correct (94.1%)

1 0.63 10 (3.5%)
2 0.73 2 (0.7%)
3 0.83 271 (94.1%)
4 0.93 4 (1.4%)

4. Rouge 1 F

272 / 288 correct (94.4%)

1 0.35 3 (1.0%)
2 0.45 272 (94.4%)
3 0.55 5 (1.7%)
4 0.65 6 (2.1%)

5. Average Rouge

269 / 288 correct (93.4%)

1 0.35 269 (93.4%)
2 0.45 5 (1.7%)
3 0.55 10 (3.5%)
4 0.65 2 (0.7%)

6. Average Rouge 2

257 / 288 correct (89.2%)

1 0.10 3 (1.0%)
2 0.20 257 (89.2%)
3 0.30 20 (6.9%)
4 0.40 7 (2.4%)

Calculated: 11 October 2024, 08:34