Course Management

Homework 3: Evaluation for LLM Zoomcamp 2025

Due date: 2025-07-28T23:00:00+00:00 (local time)

Please log in to access this homework.

Question 1. Hitrate for minsearch text (1 point)

0.64

0.74

0.84

0.94

Question 2. MRR Vector search (question field) (1 point)

0.25

0.35

0.45

0.55

Question 3. Hitrate Vector search (question + text fields) (1 point)

0.62

0.72

0.82

0.92

Question 4. MRR Qdrant (1 point)

0.65

0.75

0.85

0.95

Question 5. Average cosine (1 point)

0.64

0.74

0.84

0.94

Question 6. Average Rouge-1 F1 (1 point)

0.25

0.35

0.45

0.55

Homework URL

Please provide a valid URL.

Learning in public links (optional)

Time spent on lectures (hours) (optional)

Time spent on homework (hours) (optional)

FAQ contribution (FAQ document, optional)

Please log in to access this homework.

Status: Not submitted