Homework 5: Monitoring

Instructions
Deadline: 20 July 2026 (Mon), 23:00
Shown in your timezone.
Log in to submit this homework

You can preview the questions, but submissions are saved only for logged-in students.

Log in to submit
The deadline has passed, but this homework is still open

You can still submit your answers below. Submissions are accepted until the homework is closed for scoring.

Questions

1. How many spans does the trace produce? (1 point)

2. How many input tokens do we see for the LLM call? (1 point)

3. For a typical query, roughly how long does the LLM call take? (1 point)

4. Which span names appear in the spans table? (1 point)

5. Excluding the rag span, which span type takes the most total time? (1 point)

6. How much do the input tokens vary across 4 runs of the same query? (1 point)