Homework 5: Monitoring

1. How many spans does the trace produce? (1 point)

2. How many input tokens do we see for the LLM call? (1 point)

3. For a typical query, roughly how long does the LLM call take? (1 point)

4. Which span names appear in the spans table? (1 point)

5. Excluding the rag span, which span type takes the most total time? (1 point)

6. How much do the input tokens vary across 4 runs of the same query? (1 point)