Data Engineering Zoomcamp 2025

Homework 5: Batch Statistics

Distribution of scores and reported study time for this homework.

Submissions

408

Median total score

6

Average total score

7

Score distribution

All values are points.

Questions score

Min
2
Median
6.0
Max
6
Q1
6.0
Avg
5.7
Q3
6.0

Learning in public score

Min
-
Median
0.0
Max
7
Q1
0.0
Avg
0.7
Q3
0.0

Total score

Min
2
Median
6.0
Max
14
Q1
6.0
Avg
6.5
Q3
6.0

Time distribution

All values are hours reported by students.

Lectures

Min
0.0
Median
6.0
Max
72.0
Q1
4.0
Avg
9.3
Q3
10.0

Homework

Min
0.0
Median
2.0
Max
25.0
Q1
1.1
Avg
3.5
Q3
4.0

Question breakdown

Correctness and answer distribution per question.

1. PySpark version

408 / 408 correct (100.0%)

Answer Count
3.5.5 128
3.3.2 120
3.5.4 66
3.4.4 11
3.5.0 10
3.5.1 7
'3.5.5' 7
'3.3.2' 5
'3.5.4' 4
3.0.3 4
3.3.1 3
3.4.2 2
'3.4.4' 2
PySpark3.3.2 2
3.5.3 2
3.4.0 2
3.1.2 1
3.2.3 1
Spark 3.5.4 1
The version of my pyspark is : 3.5.3 1
3.3.5 1
'3.5.3' 1
Spark version: 3.3.2 1
3.1.3 1
'3.5.1' 1
String = 3.5.5 1
4.0.0-preview2 1
v3.5.3 1
<module 'pyspark.version' from '/home/cmurp/spark/spark-3.3.2-bin-hadoop3/python/pyspark/version.py'> 1
'3.5.2' 1
3.3.0 1
3.5.2 1
3.4.1 1
3.5.5. 1
v3.3.2 1
3.2.2 1
3.5.5' 1
(From Video) Spark version 3.0.3 (Personal Setup) The current spark version is 3.5.0 1
11 1
3.3.2 (from the guide), I had some issues with it so I have spark-3.5.5-bin-hadoop3 (3.5.5 for me) 1
PySpark version: 3.5.5 | Spark version: 3.4.4 1

2. Size of partition

381 / 408 correct (93.4%)

1 6MB 11 (2.7%)
2 25MB 381 (93.4%)
3 75MB 4 (1.0%)
4 100MB 12 (2.9%)

3. Number of trips

388 / 408 correct (95.1%)

1 85,567 6 (1.5%)
2 105,567 10 (2.5%)
3 125,567 388 (95.1%)
4 145,567 4 (1.0%)

4. Longest trip

384 / 408 correct (94.1%)

1 122 5 (1.2%)
2 142 9 (2.2%)
3 162 384 (94.1%)
4 182 8 (2.0%)

5. User Interface

391 / 408 correct (95.8%)

1 80 2 (0.5%)
2 443 3 (0.7%)
3 4040 391 (95.8%)
4 8080 8 (2.0%)

6. Least frequent pickup location zone

379 / 408 correct (92.9%)

1 Governor's Island/Ellis Island/Liberty Island 379 (92.9%)
2 Arden Heights 6 (1.5%)
3 Rikers Island 14 (3.4%)
4 Jamaica Bay 9 (2.2%)

Calculated: 25 March 2025, 13:54