================================================================================================
RDD block store-time checksum overhead
================================================================================================

OpenJDK 64-Bit Server VM 25.0.4+7-LTS on Linux 6.17.0-1020-azure
AMD EPYC 9V74 80-Core Processor
64k long rows, spark.rdd.compress=false:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns) Relative time
------------------------------------------------------------------------------------------------------------------------
serialize only (feature off)                        526            528           2          0.0     2630379.4       1.0X
serialize + CRC32C checksum (feature on)            535            536           1          0.0     2675305.0       1.0X

OpenJDK 64-Bit Server VM 25.0.4+7-LTS on Linux 6.17.0-1020-azure
AMD EPYC 9V74 80-Core Processor
64k long rows, spark.rdd.compress=true:   Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns) Relative time
------------------------------------------------------------------------------------------------------------------------
serialize only (feature off)                        677            679           2          0.0     3384636.6       1.0X
serialize + CRC32C checksum (feature on)            677            680           3          0.0     3384642.1       1.0X

OpenJDK 64-Bit Server VM 25.0.4+7-LTS on Linux 6.17.0-1020-azure
AMD EPYC 9V74 80-Core Processor
8k x 128B records, spark.rdd.compress=false:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns) Relative time
---------------------------------------------------------------------------------------------------------------------------
serialize only (feature off)                           201            202           1          0.0     1003481.9       1.0X
serialize + CRC32C checksum (feature on)               212            213           2          0.0     1057749.3       1.1X

OpenJDK 64-Bit Server VM 25.0.4+7-LTS on Linux 6.17.0-1020-azure
AMD EPYC 9V74 80-Core Processor
8k x 128B records, spark.rdd.compress=true:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns) Relative time
--------------------------------------------------------------------------------------------------------------------------
serialize only (feature off)                          303            304           1          0.0     1514780.6       1.0X
serialize + CRC32C checksum (feature on)              305            305           0          0.0     1522793.0       1.0X


================================================================================================
Raw checksum algorithm over 4 MiB (reference)
================================================================================================

OpenJDK 64-Bit Server VM 25.0.4+7-LTS on Linux 6.17.0-1020-azure
AMD EPYC 9V74 80-Core Processor
Checksum algorithm:                       Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
ADLER32                                             380            384           9          0.0     1485607.5       1.0X
CRC32                                                95             95           1          0.0      370285.3       4.0X
CRC32C                                               52             52           0          0.0      201622.1       7.4X


