================================================================================================
RDD block store-time checksum overhead
================================================================================================

OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure
AMD EPYC 9V74 80-Core Processor
64k long rows, spark.rdd.compress=false:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns) Relative time
------------------------------------------------------------------------------------------------------------------------
serialize only (feature off)                        489            491           2          0.0     2446581.1       1.0X
serialize + CRC32C checksum (feature on)            497            497           1          0.0     2484953.9       1.0X

OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure
AMD EPYC 9V74 80-Core Processor
64k long rows, spark.rdd.compress=true:   Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns) Relative time
------------------------------------------------------------------------------------------------------------------------
serialize only (feature off)                        641            646           6          0.0     3204290.4       1.0X
serialize + CRC32C checksum (feature on)            656            658           4          0.0     3278535.1       1.0X

OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure
AMD EPYC 9V74 80-Core Processor
8k x 128B records, spark.rdd.compress=false:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns) Relative time
---------------------------------------------------------------------------------------------------------------------------
serialize only (feature off)                           203            204           1          0.0     1016374.4       1.0X
serialize + CRC32C checksum (feature on)               215            215           0          0.0     1072849.1       1.1X

OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure
AMD EPYC 9V74 80-Core Processor
8k x 128B records, spark.rdd.compress=true:  Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns) Relative time
--------------------------------------------------------------------------------------------------------------------------
serialize only (feature off)                          305            306           1          0.0     1523932.2       1.0X
serialize + CRC32C checksum (feature on)              307            309           3          0.0     1533621.9       1.0X


================================================================================================
Raw checksum algorithm over 4 MiB (reference)
================================================================================================

OpenJDK 64-Bit Server VM 17.0.20+8-LTS on Linux 6.17.0-1020-azure
AMD EPYC 9V74 80-Core Processor
Checksum algorithm:                       Best Time(ms)   Avg Time(ms)   Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------------------------------
ADLER32                                             380            380           0          0.0     1484904.3       1.0X
CRC32                                                95             95           0          0.0      369944.3       4.0X
CRC32C                                               51             51           0          0.0      198061.7       7.5X


