conbench-apache-arrow / Conbench performance report
succeeded
Sep 13, 2024 in 0s
Found 0 regressions
After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit 85fc3eb.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
test-mac-arm
at 2024-09-13 03:20:01Z - Commit Run on
arm64-t4g-2xlarge-linux
at 2024-09-12 21:17:36Z - Commit Run on
amd64-c6a-4xlarge-linux
at 2024-09-12 18:01:13Z - Commit Run on
amd64-m5-4xlarge-linux
at 2024-09-12 23:26:16Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
amd64-c6a-4xlarge-linux
at 2024-09-12 18:01:13ZInt8StridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatColumnMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBinaryCompareOpConstant
(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkFloatStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkHexParsing
(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkDoubleColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkUniqueString10bytes
(C++) with params=6, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkFloatColumnMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8StridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkDoubleRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkExecuteScalarExpressionOverhead
(C++) with params=zero_copy_expression/rows_per_batch:100000/real_time/threads:16, source=cpp-micro, suite=arrow-acero-expression-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkTypeEqualsComplex
(C++) with source=cpp-micro, suite=arrow-type-benchmarkFloatColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkDoubleColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkExecuteScalarExpressionOverhead
(C++) with params=zero_copy_expression/rows_per_batch:10000/real_time/threads:16, source=cpp-micro, suite=arrow-acero-expression-benchmarkExecuteScalarExpressionOverhead
(C++) with params=zero_copy_expression/rows_per_batch:1000000/real_time/threads:16, source=cpp-micro, suite=arrow-acero-expression-benchmarkInt8ColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkMaxElementWiseArrayArrayString
(C++) with params=32768/10, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkDoubleStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkArrayArrayKernel
(C++) with params=<DivideChecked, UInt32Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkInt8RowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkDoubleStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkDoubleRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8ColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkConstants
(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkBinaryCompareOp
(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkExecuteScalarExpressionOverhead
(C++) with params=zero_copy_expression/rows_per_batch:1000/real_time/threads:16, source=cpp-micro, suite=arrow-acero-expression-benchmarkDoubleStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkMaxElementWiseArrayArrayString
(C++) with params=32768/10000, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkDoubleStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkDoubleRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkUniqueString100bytes
(C++) with params=13, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkMaxElementWiseArrayArrayString
(C++) with params=32768/100, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkUniqueString100bytes
(C++) with params=6, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkFloatStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmark
-
Commit Run on
amd64-m5-4xlarge-linux
at 2024-09-12 23:26:16ZInt8ColumnMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8StridedTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkCastUInt32ToInt32Safe
(C++) with params=1048576/2, source=cpp-micro, suite=arrow-compute-scalar-cast-benchmarkInt8StridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_ReadColumnPlain
(C++) with params=<true,Float16LogicalType>/null_probability:50, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkFloatColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8RowMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatStridedTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkWriteCsvNumericCheckQuote
(C++) with params=1, source=cpp-micro, suite=arrow-csv-writer-benchmarkBatchToTensorSimple
(C++) with params=/size:32768/num_columns:3, source=cpp-micro, suite=arrow-tensor-benchmarkInt8StridedTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkCheckIndexBoundsInt32
(C++) with params=1048576/1000, source=cpp-micro, suite=arrow-int-util-benchmarkFloatRowMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkUniqueInt64
(C++) with params=13, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkFloatStridedTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8RowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkArrayRangeEqualsStruct
(C++) with params=32768/0, source=cpp-micro, suite=arrow-compare-benchmarkBM_ReadColumnPlain
(C++) with params=<true,Float16LogicalType>/null_probability:100, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBatchToTensorSimple
(C++) with params=/size:1048576/num_columns:3, source=cpp-micro, suite=arrow-tensor-benchmarkFloatStridedTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8ColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatRowMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkConstants
(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkFloatStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatColumnMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatColumnMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkCastInt64ToInt32Safe
(C++) with params=1048576/0, source=cpp-micro, suite=arrow-compute-scalar-cast-benchmarkUniqueInt64
(C++) with params=6, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkInt8StridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_ByteStreamSplitDecode_Float_Scalar
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkInt8StridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt16, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkArrayRangeEqualsString
(C++) with params=32768/0, source=cpp-micro, suite=arrow-compare-benchmarkArrayRangeEqualsInt32
(C++) with params=32768/2, source=cpp-micro, suite=arrow-compare-benchmarkFloatStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8ColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt16, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8ColumnMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8ColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt8, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8RowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8RowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt16, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkListSliceInt64ListWithStop
(C++) with params=32768/10000, source=cpp-micro, suite=arrow-compute-scalar-list-benchmarkCheckIndexBoundsInt32
(C++) with params=32768/1000, source=cpp-micro, suite=arrow-int-util-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8ColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8RowMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkUniqueString10bytes
(C++) with params=6, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkFloatStridedTensorConversionFixture
(C++) with params=/ConvertToSparseCSFTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading