conbench-apache-arrow / Conbench performance report
succeeded
Jul 10, 2024 in 0s
Found 0 regressions
After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit 3b7ad9d.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
test-mac-arm
at 2024-07-10 11:46:49Z - Commit Run on
ec2-c6a-4xlarge-us-east-2
at 2024-07-10 12:09:25Z - Commit Run on
ec2-m5-4xlarge-us-east-2
at 2024-07-10 12:21:48Z - Commit Run on
arm64-t4g-linux-compute
at 2024-07-10 12:39:03Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
ec2-c6a-4xlarge-us-east-2
at 2024-07-10 12:09:25ZConstructFromEmptyStdVector
(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBinaryJoinElementWiseArrayArray
(C++) with params=2, source=cpp-micro, suite=arrow-compute-scalar-string-benchmarkMoveShortVector
(C++) with params=<STD_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_ArrowBinaryPlain
(C++) with params=EncodeLowLevel/262144, source=cpp-micro, suite=parquet-encoding-benchmarkCopyEmptyVector
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkShortVectorInsert
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_DictDecodingByteArray
(C++) with params=max-string-length:8/batch-size:2048, source=cpp-micro, suite=parquet-encoding-benchmarkBM_PlainEncodingByteArray
(C++) with params=max-string-length:8/batch-size:512, source=cpp-micro, suite=parquet-encoding-benchmarkCopyShortVector
(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_DictDecodingByteArray
(C++) with params=max-string-length:8/batch-size:512, source=cpp-micro, suite=parquet-encoding-benchmarkHashIntegers
(C++) with source=cpp-micro, suite=arrow-hashing-benchmarkBM_ArrowBinaryPlain
(C++) with params=EncodeArrow/262144, source=cpp-micro, suite=parquet-encoding-benchmarkBitRunReaderLinear
(C++) with params=0, source=cpp-micro, suite=arrow-bit-util-benchmarkBM_PlainEncodingByteArray
(C++) with params=max-string-length:8/batch-size:2048, source=cpp-micro, suite=parquet-encoding-benchmarkBitRunReader
(C++) with params=-1, source=cpp-micro, suite=arrow-bit-util-benchmarkMoveShortVector
(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBitRunReaderLinear
(C++) with params=60, source=cpp-micro, suite=arrow-bit-util-benchmarkBM_DeltaDecodingByteArray
(C++) with params=max-string-length:64/batch-size:2048/prefixed-percent:99, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DictDecodingByteArray
(C++) with params=max-string-length:64/batch-size:2048, source=cpp-micro, suite=parquet-encoding-benchmarkBitRunReaderLinear
(C++) with params=50, source=cpp-micro, suite=arrow-bit-util-benchmarkConstructFromShortStdVector
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBitRunReaderLinear
(C++) with params=75, source=cpp-micro, suite=arrow-bit-util-benchmarkBinaryJoinArrayArray
(C++) with source=cpp-micro, suite=arrow-compute-scalar-string-benchmarkCopyEmptyVector
(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBitRunReaderLinear
(C++) with params=-1, source=cpp-micro, suite=arrow-bit-util-benchmarkBM_PlainEncodingByteArray
(C++) with params=max-string-length:64/batch-size:512, source=cpp-micro, suite=parquet-encoding-benchmarkConstructFromEmptyStdVector
(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveEmptyVector
(C++) with params=<STD_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveEmptyVector
(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_ArrowBinaryPlain
(C++) with params=EncodeArrow/1048576, source=cpp-micro, suite=parquet-encoding-benchmarkLongVectorPushBack
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyEmptyVector
(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkValidateTinyAscii
(C++) with source=cpp-micro, suite=arrow-utf8-util-benchmarkConstructFromEmptyStdVector
(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBitRunReaderLinear
(C++) with params=25, source=cpp-micro, suite=arrow-bit-util-benchmarkMoveEmptyVector
(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_DeltaEncodingByteArray
(C++) with params=max-string-length:8/batch-size:2048/prefixed-percent:90, source=cpp-micro, suite=parquet-encoding-benchmarkErrorSchemeNoErrorNoInline
(C++) with source=cpp-micro, suite=arrow-type-benchmarkBM_ComputeHash
(C++) with params=, source=cpp-micro, suite=parquet-bloom-filter-benchmarkBM_DictDecodingByteArray
(C++) with params=max-string-length:64/batch-size:512, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DeltaDecodingByteArray
(C++) with params=max-string-length:64/batch-size:512/prefixed-percent:99, source=cpp-micro, suite=parquet-encoding-benchmark
-
Commit Run on
ec2-m5-4xlarge-us-east-2
at 2024-07-10 12:21:48ZConstructFromEmptyStdVector
(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBitRunReaderLinear
(C++) with params=99, source=cpp-micro, suite=arrow-bit-util-benchmarkMoveShortVector
(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromEmptyStdVector
(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBitRunReaderLinear
(C++) with params=0, source=cpp-micro, suite=arrow-bit-util-benchmarkReferenceNaiveBitmapWriter
(C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading