Some benchmarks had errors
After merging your PR, Conbench analyzed the 3 benchmarking runs that have been run so far on merge-commit 1b3caf6.
Benchmarks with errors
These are errors that were caught while running the benchmarks. You can click each link to go to the Conbench entry for that benchmark, which might have more information about what the error was.
-
Commit Run on
arm64-t4g-2xlarge-linux
at 2024-12-07 16:34:43Ztpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-07, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-09, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-15, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-17, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-14, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-12, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-18, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-13, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-13, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-01, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-22, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-18, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-05, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-19, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-20, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-16, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-01, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-12, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-10, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-07, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-22, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-20, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-02, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-09, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-17, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-06, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-03, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-08, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-04, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-16, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-03, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-06, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-11, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-19, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-14, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-10, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-08, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-15, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-21, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-04, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-21, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-11, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-05, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-02, scale_factor=1
-
Commit Run on
amd64-m5-4xlarge-linux
at 2024-12-07 16:31:19Ztpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-22, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-22, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-04, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-12, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-20, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-12, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-08, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-05, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-09, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-05, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-21, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-08, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-06, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-13, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-20, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-19, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-04, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-09, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-09, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-12, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-10, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-17, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-02, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-10, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-10, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-07, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-08, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-03, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-14, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-15, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-11, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-01, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-06, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-22, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-17, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-04, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-17, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-16, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-13, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-13, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-02, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-06, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-06, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-19, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-18, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-16, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-13, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-03, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-11, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-11, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-14, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-16, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-22, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-18, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-12, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-21, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-07, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-10, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-17, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-21, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-02, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-21, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-01, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-05, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-03, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-01, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-18, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-07, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-09, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-14, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-15, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-08, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-11, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-07, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-01, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-16, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-18, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-15, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-14, scale_factor=10tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-02, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-19, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-04, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-20, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-19, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-03, scale_factor=1tpch
(R) with engine=arrow, format=parquet, language=R, memory_map=False, query_id=TPCH-20, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-15, scale_factor=10tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-05, scale_factor=10
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
amd64-c6a-4xlarge-linux
at 2024-12-07 16:16:16Z - Commit Run on
arm64-t4g-2xlarge-linux
at 2024-12-07 16:34:43Z - Commit Run on
amd64-m5-4xlarge-linux
at 2024-12-07 16:31:19Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
- Commit Run on
amd64-c6a-4xlarge-linux
at 2024-12-07 16:16:16ZReferenceStreamingCompression
(C++) with params=Compression::ZSTD, source=cpp-micro, suite=arrow-compression-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.