Billion-Scale ANN Benchmarks, NeurIPS 2023

added gt urls, added configurable max points #877

Triggered via push November 20, 2024 16:33

magdalendobson

pushed fe7103e

users/magdalen/add_msturing_expiration_time_runbook

Status Failure

Total duration 31m 13s

Artifacts –

neurips23.yml

on: push

Matrix: build

Annotations

43 errors and 71 warnings

build (fdufilterdiskann, random-filter-s, filter): benchmark/main.py#L257

Nothing to run

build (fdufilterdiskann, random-filter-s, filter)

Process completed with exit code 1.

build (hwtl_sdu_anns_stream, random-xs, streaming)

Process completed with exit code 1.

build (dhq, random-filter-s, filter): benchmark/main.py#L257

Nothing to run

build (dhq, random-filter-s, filter)

Process completed with exit code 1.

build (mysteryann-dif, random-xs, ood)

Process completed with exit code 1.

build (mysteryann, random-xs, ood)

Process completed with exit code 1.

build (linscan, sparse-small, sparse)

Process completed with exit code 1.

build (cufe, sparse-small, sparse)

Process completed with exit code 1.

build (ngt, random-xs, ood)

Process completed with exit code 1.

build (pinecone, random-filter-s, filter)

Process completed with exit code 1.

build (cufe, random-xs, streaming)

Process completed with exit code 1.

build (diskann, random-xs, streaming)

Process completed with exit code 1.

build (cufe, random-xs, ood)

Process completed with exit code 1.

build (diskann, random-xs, ood)

Process completed with exit code 1.

build (pyanns, sparse-small, sparse): benchmark/main.py#L257

Nothing to run

build (pyanns, sparse-small, sparse)

Process completed with exit code 1.

build (sustech-whu, sparse-small, sparse): benchmark/main.py#L257

Nothing to run

build (sustech-whu, sparse-small, sparse)

Process completed with exit code 1.

build (hwtl_sdu_anns_filter, random-filter-s, filter): benchmark/main.py#L257

Nothing to run

build (hwtl_sdu_anns_filter, random-filter-s, filter)

Process completed with exit code 1.

build (parlayivf, random-filter-s, filter)

Process completed with exit code 1.

build (zilliz, random-filter-s, filter)

Process completed with exit code 1.

build (vamana, random-xs, ood)

Process completed with exit code 1.

build (pyanns, random-xs, ood): benchmark/main.py#L257

Nothing to run

build (pyanns, random-xs, ood)

Process completed with exit code 1.

build (pyanns, random-xs, streaming)

Process completed with exit code 1.

build (zilliz, random-xs, ood)

Process completed with exit code 1.

build (zilliz, sparse-small, sparse)

Process completed with exit code 1.

build (epsearch, random-xs, ood)

Process completed with exit code 1.

build (shnsw, sparse-small, sparse)

Process completed with exit code 1.

build (cufe, random-s, filter)

Process completed with exit code 1.

build (faissplus, random-filter-s, filter)

Process completed with exit code 1.

build (faiss, random-filter-s, filter)

Process completed with exit code 1.

build (puck, random-xs, ood)

Process completed with exit code 1.

build (puck, random-xs, streaming)

Process completed with exit code 1.

build (puck, random-filter-s, filter)

Process completed with exit code 1.

build (pyanns, random-filter-s, filter): benchmark/main.py#L257

Nothing to run

build (pyanns, random-filter-s, filter)

Process completed with exit code 1.

build (sustech-ood, random-xs, ood): benchmark/main.py#L257

Nothing to run

build (sustech-ood, random-xs, ood)

Process completed with exit code 1.

build (nle, sparse-small, sparse)

Process completed with exit code 1.

build (wm_filter, random-filter-s, filter)

Process completed with exit code 1.

build (fdufilterdiskann, random-filter-s, filter)

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

build (fdufilterdiskann, random-filter-s, filter)

The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v2, actions/setup-python@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/

build (hwtl_sdu_anns_stream, random-xs, streaming)

build (dhq, random-filter-s, filter)

build (mysteryann-dif, random-xs, ood)

build (mysteryann, random-xs, ood)

build (linscan, sparse-small, sparse)

build (cufe, sparse-small, sparse)

build (ngt, random-xs, ood)

build (pinecone, random-filter-s, filter)

build (cufe, random-xs, streaming)

build (diskann, random-xs, streaming)

build (cufe, random-xs, ood)

build (diskann, random-xs, ood)

build (pyanns, sparse-small, sparse)

build (sustech-whu, sparse-small, sparse)

build (hwtl_sdu_anns_filter, random-filter-s, filter)

You are running out of disk space. The runner will stop working when the machine runs out of disk space. Free space left: 48 MB

build (parlayivf, random-filter-s, filter)

build (zilliz, random-filter-s, filter)

build (vamana, random-xs, ood)

build (pyanns, random-xs, ood)

build (pyanns, random-xs, streaming)

build (zilliz, random-xs, ood)

build (zilliz, sparse-small, sparse)

build (epsearch, random-xs, ood)

build (shnsw, sparse-small, sparse)

build (cufe, random-s, filter)

build (faissplus, random-filter-s, filter)

build (faiss, random-filter-s, filter)

build (puck, random-xs, ood)

build (puck, random-xs, streaming)

build (puck, random-filter-s, filter)

build (pyanns, random-filter-s, filter)

build (sustech-ood, random-xs, ood)

build (nle, sparse-small, sparse)

build (wm_filter, random-filter-s, filter)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

added gt urls, added configurable max points #877

Summary