Publish comet metrics #621
Merged
firefoxci-taskcluster / tests-test
succeeded
May 22, 2024 in 12m 12s
FirefoxCI (pull_request)
Run tests
Details
View task in Taskcluster
View logs in Taskcluster
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VF--UyYRTI6hby6Gr143Vw/artifacts/public/build/extract_lex.tar.zstattempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/G1VhRvXLTuGQCP9l749hfA/artifacts/public/build/marian.tar.zst to /builds/worker/fetches/marian.tar.zst
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/G1VhRvXLTuGQCP9l749hfA/artifacts/public/build/marian.tar.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/QYRWW9BSTh-34mlpXqVVsg/artifacts/public/build/fast-align.tar.zst
/usr/local/bin/fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
with urllib.request.urlopen(
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VF--UyYRTI6hby6Gr143Vw/artifacts/public/build/extract_lex.tar.zst resolved to 620577 bytes with sha256 964eea4e00f3761a1fc0cc3d50b562a2bbcfdd9b7f668c38d4e2f3ed12c0d9c1 in 0.186s
Extracting /builds/worker/fetches/extract_lex.tar.zst to /builds/worker/fetches
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/QYRWW9BSTh-34mlpXqVVsg/artifacts/public/build/fast-align.tar.zst resolved to 722791 bytes with sha256 0cd2223cd464783e79948ea5057aa6e482f3f0bbe6660d3cd9200fab91f0e409 in 0.187s
Extracting /builds/worker/fetches/fast-align.tar.zst to /builds/worker/fetches
/builds/worker/fetches/extract_lex.tar.zst extracted in 0.006s
Removing /builds/worker/fetches/extract_lex.tar.zst
/builds/worker/fetches/fast-align.tar.zst extracted in 0.006s
Removing /builds/worker/fetches/fast-align.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/G1VhRvXLTuGQCP9l749hfA/artifacts/public/build/marian.tar.zst resolved to 502183035 bytes with sha256 ee9c1bf3cc1ec850696e9f62a1d90167631942680990b1b195a2e51060af0ac3 in 3.468s
Extracting /builds/worker/fetches/marian.tar.zst to /builds/worker/fetches
/builds/worker/fetches/marian.tar.zst extracted in 3.407s
Removing /builds/worker/fetches/marian.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 6.973947501999987, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-05-22T20:55:32.493Z] finished fetching artifacts
[task 2024-05-22T20:55:32.493Z] executing ['bash', '-c', 'export BIN=$MOZ_FETCHES_DIR && export MARIAN=$MOZ_FETCHES_DIR && task test']
[task 2024-05-22T20:55:32.499Z] task: [test] poetry install --only tests --only utils --no-root
[task 2024-05-22T20:55:32.960Z] Creating virtualenv firefox-translations-training-hlUNdH3O-py3.10 in /builds/worker/.cache/pypoetry/virtualenvs
[task 2024-05-22T20:55:33.506Z] Installing dependencies from lock file
[task 2024-05-22T20:55:33.798Z]
[task 2024-05-22T20:55:33.799Z] Package operations: 86 installs, 0 updates, 0 removals
[task 2024-05-22T20:55:33.799Z]
[task 2024-05-22T20:55:33.799Z] - Installing frozenlist (1.4.1)
[task 2024-05-22T20:55:33.800Z] - Installing idna (3.7)
[task 2024-05-22T20:55:33.800Z] - Installing mdurl (0.1.2)
[task 2024-05-22T20:55:33.801Z] - Installing multidict (6.0.5)
[task 2024-05-22T20:55:33.801Z] - Installing six (1.16.0)
[task 2024-05-22T20:55:33.801Z] - Installing smmap (5.0.1)
[task 2024-05-22T20:55:34.951Z] - Installing aiosignal (1.3.1)
[task 2024-05-22T20:55:34.952Z] - Installing async-timeout (4.0.3)
[task 2024-05-22T20:55:34.953Z] - Installing attrs (23.2.0)
[task 2024-05-22T20:55:34.954Z] - Installing certifi (2024.2.2)
[task 2024-05-22T20:55:34.954Z] - Installing chardet (5.2.0)
[task 2024-05-22T20:55:34.955Z] - Installing charset-normalizer (2.0.12)
[task 2024-05-22T20:55:34.956Z] - Installing gitdb (4.0.11)
[task 2024-05-22T20:55:34.960Z] - Installing markdown-it-py (3.0.0)
[task 2024-05-22T20:55:34.962Z] - Installing markupsafe (2.1.5)
[task 2024-05-22T20:55:34.963Z] - Installing pygments (2.17.2)
[task 2024-05-22T20:55:34.963Z] - Installing python-dateutil (2.9.0.post0)
[task 2024-05-22T20:55:34.965Z] - Installing text-unidecode (1.3)
[task 2024-05-22T20:55:34.966Z] - Installing types-python-dateutil (2.9.0.20240316)
[task 2024-05-22T20:55:34.967Z] - Installing urllib3 (1.26.18)
[task 2024-05-22T20:55:34.969Z] - Installing wcwidth (0.2.13)
[task 2024-05-22T20:55:34.969Z] - Installing yarl (1.9.4)
[task 2024-05-22T20:55:35.905Z] - Installing aiohttp (3.9.5)
[task 2024-05-22T20:55:35.906Z] - Installing appdirs (1.4.4)
[task 2024-05-22T20:55:35.907Z] - Installing arrow (1.3.0)
[task 2024-05-22T20:55:35.907Z] - Installing binaryornot (0.4.4)
[task 2024-05-22T20:55:35.909Z] - Installing blessed (1.20.0)
[task 2024-05-22T20:55:35.911Z] - Installing click (8.1.7)
[task 2024-05-22T20:55:35.912Z] - Installing docker-pycreds (0.4.0)
[task 2024-05-22T20:55:35.913Z] - Installing gitpython (3.1.43)
[task 2024-05-22T20:55:35.914Z] - Installing giturlparse (0.12.0)
[task 2024-05-22T20:55:35.915Z] - Installing jinja2 (3.1.3)
[task 2024-05-22T20:55:35.917Z] - Installing joblib (1.4.2)
[task 2024-05-22T20:55:35.918Z] - Installing latexcodec (3.0.0)
[task 2024-05-22T20:55:35.919Z] - Installing mohawk (1.1.0)
[task 2024-05-22T20:55:35.921Z] - Installing prefixed (0.7.1)
[task 2024-05-22T20:55:35.921Z] - Installing protobuf (3.19.0)
[task 2024-05-22T20:55:35.923Z] - Installing psutil (5.9.8)
[task 2024-05-22T20:55:35.924Z] - Installing python-slugify (8.0.4)
[task 2024-05-22T20:55:35.926Z] - Installing pyyaml (6.0.1)
[task 2024-05-22T20:55:35.927Z] - Installing regex (2024.4.28)
[task 2024-05-22T20:55:35.928Z] - Installing requests (2.26.0)
[task 2024-05-22T20:55:35.930Z] - Installing rich (13.7.1)
[task 2024-05-22T20:55:35.931Z] - Installing ruamel-yaml-clib (0.2.8)
[task 2024-05-22T20:55:35.934Z] - Installing sentry-sdk (2.0.1)
[task 2024-05-22T20:55:35.937Z] - Installing setproctitle (1.3.3)
[task 2024-05-22T20:55:35.941Z] - Installing slugid (2.0.0)
[task 2024-05-22T20:55:35.943Z] - Installing taskcluster-urls (13.0.1)
[task 2024-05-22T20:55:35.945Z] - Installing tqdm (4.66.2)
[task 2024-05-22T20:55:37.450Z] - Installing colorama (0.4.6)
[task 2024-05-22T20:55:37.451Z] - Installing cookiecutter (2.6.0)
[task 2024-05-22T20:55:37.452Z] - Installing enlighten (1.10.1)
[task 2024-05-22T20:55:37.454Z] - Installing exceptiongroup (1.2.1)
[task 2024-05-22T20:55:37.455Z] - Installing filelock (3.14.0)
[task 2024-05-22T20:55:37.456Z] - Installing fsspec (2024.3.1)
[task 2024-05-22T20:55:37.457Z] - Installing iniconfig (2.0.0)
[task 2024-05-22T20:55:37.458Z] - Installing json-e (4.7.0)
[task 2024-05-22T20:55:37.459Z] - Installing mozilla-repo-urls (0.1.1)
[task 2024-05-22T20:55:37.460Z] - Installing numpy (1.26.4)
[task 2024-05-22T20:55:37.460Z] - Installing packaging (24.0)
[task 2024-05-22T20:55:37.462Z] - Installing pluggy (1.5.0)
[task 2024-05-22T20:55:37.463Z] - Installing portalocker (2.3.0)
[task 2024-05-22T20:55:37.464Z] - Installing pybtex (0.24.0)
[task 2024-05-22T20:55:37.465Z] - Installing redo (2.0.4)
[task 2024-05-22T20:55:37.467Z] - Installing ruamel-yaml (0.18.6)
[task 2024-05-22T20:55:37.468Z] - Installing sacremoses (0.1.1)
[task 2024-05-22T20:55:37.470Z] - Installing sentencepiece (0.1.99)
[task 2024-05-22T20:55:37.470Z] - Installing tabulate (0.9.0)
[task 2024-05-22T20:55:37.473Z] - Installing taskcluster (56.0.3)
[task 2024-05-22T20:55:37.475Z] - Installing tomli (2.0.1)
[task 2024-05-22T20:55:37.477Z] - Installing typing-extensions (4.11.0)
[task 2024-05-22T20:55:37.478Z] - Installing typo (0.1.5)
[task 2024-05-22T20:55:37.480Z] - Installing voluptuous (0.14.2)
[task 2024-05-22T20:55:37.481Z] - Installing wandb (0.16.1)
[task 2024-05-22T20:55:41.028Z] - Installing huggingface-hub (0.20.3)
[task 2024-05-22T20:55:41.029Z] - Installing humanize (4.9.0)
[task 2024-05-22T20:55:41.030Z] - Installing mtdata (0.3.2)
[task 2024-05-22T20:55:41.031Z] - Installing opustrainer (0.2 c966d7b)
[task 2024-05-22T20:55:41.031Z] - Installing pytest (7.4.3)
[task 2024-05-22T20:55:41.032Z] - Installing requests-mock (1.12.1)
[task 2024-05-22T20:55:41.033Z] - Installing sacrebleu (2.0.0)
[task 2024-05-22T20:55:41.034Z] - Installing sh (2.0.6)
[task 2024-05-22T20:55:41.036Z] - Installing taskcluster-taskgraph (7.4.0)
[task 2024-05-22T20:55:41.037Z] - Installing websocket-client (1.8.0)
[task 2024-05-22T20:55:41.038Z] - Installing zstandard (0.22.0)
[task 2024-05-22T20:55:41.374Z] Installing /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/tests/__init__.py over existing file
[task 2024-05-22T20:55:50.010Z] - Installing translations-parser (0.1.0 /builds/worker/checkouts/vcs/tracking)
[task 2024-05-22T20:55:51.556Z] task: [test] PYTHONPATH="$(pwd):$(pwd)/taskcluster/scripts/pipeline" poetry run pytest -vv
[task 2024-05-22T20:55:52.953Z] /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (1.26.18) or chardet (5.2.0)/charset_normalizer (2.0.12) doesn't match a supported version!
[task 2024-05-22T20:55:52.953Z] warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported "
[task 2024-05-22T20:55:53.031Z] ============================= test session starts ==============================
[task 2024-05-22T20:55:53.031Z] platform linux -- Python 3.10.12, pytest-7.4.3, pluggy-1.5.0 -- /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/bin/python
[task 2024-05-22T20:55:53.031Z] cachedir: .pytest_cache
[task 2024-05-22T20:55:53.031Z] rootdir: /builds/worker/checkouts/vcs
[task 2024-05-22T20:55:53.031Z] configfile: pyproject.toml
[task 2024-05-22T20:55:53.031Z] testpaths: tests
[task 2024-05-22T20:55:53.031Z] plugins: requests-mock-1.12.1
[task 2024-05-22T20:55:55.405Z] collecting ... collected 97 items
[task 2024-05-22T20:55:55.405Z]
[task 2024-05-22T20:56:18.869Z] tests/test_alignments.py::test_teacher_original_alignments PASSED [ 1%]
[task 2024-05-22T20:56:19.663Z] tests/test_alignments.py::test_teacher_backtranslated_alignments PASSED [ 2%]
[task 2024-05-22T20:56:20.420Z] tests/test_alignments.py::test_student_alignments PASSED [ 3%]
[task 2024-05-22T20:56:22.108Z] tests/test_alignments.py::test_shortlist PASSED [ 4%]
[task 2024-05-22T20:56:35.408Z] tests/test_analyze.py::test_analyze_mono PASSED [ 5%]
[task 2024-05-22T20:56:37.221Z] tests/test_analyze.py::test_analyze_corpus PASSED [ 6%]
[task 2024-05-22T20:56:37.237Z] tests/test_bicleaner.py::test_model_download[en-pt-en-pt] PASSED [ 7%]
[task 2024-05-22T20:56:37.249Z] tests/test_bicleaner.py::test_model_download[pt-en-en-pt] PASSED [ 8%]
[task 2024-05-22T20:56:37.260Z] tests/test_bicleaner.py::test_model_download[ru-en-en-xx] PASSED [ 9%]
[task 2024-05-22T20:56:37.270Z] tests/test_bicleaner.py::test_model_download[en-ru-en-xx] PASSED [ 10%]
[task 2024-05-22T20:56:37.355Z] tests/test_common_datasets.py::test_shuffle_with_max_lines[even-distribution] PASSED [ 11%]
[task 2024-05-22T20:56:37.431Z] tests/test_common_datasets.py::test_shuffle_with_max_lines[small-content-at-start] PASSED [ 12%]
[task 2024-05-22T20:56:37.508Z] tests/test_common_datasets.py::test_shuffle_with_max_lines[large-content-at-start] PASSED [ 13%]
[task 2024-05-22T20:56:37.688Z] tests/test_common_datasets.py::test_shuffle_in_temp_files PASSED [ 14%]
[task 2024-05-22T21:02:10.885Z] tests/test_data_importer.py::test_basic_corpus_import[mtdata-Neulab-tedtalks_test-1-eng-rus] PASSED [ 15%]
[task 2024-05-22T21:02:11.317Z] tests/test_data_importer.py::test_basic_corpus_import[opus-ELRC-3075-wikipedia_health_v1] PASSED [ 16%]
[task 2024-05-22T21:02:11.871Z] tests/test_data_importer.py::test_basic_corpus_import[flores-dev] PASSED [ 17%]
[task 2024-05-22T21:02:13.975Z] tests/test_data_importer.py::test_basic_corpus_import[sacrebleu-wmt19] PASSED [ 18%]
[task 2024-05-22T21:02:15.118Z] tests/test_data_importer.py::test_basic_corpus_import[url-gcp_pytest-dataset_a0017e] PASSED [ 19%]
[task 2024-05-22T21:02:15.216Z] tests/test_data_importer.py::test_mono_source_import[news-crawl-en] PASSED [ 20%]
[task 2024-05-22T21:02:15.314Z] tests/test_data_importer.py::test_mono_source_import[news-crawl-ru] PASSED [ 21%]
[task 2024-05-22T21:02:15.412Z] tests/test_data_importer.py::test_mono_source_import[url-en] PASSED [ 22%]
[task 2024-05-22T21:02:15.509Z] tests/test_data_importer.py::test_mono_source_import[url-ru] PASSED [ 23%]
[task 2024-05-22T21:02:16.304Z] tests/test_data_importer.py::test_specific_augmentation[upper] PASSED [ 24%]
[task 2024-05-22T21:02:17.094Z] tests/test_data_importer.py::test_specific_augmentation[title] PASSED [ 25%]
[task 2024-05-22T21:02:17.880Z] tests/test_data_importer.py::test_specific_augmentation[typos] PASSED [ 26%]
[task 2024-05-22T21:02:18.464Z] tests/test_data_importer.py::test_specific_augmentation[noise] PASSED [ 27%]
[task 2024-05-22T21:02:19.471Z] tests/test_data_importer.py::test_specific_augmentation[inline-noise] PASSED [ 28%]
[task 2024-05-22T21:02:20.477Z] tests/test_data_importer.py::test_augmentation_mix PASSED [ 29%]
[task 2024-05-22T21:05:56.593Z] tests/test_eval.py::test_evaluate[evaluate-backward-sacrebleu-wmt09-en-ru] PASSED [ 30%]
[task 2024-05-22T21:05:56.690Z] tests/test_eval.py::test_evaluate[evaluate-finetuned-student-sacrebleu-wmt09-en-ru] PASSED [ 31%]
[task 2024-05-22T21:05:56.787Z] tests/test_eval.py::test_evaluate[evaluate-teacher-ensemble-sacrebleu-wmt09-en-ru] PASSED [ 32%]
[task 2024-05-22T21:05:56.885Z] tests/test_eval.py::test_evaluate[evaluate-quantized-sacrebleu-wmt09-en-ru] PASSED [ 34%]
[task 2024-05-22T21:06:21.253Z] tests/test_eval.py::test_evaluate_comet[evaluate-student-sacrebleu-wmt09-en-ru] PASSED [ 35%]
[task 2024-05-22T21:06:21.255Z] tests/test_filters.py::test_generate_filters[default-en-ru] PASSED [ 36%]
[task 2024-05-22T21:06:21.256Z] tests/test_filters.py::test_generate_filters[default-fr-en] PASSED [ 37%]
[task 2024-05-22T21:06:21.257Z] tests/test_filters.py::test_generate_filters[default-fr-en-elrc] PASSED [ 38%]
[task 2024-05-22T21:06:21.259Z] tests/test_filters.py::test_generate_filters[lang-ru-en] PASSED [ 39%]
[task 2024-05-22T21:06:21.260Z] tests/test_filters.py::test_generate_filters[lang-backward] PASSED [ 40%]
[task 2024-05-22T21:06:21.261Z] tests/test_filters.py::test_generate_filters[dataset-ru-en] PASSED [ 41%]
[task 2024-05-22T21:06:21.263Z] tests/test_filters.py::test_generate_filters[dataset-fr-en] PASSED [ 42%]
[task 2024-05-22T21:06:21.264Z] tests/test_filters.py::test_generate_filters[override-with-default-ru-en-elrc] PASSED [ 43%]
[task 2024-05-22T21:06:21.265Z] tests/test_filters.py::test_generate_filters[override-with-default-fr-en-unpc] PASSED [ 44%]
[task 2024-05-22T21:06:21.269Z] tests/test_find_corpus.py::test_opus PASSED [ 45%]
[task 2024-05-22T21:06:21.271Z] tests/test_find_corpus.py::test_opus_download_url PASSED [ 46%]
[task 2024-05-22T21:06:23.015Z] tests/test_find_corpus.py::test_mtdata PASSED [ 47%]
[task 2024-05-22T21:06:23.026Z] tests/test_find_corpus.py::test_sacrebleu PASSED [ 48%]
[task 2024-05-22T21:06:23.738Z] tests/test_preflight_check.py::test_artifacts PASSED [ 49%]
[task 2024-05-22T21:06:24.183Z] tests/test_preflight_check.py::test_task_group PASSED [ 50%]
[task 2024-05-22T21:06:24.912Z] tests/test_preflight_check.py::test_task_graph PASSED [ 51%]
[task 2024-05-22T21:06:25.353Z] tests/test_preflight_check.py::test_task_graph_open PASSED [ 52%]
[task 2024-05-22T21:06:25.610Z] tests/test_split_collect.py::test_split_collect_mono PASSED [ 53%]
[task 2024-05-22T21:06:25.961Z] tests/test_split_collect.py::test_split_collect_corpus PASSED [ 54%]
[task 2024-05-22T21:06:25.992Z] tests/test_spm_vocab.py::test_no_vocab_size PASSED [ 55%]
[task 2024-05-22T21:06:26.021Z] tests/test_spm_vocab.py::test_none_vocab_size PASSED [ 56%]
[task 2024-05-22T21:06:26.049Z] tests/test_spm_vocab.py::test_vocab_fully_specified PASSED [ 57%]
[task 2024-05-22T21:06:26.052Z] tests/test_spm_vocab.py::test_non_multiples_eight PASSED [ 58%]
[task 2024-05-22T21:06:26.100Z] tests/test_tracking_cli.py::test_taskcluster PASSED [ 59%]
[task 2024-05-22T21:06:26.438Z] tests/test_tracking_cli.py::test_experiments_marian_1_10 PASSED [ 60%]
[task 2024-05-22T21:06:26.594Z] tests/test_tracking_cli.py::test_experiments_marian_1_12 PASSED [ 61%]
[task 2024-05-22T21:06:26.623Z] tests/test_tracking_cli.py::test_taskcluster_wandb_initialization_failure PASSED [ 62%]
[task 2024-05-22T21:06:26.661Z] tests/test_tracking_cli.py::test_taskcluster_wandb_log_failures PASSED [ 63%]
[task 2024-05-22T21:06:26.690Z] tests/test_tracking_cli.py::test_taskcluster_wandb_disabled PASSED [ 64%]
[task 2024-05-22T21:06:26.691Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-teacher-flores-flores_aug-title_devtest-lt-en-1_2-parsed_values0] PASSED [ 65%]
[task 2024-05-22T21:06:26.691Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-quantized-mtdata_aug-mix_Neulab-tedtalks_eng-lit-lt-en-parsed_values1] PASSED [ 67%]
[task 2024-05-22T21:06:26.692Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-finetune-teacher-sacrebleu-wmt19-lt-en-2_2-parsed_values2] PASSED [ 68%]
[task 2024-05-22T21:06:26.693Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-student-sacrebleu-wmt19-lt-en-parsed_values3] PASSED [ 69%]
[task 2024-05-22T21:06:26.694Z] tests/test_tracking_utils.py::test_parse_task_label[train-student-en-hu-parsed_values4] PASSED [ 70%]
[task 2024-05-22T21:06:26.695Z] tests/test_tracking_utils.py::test_parse_task_label[eval_teacher-ensemble_mtdata_Neulab-tedtalks_test-1-eng-nld-parsed_values5] PASSED [ 71%]
[task 2024-05-22T21:06:26.695Z] tests/test_tracking_utils.py::test_parse_task_label[eval_student-finetuned_flores_devtest-parsed_values6] PASSED [ 72%]
[task 2024-05-22T21:06:26.696Z] tests/test_tracking_utils.py::test_parse_task_label[eval_teacher-base0_flores_devtest-parsed_values7] PASSED [ 73%]
[task 2024-05-22T21:06:26.697Z] tests/test_tracking_utils.py::test_parse_task_label[train-backwards-en-ca-parsed_values8] PASSED [ 74%]
[task 2024-05-22T21:06:26.698Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-teacher-flores-flores_dev-en-ca-1/2-parsed_values9] PASSED [ 75%]
[task 2024-05-22T21:06:26.698Z] tests/test_tracking_utils.py::test_parse_task_label[train-teacher-ensemble-parsed_values10] PASSED [ 76%]
[task 2024-05-22T21:06:26.699Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-teacher-flores-flores_dev-en-ca-parsed_values11] PASSED [ 77%]
[task 2024-05-22T21:06:26.700Z] tests/test_tracking_utils.py::test_parse_task_label[train-finetune-student-ru-en-parsed_values12] PASSED [ 78%]
[task 2024-05-22T21:06:26.701Z] tests/test_tracking_utils.py::test_parse_task_label[train-teacher-ru-en-1-parsed_values13] PASSED [ 79%]
[task 2024-05-22T21:06:26.702Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-backward-url-gcp_pytest-dataset_a0017e-en-ru-parsed_values14] PASSED [ 80%]
[task 2024-05-22T21:06:26.702Z] tests/test_tracking_utils.py::test_parse_task_label[train-teacher-ast-en-1-parsed_values15] PASSED [ 81%]
[task 2024-05-22T21:06:26.703Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-student-sacrebleu-wmt19-ast-en-parsed_values16] PASSED [ 82%]
[task 2024-05-22T21:06:26.704Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-teacher-flores-devtest-ru-en-1-parsed_values17] PASSED [ 83%]
[task 2024-05-22T21:06:26.705Z] tests/test_tracking_utils.py::test_parse_labels_on_full_taskgraph PASSED [ 84%]
[task 2024-05-22T21:06:26.706Z] tests/test_tracking_utils.py::test_build_task_name[task_tags0-values0] PASSED [ 85%]
[task 2024-05-22T21:06:26.707Z] tests/test_tracking_utils.py::test_build_task_name[task_tags1-values1] PASSED [ 86%]
[task 2024-05-22T21:06:26.708Z] tests/test_train_taskcluster.py::test_all_args_forwarded[required_only] PASSED [ 87%]
[task 2024-05-22T21:06:26.710Z] tests/test_train_taskcluster.py::test_all_args_forwarded[with_pretrained_model] PASSED [ 88%]
[task 2024-05-22T21:06:26.712Z] tests/test_train_taskcluster.py::test_all_args_forwarded[with_extra_params] PASSED [ 89%]
[task 2024-05-22T21:06:26.714Z] tests/test_train_taskcluster.py::test_autocontinue[run_0_no_continuation] PASSED [ 90%]
[task 2024-05-22T21:06:26.716Z] tests/test_train_taskcluster.py::test_autocontinue[run_0_no_continuation_with_pretrained_model] PASSED [ 91%]
[task 2024-05-22T21:06:26.720Z] tests/test_train_taskcluster.py::test_autocontinue[run_1_continues_run_0] PASSED [ 92%]
[task 2024-05-22T21:06:26.723Z] tests/test_train_taskcluster.py::test_autocontinue[run_2_continues_run_1] PASSED [ 93%]
[task 2024-05-22T21:06:26.727Z] tests/test_train_taskcluster.py::test_autocontinue[run_2_continues_run_0] PASSED [ 94%]
[task 2024-05-22T21:06:26.730Z] tests/test_train_taskcluster.py::test_autocontinue[run_3_continues_run_1] PASSED [ 95%]
[task 2024-05-22T21:06:26.733Z] tests/test_train_taskcluster.py::test_autocontinue[run_2_cant_continue_earlier_runs] PASSED [ 96%]
[task 2024-05-22T21:06:26.735Z] tests/test_train_taskcluster.py::test_autocontinue[run_2_cant_continue_earlier_runs_preserves_pretrained_model_mode] PASSED [ 97%]
[task 2024-05-22T21:06:39.512Z] tests/test_training.py::test_train_student_mocked PASSED [ 98%]
[task 2024-05-22T21:06:50.622Z] tests/test_training.py::test_train_student PASSED [100%]
[task 2024-05-22T21:06:50.622Z]
[task 2024-05-22T21:06:50.622Z] =============================== warnings summary ===============================
[task 2024-05-22T21:06:50.622Z] ../../.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/wandb/sdk/launch/builder/build.py:11
[task 2024-05-22T21:06:50.622Z] /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/wandb/sdk/launch/builder/build.py:11: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
[task 2024-05-22T21:06:50.622Z] import pkg_resources
[task 2024-05-22T21:06:50.622Z]
[task 2024-05-22T21:06:50.622Z] ../../.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/pkg_resources/__init__.py:2832
[task 2024-05-22T21:06:50.622Z] /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/pkg_resources/__init__.py:2832: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
[task 2024-05-22T21:06:50.622Z] Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
[task 2024-05-22T21:06:50.622Z] declare_namespace(pkg)
[task 2024-05-22T21:06:50.622Z]
[task 2024-05-22T21:06:50.622Z] -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
[task 2024-05-22T21:06:50.622Z] ================== 97 passed, 2 warnings in 657.59s (0:10:57) ==================
[fetches 2024-05-22T21:06:51.708Z] removing /builds/worker/fetches
[fetches 2024-05-22T21:06:51.872Z] finished
[taskcluster 2024-05-22T21:06:54.322Z] Exit Code: 0
[taskcluster 2024-05-22T21:06:54.322Z] User Time: 9.302594s
[taskcluster 2024-05-22T21:06:54.322Z] Kernel Time: 4.452333s
[taskcluster 2024-05-22T21:06:54.322Z] Wall Time: 11m41.09497021s
[taskcluster 2024-05-22T21:06:54.322Z] Result: SUCCEEDED
[taskcluster 2024-05-22T21:06:54.322Z] === Task Finished ===
[taskcluster 2024-05-22T21:06:54.322Z] Task Duration: 11m41.095262485s
[taskcluster 2024-05-22T21:06:54.322Z] [mounts] Preserving cache: Moving "/task_171641103874051/cache0" to "caches/Vr2GrZXeTXOoNKkoSOJy_Q"
[taskcluster 2024-05-22T21:06:54.376Z] [mounts] Denying task_171641103874051 access to 'caches/Vr2GrZXeTXOoNKkoSOJy_Q'
[taskcluster 2024-05-22T21:06:54.455Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-08-20T20:54:41.828Z
Loading