Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Publish comet metrics #621

Merged
merged 19 commits into from
May 22, 2024

Revert "Enable publication"

6d213f8
Select commit
Loading
Failed to load commit list.
Merged

Publish comet metrics #621

Revert "Enable publication"
6d213f8
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / tests-test succeeded May 22, 2024 in 12m 12s

FirefoxCI (pull_request)

Run tests

Details

View task in Taskcluster
View logs in Taskcluster


Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VF--UyYRTI6hby6Gr143Vw/artifacts/public/build/extract_lex.tar.zstattempt 1/5
Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/G1VhRvXLTuGQCP9l749hfA/artifacts/public/build/marian.tar.zst to /builds/worker/fetches/marian.tar.zst

Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/G1VhRvXLTuGQCP9l749hfA/artifacts/public/build/marian.tar.zstDownloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/QYRWW9BSTh-34mlpXqVVsg/artifacts/public/build/fast-align.tar.zst

/usr/local/bin/fetch-content:192: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
  with urllib.request.urlopen(
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VF--UyYRTI6hby6Gr143Vw/artifacts/public/build/extract_lex.tar.zst resolved to 620577 bytes with sha256 964eea4e00f3761a1fc0cc3d50b562a2bbcfdd9b7f668c38d4e2f3ed12c0d9c1 in 0.186s
Extracting /builds/worker/fetches/extract_lex.tar.zst to /builds/worker/fetches
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/QYRWW9BSTh-34mlpXqVVsg/artifacts/public/build/fast-align.tar.zst resolved to 722791 bytes with sha256 0cd2223cd464783e79948ea5057aa6e482f3f0bbe6660d3cd9200fab91f0e409 in 0.187s
Extracting /builds/worker/fetches/fast-align.tar.zst to /builds/worker/fetches
/builds/worker/fetches/extract_lex.tar.zst extracted in 0.006s
Removing /builds/worker/fetches/extract_lex.tar.zst
/builds/worker/fetches/fast-align.tar.zst extracted in 0.006s
Removing /builds/worker/fetches/fast-align.tar.zst
https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/G1VhRvXLTuGQCP9l749hfA/artifacts/public/build/marian.tar.zst resolved to 502183035 bytes with sha256 ee9c1bf3cc1ec850696e9f62a1d90167631942680990b1b195a2e51060af0ac3 in 3.468s
Extracting /builds/worker/fetches/marian.tar.zst to /builds/worker/fetches
/builds/worker/fetches/marian.tar.zst extracted in 3.407s
Removing /builds/worker/fetches/marian.tar.zst
PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 6.973947501999987, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2024-05-22T20:55:32.493Z] finished fetching artifacts
[task 2024-05-22T20:55:32.493Z] executing ['bash', '-c', 'export BIN=$MOZ_FETCHES_DIR && export MARIAN=$MOZ_FETCHES_DIR && task test']
[task 2024-05-22T20:55:32.499Z] task: [test] poetry install --only tests --only utils --no-root
[task 2024-05-22T20:55:32.960Z] Creating virtualenv firefox-translations-training-hlUNdH3O-py3.10 in /builds/worker/.cache/pypoetry/virtualenvs
[task 2024-05-22T20:55:33.506Z] Installing dependencies from lock file
[task 2024-05-22T20:55:33.798Z] 
[task 2024-05-22T20:55:33.799Z] Package operations: 86 installs, 0 updates, 0 removals
[task 2024-05-22T20:55:33.799Z] 
[task 2024-05-22T20:55:33.799Z]   - Installing frozenlist (1.4.1)
[task 2024-05-22T20:55:33.800Z]   - Installing idna (3.7)
[task 2024-05-22T20:55:33.800Z]   - Installing mdurl (0.1.2)
[task 2024-05-22T20:55:33.801Z]   - Installing multidict (6.0.5)
[task 2024-05-22T20:55:33.801Z]   - Installing six (1.16.0)
[task 2024-05-22T20:55:33.801Z]   - Installing smmap (5.0.1)
[task 2024-05-22T20:55:34.951Z]   - Installing aiosignal (1.3.1)
[task 2024-05-22T20:55:34.952Z]   - Installing async-timeout (4.0.3)
[task 2024-05-22T20:55:34.953Z]   - Installing attrs (23.2.0)
[task 2024-05-22T20:55:34.954Z]   - Installing certifi (2024.2.2)
[task 2024-05-22T20:55:34.954Z]   - Installing chardet (5.2.0)
[task 2024-05-22T20:55:34.955Z]   - Installing charset-normalizer (2.0.12)
[task 2024-05-22T20:55:34.956Z]   - Installing gitdb (4.0.11)
[task 2024-05-22T20:55:34.960Z]   - Installing markdown-it-py (3.0.0)
[task 2024-05-22T20:55:34.962Z]   - Installing markupsafe (2.1.5)
[task 2024-05-22T20:55:34.963Z]   - Installing pygments (2.17.2)
[task 2024-05-22T20:55:34.963Z]   - Installing python-dateutil (2.9.0.post0)
[task 2024-05-22T20:55:34.965Z]   - Installing text-unidecode (1.3)
[task 2024-05-22T20:55:34.966Z]   - Installing types-python-dateutil (2.9.0.20240316)
[task 2024-05-22T20:55:34.967Z]   - Installing urllib3 (1.26.18)
[task 2024-05-22T20:55:34.969Z]   - Installing wcwidth (0.2.13)
[task 2024-05-22T20:55:34.969Z]   - Installing yarl (1.9.4)
[task 2024-05-22T20:55:35.905Z]   - Installing aiohttp (3.9.5)
[task 2024-05-22T20:55:35.906Z]   - Installing appdirs (1.4.4)
[task 2024-05-22T20:55:35.907Z]   - Installing arrow (1.3.0)
[task 2024-05-22T20:55:35.907Z]   - Installing binaryornot (0.4.4)
[task 2024-05-22T20:55:35.909Z]   - Installing blessed (1.20.0)
[task 2024-05-22T20:55:35.911Z]   - Installing click (8.1.7)
[task 2024-05-22T20:55:35.912Z]   - Installing docker-pycreds (0.4.0)
[task 2024-05-22T20:55:35.913Z]   - Installing gitpython (3.1.43)
[task 2024-05-22T20:55:35.914Z]   - Installing giturlparse (0.12.0)
[task 2024-05-22T20:55:35.915Z]   - Installing jinja2 (3.1.3)
[task 2024-05-22T20:55:35.917Z]   - Installing joblib (1.4.2)
[task 2024-05-22T20:55:35.918Z]   - Installing latexcodec (3.0.0)
[task 2024-05-22T20:55:35.919Z]   - Installing mohawk (1.1.0)
[task 2024-05-22T20:55:35.921Z]   - Installing prefixed (0.7.1)
[task 2024-05-22T20:55:35.921Z]   - Installing protobuf (3.19.0)
[task 2024-05-22T20:55:35.923Z]   - Installing psutil (5.9.8)
[task 2024-05-22T20:55:35.924Z]   - Installing python-slugify (8.0.4)
[task 2024-05-22T20:55:35.926Z]   - Installing pyyaml (6.0.1)
[task 2024-05-22T20:55:35.927Z]   - Installing regex (2024.4.28)
[task 2024-05-22T20:55:35.928Z]   - Installing requests (2.26.0)
[task 2024-05-22T20:55:35.930Z]   - Installing rich (13.7.1)
[task 2024-05-22T20:55:35.931Z]   - Installing ruamel-yaml-clib (0.2.8)
[task 2024-05-22T20:55:35.934Z]   - Installing sentry-sdk (2.0.1)
[task 2024-05-22T20:55:35.937Z]   - Installing setproctitle (1.3.3)
[task 2024-05-22T20:55:35.941Z]   - Installing slugid (2.0.0)
[task 2024-05-22T20:55:35.943Z]   - Installing taskcluster-urls (13.0.1)
[task 2024-05-22T20:55:35.945Z]   - Installing tqdm (4.66.2)
[task 2024-05-22T20:55:37.450Z]   - Installing colorama (0.4.6)
[task 2024-05-22T20:55:37.451Z]   - Installing cookiecutter (2.6.0)
[task 2024-05-22T20:55:37.452Z]   - Installing enlighten (1.10.1)
[task 2024-05-22T20:55:37.454Z]   - Installing exceptiongroup (1.2.1)
[task 2024-05-22T20:55:37.455Z]   - Installing filelock (3.14.0)
[task 2024-05-22T20:55:37.456Z]   - Installing fsspec (2024.3.1)
[task 2024-05-22T20:55:37.457Z]   - Installing iniconfig (2.0.0)
[task 2024-05-22T20:55:37.458Z]   - Installing json-e (4.7.0)
[task 2024-05-22T20:55:37.459Z]   - Installing mozilla-repo-urls (0.1.1)
[task 2024-05-22T20:55:37.460Z]   - Installing numpy (1.26.4)
[task 2024-05-22T20:55:37.460Z]   - Installing packaging (24.0)
[task 2024-05-22T20:55:37.462Z]   - Installing pluggy (1.5.0)
[task 2024-05-22T20:55:37.463Z]   - Installing portalocker (2.3.0)
[task 2024-05-22T20:55:37.464Z]   - Installing pybtex (0.24.0)
[task 2024-05-22T20:55:37.465Z]   - Installing redo (2.0.4)
[task 2024-05-22T20:55:37.467Z]   - Installing ruamel-yaml (0.18.6)
[task 2024-05-22T20:55:37.468Z]   - Installing sacremoses (0.1.1)
[task 2024-05-22T20:55:37.470Z]   - Installing sentencepiece (0.1.99)
[task 2024-05-22T20:55:37.470Z]   - Installing tabulate (0.9.0)
[task 2024-05-22T20:55:37.473Z]   - Installing taskcluster (56.0.3)
[task 2024-05-22T20:55:37.475Z]   - Installing tomli (2.0.1)
[task 2024-05-22T20:55:37.477Z]   - Installing typing-extensions (4.11.0)
[task 2024-05-22T20:55:37.478Z]   - Installing typo (0.1.5)
[task 2024-05-22T20:55:37.480Z]   - Installing voluptuous (0.14.2)
[task 2024-05-22T20:55:37.481Z]   - Installing wandb (0.16.1)
[task 2024-05-22T20:55:41.028Z]   - Installing huggingface-hub (0.20.3)
[task 2024-05-22T20:55:41.029Z]   - Installing humanize (4.9.0)
[task 2024-05-22T20:55:41.030Z]   - Installing mtdata (0.3.2)
[task 2024-05-22T20:55:41.031Z]   - Installing opustrainer (0.2 c966d7b)
[task 2024-05-22T20:55:41.031Z]   - Installing pytest (7.4.3)
[task 2024-05-22T20:55:41.032Z]   - Installing requests-mock (1.12.1)
[task 2024-05-22T20:55:41.033Z]   - Installing sacrebleu (2.0.0)
[task 2024-05-22T20:55:41.034Z]   - Installing sh (2.0.6)
[task 2024-05-22T20:55:41.036Z]   - Installing taskcluster-taskgraph (7.4.0)
[task 2024-05-22T20:55:41.037Z]   - Installing websocket-client (1.8.0)
[task 2024-05-22T20:55:41.038Z]   - Installing zstandard (0.22.0)
[task 2024-05-22T20:55:41.374Z] Installing /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/tests/__init__.py over existing file
[task 2024-05-22T20:55:50.010Z]   - Installing translations-parser (0.1.0 /builds/worker/checkouts/vcs/tracking)
[task 2024-05-22T20:55:51.556Z] task: [test] PYTHONPATH="$(pwd):$(pwd)/taskcluster/scripts/pipeline" poetry run pytest -vv 
[task 2024-05-22T20:55:52.953Z] /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (1.26.18) or chardet (5.2.0)/charset_normalizer (2.0.12) doesn't match a supported version!
[task 2024-05-22T20:55:52.953Z]   warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported "
[task 2024-05-22T20:55:53.031Z] ============================= test session starts ==============================
[task 2024-05-22T20:55:53.031Z] platform linux -- Python 3.10.12, pytest-7.4.3, pluggy-1.5.0 -- /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/bin/python
[task 2024-05-22T20:55:53.031Z] cachedir: .pytest_cache
[task 2024-05-22T20:55:53.031Z] rootdir: /builds/worker/checkouts/vcs
[task 2024-05-22T20:55:53.031Z] configfile: pyproject.toml
[task 2024-05-22T20:55:53.031Z] testpaths: tests
[task 2024-05-22T20:55:53.031Z] plugins: requests-mock-1.12.1
[task 2024-05-22T20:55:55.405Z] collecting ... collected 97 items
[task 2024-05-22T20:55:55.405Z] 
[task 2024-05-22T20:56:18.869Z] tests/test_alignments.py::test_teacher_original_alignments PASSED        [  1%]
[task 2024-05-22T20:56:19.663Z] tests/test_alignments.py::test_teacher_backtranslated_alignments PASSED  [  2%]
[task 2024-05-22T20:56:20.420Z] tests/test_alignments.py::test_student_alignments PASSED                 [  3%]
[task 2024-05-22T20:56:22.108Z] tests/test_alignments.py::test_shortlist PASSED                          [  4%]
[task 2024-05-22T20:56:35.408Z] tests/test_analyze.py::test_analyze_mono PASSED                          [  5%]
[task 2024-05-22T20:56:37.221Z] tests/test_analyze.py::test_analyze_corpus PASSED                        [  6%]
[task 2024-05-22T20:56:37.237Z] tests/test_bicleaner.py::test_model_download[en-pt-en-pt] PASSED         [  7%]
[task 2024-05-22T20:56:37.249Z] tests/test_bicleaner.py::test_model_download[pt-en-en-pt] PASSED         [  8%]
[task 2024-05-22T20:56:37.260Z] tests/test_bicleaner.py::test_model_download[ru-en-en-xx] PASSED         [  9%]
[task 2024-05-22T20:56:37.270Z] tests/test_bicleaner.py::test_model_download[en-ru-en-xx] PASSED         [ 10%]
[task 2024-05-22T20:56:37.355Z] tests/test_common_datasets.py::test_shuffle_with_max_lines[even-distribution] PASSED [ 11%]
[task 2024-05-22T20:56:37.431Z] tests/test_common_datasets.py::test_shuffle_with_max_lines[small-content-at-start] PASSED [ 12%]
[task 2024-05-22T20:56:37.508Z] tests/test_common_datasets.py::test_shuffle_with_max_lines[large-content-at-start] PASSED [ 13%]
[task 2024-05-22T20:56:37.688Z] tests/test_common_datasets.py::test_shuffle_in_temp_files PASSED         [ 14%]
[task 2024-05-22T21:02:10.885Z] tests/test_data_importer.py::test_basic_corpus_import[mtdata-Neulab-tedtalks_test-1-eng-rus] PASSED [ 15%]
[task 2024-05-22T21:02:11.317Z] tests/test_data_importer.py::test_basic_corpus_import[opus-ELRC-3075-wikipedia_health_v1] PASSED [ 16%]
[task 2024-05-22T21:02:11.871Z] tests/test_data_importer.py::test_basic_corpus_import[flores-dev] PASSED [ 17%]
[task 2024-05-22T21:02:13.975Z] tests/test_data_importer.py::test_basic_corpus_import[sacrebleu-wmt19] PASSED [ 18%]
[task 2024-05-22T21:02:15.118Z] tests/test_data_importer.py::test_basic_corpus_import[url-gcp_pytest-dataset_a0017e] PASSED [ 19%]
[task 2024-05-22T21:02:15.216Z] tests/test_data_importer.py::test_mono_source_import[news-crawl-en] PASSED [ 20%]
[task 2024-05-22T21:02:15.314Z] tests/test_data_importer.py::test_mono_source_import[news-crawl-ru] PASSED [ 21%]
[task 2024-05-22T21:02:15.412Z] tests/test_data_importer.py::test_mono_source_import[url-en] PASSED      [ 22%]
[task 2024-05-22T21:02:15.509Z] tests/test_data_importer.py::test_mono_source_import[url-ru] PASSED      [ 23%]
[task 2024-05-22T21:02:16.304Z] tests/test_data_importer.py::test_specific_augmentation[upper] PASSED    [ 24%]
[task 2024-05-22T21:02:17.094Z] tests/test_data_importer.py::test_specific_augmentation[title] PASSED    [ 25%]
[task 2024-05-22T21:02:17.880Z] tests/test_data_importer.py::test_specific_augmentation[typos] PASSED    [ 26%]
[task 2024-05-22T21:02:18.464Z] tests/test_data_importer.py::test_specific_augmentation[noise] PASSED    [ 27%]
[task 2024-05-22T21:02:19.471Z] tests/test_data_importer.py::test_specific_augmentation[inline-noise] PASSED [ 28%]
[task 2024-05-22T21:02:20.477Z] tests/test_data_importer.py::test_augmentation_mix PASSED                [ 29%]
[task 2024-05-22T21:05:56.593Z] tests/test_eval.py::test_evaluate[evaluate-backward-sacrebleu-wmt09-en-ru] PASSED [ 30%]
[task 2024-05-22T21:05:56.690Z] tests/test_eval.py::test_evaluate[evaluate-finetuned-student-sacrebleu-wmt09-en-ru] PASSED [ 31%]
[task 2024-05-22T21:05:56.787Z] tests/test_eval.py::test_evaluate[evaluate-teacher-ensemble-sacrebleu-wmt09-en-ru] PASSED [ 32%]
[task 2024-05-22T21:05:56.885Z] tests/test_eval.py::test_evaluate[evaluate-quantized-sacrebleu-wmt09-en-ru] PASSED [ 34%]
[task 2024-05-22T21:06:21.253Z] tests/test_eval.py::test_evaluate_comet[evaluate-student-sacrebleu-wmt09-en-ru] PASSED [ 35%]
[task 2024-05-22T21:06:21.255Z] tests/test_filters.py::test_generate_filters[default-en-ru] PASSED       [ 36%]
[task 2024-05-22T21:06:21.256Z] tests/test_filters.py::test_generate_filters[default-fr-en] PASSED       [ 37%]
[task 2024-05-22T21:06:21.257Z] tests/test_filters.py::test_generate_filters[default-fr-en-elrc] PASSED  [ 38%]
[task 2024-05-22T21:06:21.259Z] tests/test_filters.py::test_generate_filters[lang-ru-en] PASSED          [ 39%]
[task 2024-05-22T21:06:21.260Z] tests/test_filters.py::test_generate_filters[lang-backward] PASSED       [ 40%]
[task 2024-05-22T21:06:21.261Z] tests/test_filters.py::test_generate_filters[dataset-ru-en] PASSED       [ 41%]
[task 2024-05-22T21:06:21.263Z] tests/test_filters.py::test_generate_filters[dataset-fr-en] PASSED       [ 42%]
[task 2024-05-22T21:06:21.264Z] tests/test_filters.py::test_generate_filters[override-with-default-ru-en-elrc] PASSED [ 43%]
[task 2024-05-22T21:06:21.265Z] tests/test_filters.py::test_generate_filters[override-with-default-fr-en-unpc] PASSED [ 44%]
[task 2024-05-22T21:06:21.269Z] tests/test_find_corpus.py::test_opus PASSED                              [ 45%]
[task 2024-05-22T21:06:21.271Z] tests/test_find_corpus.py::test_opus_download_url PASSED                 [ 46%]
[task 2024-05-22T21:06:23.015Z] tests/test_find_corpus.py::test_mtdata PASSED                            [ 47%]
[task 2024-05-22T21:06:23.026Z] tests/test_find_corpus.py::test_sacrebleu PASSED                         [ 48%]
[task 2024-05-22T21:06:23.738Z] tests/test_preflight_check.py::test_artifacts PASSED                     [ 49%]
[task 2024-05-22T21:06:24.183Z] tests/test_preflight_check.py::test_task_group PASSED                    [ 50%]
[task 2024-05-22T21:06:24.912Z] tests/test_preflight_check.py::test_task_graph PASSED                    [ 51%]
[task 2024-05-22T21:06:25.353Z] tests/test_preflight_check.py::test_task_graph_open PASSED               [ 52%]
[task 2024-05-22T21:06:25.610Z] tests/test_split_collect.py::test_split_collect_mono PASSED              [ 53%]
[task 2024-05-22T21:06:25.961Z] tests/test_split_collect.py::test_split_collect_corpus PASSED            [ 54%]
[task 2024-05-22T21:06:25.992Z] tests/test_spm_vocab.py::test_no_vocab_size PASSED                       [ 55%]
[task 2024-05-22T21:06:26.021Z] tests/test_spm_vocab.py::test_none_vocab_size PASSED                     [ 56%]
[task 2024-05-22T21:06:26.049Z] tests/test_spm_vocab.py::test_vocab_fully_specified PASSED               [ 57%]
[task 2024-05-22T21:06:26.052Z] tests/test_spm_vocab.py::test_non_multiples_eight PASSED                 [ 58%]
[task 2024-05-22T21:06:26.100Z] tests/test_tracking_cli.py::test_taskcluster PASSED                      [ 59%]
[task 2024-05-22T21:06:26.438Z] tests/test_tracking_cli.py::test_experiments_marian_1_10 PASSED          [ 60%]
[task 2024-05-22T21:06:26.594Z] tests/test_tracking_cli.py::test_experiments_marian_1_12 PASSED          [ 61%]
[task 2024-05-22T21:06:26.623Z] tests/test_tracking_cli.py::test_taskcluster_wandb_initialization_failure PASSED [ 62%]
[task 2024-05-22T21:06:26.661Z] tests/test_tracking_cli.py::test_taskcluster_wandb_log_failures PASSED   [ 63%]
[task 2024-05-22T21:06:26.690Z] tests/test_tracking_cli.py::test_taskcluster_wandb_disabled PASSED       [ 64%]
[task 2024-05-22T21:06:26.691Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-teacher-flores-flores_aug-title_devtest-lt-en-1_2-parsed_values0] PASSED [ 65%]
[task 2024-05-22T21:06:26.691Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-quantized-mtdata_aug-mix_Neulab-tedtalks_eng-lit-lt-en-parsed_values1] PASSED [ 67%]
[task 2024-05-22T21:06:26.692Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-finetune-teacher-sacrebleu-wmt19-lt-en-2_2-parsed_values2] PASSED [ 68%]
[task 2024-05-22T21:06:26.693Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-student-sacrebleu-wmt19-lt-en-parsed_values3] PASSED [ 69%]
[task 2024-05-22T21:06:26.694Z] tests/test_tracking_utils.py::test_parse_task_label[train-student-en-hu-parsed_values4] PASSED [ 70%]
[task 2024-05-22T21:06:26.695Z] tests/test_tracking_utils.py::test_parse_task_label[eval_teacher-ensemble_mtdata_Neulab-tedtalks_test-1-eng-nld-parsed_values5] PASSED [ 71%]
[task 2024-05-22T21:06:26.695Z] tests/test_tracking_utils.py::test_parse_task_label[eval_student-finetuned_flores_devtest-parsed_values6] PASSED [ 72%]
[task 2024-05-22T21:06:26.696Z] tests/test_tracking_utils.py::test_parse_task_label[eval_teacher-base0_flores_devtest-parsed_values7] PASSED [ 73%]
[task 2024-05-22T21:06:26.697Z] tests/test_tracking_utils.py::test_parse_task_label[train-backwards-en-ca-parsed_values8] PASSED [ 74%]
[task 2024-05-22T21:06:26.698Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-teacher-flores-flores_dev-en-ca-1/2-parsed_values9] PASSED [ 75%]
[task 2024-05-22T21:06:26.698Z] tests/test_tracking_utils.py::test_parse_task_label[train-teacher-ensemble-parsed_values10] PASSED [ 76%]
[task 2024-05-22T21:06:26.699Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-teacher-flores-flores_dev-en-ca-parsed_values11] PASSED [ 77%]
[task 2024-05-22T21:06:26.700Z] tests/test_tracking_utils.py::test_parse_task_label[train-finetune-student-ru-en-parsed_values12] PASSED [ 78%]
[task 2024-05-22T21:06:26.701Z] tests/test_tracking_utils.py::test_parse_task_label[train-teacher-ru-en-1-parsed_values13] PASSED [ 79%]
[task 2024-05-22T21:06:26.702Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-backward-url-gcp_pytest-dataset_a0017e-en-ru-parsed_values14] PASSED [ 80%]
[task 2024-05-22T21:06:26.702Z] tests/test_tracking_utils.py::test_parse_task_label[train-teacher-ast-en-1-parsed_values15] PASSED [ 81%]
[task 2024-05-22T21:06:26.703Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-student-sacrebleu-wmt19-ast-en-parsed_values16] PASSED [ 82%]
[task 2024-05-22T21:06:26.704Z] tests/test_tracking_utils.py::test_parse_task_label[evaluate-teacher-flores-devtest-ru-en-1-parsed_values17] PASSED [ 83%]
[task 2024-05-22T21:06:26.705Z] tests/test_tracking_utils.py::test_parse_labels_on_full_taskgraph PASSED [ 84%]
[task 2024-05-22T21:06:26.706Z] tests/test_tracking_utils.py::test_build_task_name[task_tags0-values0] PASSED [ 85%]
[task 2024-05-22T21:06:26.707Z] tests/test_tracking_utils.py::test_build_task_name[task_tags1-values1] PASSED [ 86%]
[task 2024-05-22T21:06:26.708Z] tests/test_train_taskcluster.py::test_all_args_forwarded[required_only] PASSED [ 87%]
[task 2024-05-22T21:06:26.710Z] tests/test_train_taskcluster.py::test_all_args_forwarded[with_pretrained_model] PASSED [ 88%]
[task 2024-05-22T21:06:26.712Z] tests/test_train_taskcluster.py::test_all_args_forwarded[with_extra_params] PASSED [ 89%]
[task 2024-05-22T21:06:26.714Z] tests/test_train_taskcluster.py::test_autocontinue[run_0_no_continuation] PASSED [ 90%]
[task 2024-05-22T21:06:26.716Z] tests/test_train_taskcluster.py::test_autocontinue[run_0_no_continuation_with_pretrained_model] PASSED [ 91%]
[task 2024-05-22T21:06:26.720Z] tests/test_train_taskcluster.py::test_autocontinue[run_1_continues_run_0] PASSED [ 92%]
[task 2024-05-22T21:06:26.723Z] tests/test_train_taskcluster.py::test_autocontinue[run_2_continues_run_1] PASSED [ 93%]
[task 2024-05-22T21:06:26.727Z] tests/test_train_taskcluster.py::test_autocontinue[run_2_continues_run_0] PASSED [ 94%]
[task 2024-05-22T21:06:26.730Z] tests/test_train_taskcluster.py::test_autocontinue[run_3_continues_run_1] PASSED [ 95%]
[task 2024-05-22T21:06:26.733Z] tests/test_train_taskcluster.py::test_autocontinue[run_2_cant_continue_earlier_runs] PASSED [ 96%]
[task 2024-05-22T21:06:26.735Z] tests/test_train_taskcluster.py::test_autocontinue[run_2_cant_continue_earlier_runs_preserves_pretrained_model_mode] PASSED [ 97%]
[task 2024-05-22T21:06:39.512Z] tests/test_training.py::test_train_student_mocked PASSED                 [ 98%]
[task 2024-05-22T21:06:50.622Z] tests/test_training.py::test_train_student PASSED                        [100%]
[task 2024-05-22T21:06:50.622Z] 
[task 2024-05-22T21:06:50.622Z] =============================== warnings summary ===============================
[task 2024-05-22T21:06:50.622Z] ../../.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/wandb/sdk/launch/builder/build.py:11
[task 2024-05-22T21:06:50.622Z]   /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/wandb/sdk/launch/builder/build.py:11: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
[task 2024-05-22T21:06:50.622Z]     import pkg_resources
[task 2024-05-22T21:06:50.622Z] 
[task 2024-05-22T21:06:50.622Z] ../../.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/pkg_resources/__init__.py:2832
[task 2024-05-22T21:06:50.622Z]   /builds/worker/.cache/pypoetry/virtualenvs/firefox-translations-training-hlUNdH3O-py3.10/lib/python3.10/site-packages/pkg_resources/__init__.py:2832: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
[task 2024-05-22T21:06:50.622Z]   Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
[task 2024-05-22T21:06:50.622Z]     declare_namespace(pkg)
[task 2024-05-22T21:06:50.622Z] 
[task 2024-05-22T21:06:50.622Z] -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
[task 2024-05-22T21:06:50.622Z] ================== 97 passed, 2 warnings in 657.59s (0:10:57) ==================
[fetches 2024-05-22T21:06:51.708Z] removing /builds/worker/fetches
[fetches 2024-05-22T21:06:51.872Z] finished
[taskcluster 2024-05-22T21:06:54.322Z]    Exit Code: 0
[taskcluster 2024-05-22T21:06:54.322Z]    User Time: 9.302594s
[taskcluster 2024-05-22T21:06:54.322Z]  Kernel Time: 4.452333s
[taskcluster 2024-05-22T21:06:54.322Z]    Wall Time: 11m41.09497021s
[taskcluster 2024-05-22T21:06:54.322Z]       Result: SUCCEEDED
[taskcluster 2024-05-22T21:06:54.322Z] === Task Finished ===
[taskcluster 2024-05-22T21:06:54.322Z] Task Duration: 11m41.095262485s
[taskcluster 2024-05-22T21:06:54.322Z] [mounts] Preserving cache: Moving "/task_171641103874051/cache0" to "caches/Vr2GrZXeTXOoNKkoSOJy_Q"
[taskcluster 2024-05-22T21:06:54.376Z] [mounts] Denying task_171641103874051 access to 'caches/Vr2GrZXeTXOoNKkoSOJy_Q'
[taskcluster 2024-05-22T21:06:54.455Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2024-08-20T20:54:41.828Z