Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the ability to run starting from a specific task (fixes #227) #377

Merged
merged 2 commits into from
Feb 14, 2024

Update poetry dependencies to pull in newer taskgraph version

37fbf27
Select commit
Loading
Failed to load commit list.
Merged

Add the ability to run starting from a specific task (fixes #227) #377

Update poetry dependencies to pull in newer taskgraph version
37fbf27
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / Decision Task (pull-request) succeeded Feb 13, 2024 in 17s

FirefoxCI (pull_request)

The task that creates all of the other tasks in the task graph

Details

View task in Taskcluster
View logs in Taskcluster


[vcs 2024-02-13T19:45:31.618Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2024-02-13T19:45:31.618Z]  * branch            start-specific -> FETCH_HEAD
[vcs 2024-02-13T19:45:31.621Z] executing ['git', 'checkout', '-f', '-B', 'start-specific', '37fbf272d7eb316897377144111a3ef057becfd4']
[vcs 2024-02-13T19:45:31.628Z] Switched to and reset branch 'start-specific'
[vcs 2024-02-13T19:45:31.628Z] Your branch and 'origin/start-specific' have diverged,
[vcs 2024-02-13T19:45:31.628Z] and have 2 and 1 different commits each, respectively.
[vcs 2024-02-13T19:45:31.628Z]   (use "git pull" to merge the remote branch into yours)
[vcs 2024-02-13T19:45:31.629Z] executing ['git', 'submodule', 'init']
[vcs 2024-02-13T19:45:31.646Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-02-13T19:45:31.675Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-02-13T19:45:31.681Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-02-13T19:45:31.686Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-02-13T19:45:31.694Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-02-13T19:45:31.703Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-02-13T19:45:31.709Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-02-13T19:45:31.710Z] cleaning git checkout...
[vcs 2024-02-13T19:45:31.710Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-02-13T19:45:31.714Z] removing ['/builds/worker/checkouts/src/artifacts', '/builds/worker/checkouts/src/docker-contexts/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/actions/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/transforms/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/util/__pycache__/']
[vcs 2024-02-13T19:45:31.715Z] successfully cleaned git checkout!
[vcs 2024-02-13T19:45:31.718Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/37fbf272d7eb316897377144111a3ef057becfd4' title='Built from firefox-translations-training commit 37fbf272d7eb316897377144111a3ef057becfd4'>37fbf272d7eb316897377144111a3ef057becfd4</a>
[pip-install 2024-02-13T19:45:31.718Z] executing ['/usr/bin/python3', '-mpip', 'install', '--break-system-packages', '--require-hashes', '-r', '/builds/worker/checkouts/src/taskcluster/requirements.txt']
[pip-install 2024-02-13T19:45:31.983Z] Defaulting to user installation because normal site-packages is not writeable
[pip-install 2024-02-13T19:45:32.071Z] Requirement already satisfied: appdirs==1.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 7)) (1.4.4)
[pip-install 2024-02-13T19:45:32.160Z] Collecting arrow==1.3.0
[pip-install 2024-02-13T19:45:32.303Z]   Downloading arrow-1.3.0-py3-none-any.whl (66 kB)
[pip-install 2024-02-13T19:45:32.347Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 kB 1.5 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:32.351Z] Requirement already satisfied: binaryornot==0.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 15)) (0.4.4)
[pip-install 2024-02-13T19:45:32.382Z] Collecting certifi==2024.2.2
[pip-install 2024-02-13T19:45:32.417Z]   Downloading certifi-2024.2.2-py3-none-any.whl (163 kB)
[pip-install 2024-02-13T19:45:32.459Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.8/163.8 kB 3.9 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:32.480Z] Collecting chardet==5.2.0
[pip-install 2024-02-13T19:45:32.515Z]   Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[pip-install 2024-02-13T19:45:32.528Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 17.2 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:32.674Z] Collecting charset-normalizer==3.3.2
[pip-install 2024-02-13T19:45:32.710Z]   Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
[pip-install 2024-02-13T19:45:32.719Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.3/140.3 kB 23.2 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:32.752Z] Collecting click==8.1.7
[pip-install 2024-02-13T19:45:32.788Z]   Downloading click-8.1.7-py3-none-any.whl (97 kB)
[pip-install 2024-02-13T19:45:32.793Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 27.3 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:32.820Z] Collecting cookiecutter==2.5.0
[pip-install 2024-02-13T19:45:32.855Z]   Downloading cookiecutter-2.5.0-py3-none-any.whl (39 kB)
[pip-install 2024-02-13T19:45:32.878Z] Collecting giturlparse==0.12.0
[pip-install 2024-02-13T19:45:32.914Z]   Downloading giturlparse-0.12.0-py2.py3-none-any.whl (15 kB)
[pip-install 2024-02-13T19:45:32.940Z] Collecting idna==3.6
[pip-install 2024-02-13T19:45:32.977Z]   Downloading idna-3.6-py3-none-any.whl (61 kB)
[pip-install 2024-02-13T19:45:32.982Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 kB 28.7 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.010Z] Collecting jinja2==3.1.3
[pip-install 2024-02-13T19:45:33.045Z]   Downloading Jinja2-3.1.3-py3-none-any.whl (133 kB)
[pip-install 2024-02-13T19:45:33.053Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.2/133.2 kB 28.8 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.074Z] Collecting json-e==4.6.0
[pip-install 2024-02-13T19:45:33.110Z]   Downloading json_e-4.6.0-py3-none-any.whl (13 kB)
[pip-install 2024-02-13T19:45:33.145Z] Collecting markdown-it-py==3.0.0
[pip-install 2024-02-13T19:45:33.180Z]   Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[pip-install 2024-02-13T19:45:33.185Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 35.4 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.274Z] Collecting markupsafe==2.1.5
[pip-install 2024-02-13T19:45:33.309Z]   Downloading MarkupSafe-2.1.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (28 kB)
[pip-install 2024-02-13T19:45:33.332Z] Collecting mdurl==0.1.2
[pip-install 2024-02-13T19:45:33.366Z]   Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[pip-install 2024-02-13T19:45:33.370Z] Requirement already satisfied: mozilla-repo-urls==0.1.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 213)) (0.1.1)
[pip-install 2024-02-13T19:45:33.407Z] Collecting pygments==2.17.2
[pip-install 2024-02-13T19:45:33.442Z]   Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
[pip-install 2024-02-13T19:45:33.499Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 21.3 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.507Z] Requirement already satisfied: python-dateutil==2.8.2 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 221)) (2.8.2)
[pip-install 2024-02-13T19:45:33.534Z] Collecting python-slugify==8.0.4
[pip-install 2024-02-13T19:45:33.570Z]   Downloading python_slugify-8.0.4-py2.py3-none-any.whl (10 kB)
[pip-install 2024-02-13T19:45:33.632Z] Collecting pyyaml==6.0.1
[pip-install 2024-02-13T19:45:33.670Z]   Downloading PyYAML-6.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (757 kB)
[pip-install 2024-02-13T19:45:33.682Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 757.7/757.7 kB 94.8 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.687Z] Requirement already satisfied: redo==2.0.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 284)) (2.0.4)
[pip-install 2024-02-13T19:45:33.688Z] Requirement already satisfied: requests==2.31.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 288)) (2.31.0)
[pip-install 2024-02-13T19:45:33.777Z] Collecting rich==13.7.0
[pip-install 2024-02-13T19:45:33.812Z]   Downloading rich-13.7.0-py3-none-any.whl (240 kB)
[pip-install 2024-02-13T19:45:33.819Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 74.5 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.825Z] Requirement already satisfied: six==1.16.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 298)) (1.16.0)
[pip-install 2024-02-13T19:45:33.826Z] Requirement already satisfied: slugid==2.0.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 302)) (2.0.0)
[pip-install 2024-02-13T19:45:33.859Z] Collecting taskcluster-taskgraph==7.3.0
[pip-install 2024-02-13T19:45:33.912Z]   Downloading taskcluster_taskgraph-7.3.0-py3-none-any.whl (188 kB)
[pip-install 2024-02-13T19:45:33.917Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 188.8/188.8 kB 69.8 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.921Z] Requirement already satisfied: taskcluster-urls==13.0.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 310)) (13.0.1)
[pip-install 2024-02-13T19:45:33.923Z] Requirement already satisfied: text-unidecode==1.3 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 315)) (1.3)
[pip-install 2024-02-13T19:45:33.950Z] Collecting types-python-dateutil==2.8.19.20240106
[pip-install 2024-02-13T19:45:33.985Z]   Downloading types_python_dateutil-2.8.19.20240106-py3-none-any.whl (9.7 kB)
[pip-install 2024-02-13T19:45:34.037Z] Collecting urllib3==2.2.0
[pip-install 2024-02-13T19:45:34.073Z]   Downloading urllib3-2.2.0-py3-none-any.whl (120 kB)
[pip-install 2024-02-13T19:45:34.077Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.9/120.9 kB 57.1 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:34.102Z] Collecting voluptuous==0.14.2
[pip-install 2024-02-13T19:45:34.137Z]   Downloading voluptuous-0.14.2-py3-none-any.whl (31 kB)
[pip-install 2024-02-13T19:45:34.510Z] Installing collected packages: json-e, voluptuous, urllib3, types-python-dateutil, pyyaml, python-slugify, pygments, mdurl, markupsafe, idna, giturlparse, click, charset-normalizer, chardet, certifi, markdown-it-py, jinja2, arrow, rich, cookiecutter, taskcluster-taskgraph
[pip-install 2024-02-13T19:45:34.661Z]   WARNING: The script slugify is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:34.661Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:35.224Z]   WARNING: The script pygmentize is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:35.225Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:35.403Z]   WARNING: The script normalizer is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:35.404Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:35.560Z]   WARNING: The script chardetect is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:35.560Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:35.621Z]   WARNING: The script markdown-it is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:35.621Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:35.904Z]   WARNING: The script cookiecutter is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:35.904Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:35.988Z]   WARNING: The script taskgraph is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:35.988Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:36.051Z] Successfully installed arrow-1.3.0 certifi-2024.2.2 chardet-5.2.0 charset-normalizer-3.3.2 click-8.1.7 cookiecutter-2.5.0 giturlparse-0.12.0 idna-3.6 jinja2-3.1.3 json-e-4.6.0 markdown-it-py-3.0.0 markupsafe-2.1.5 mdurl-0.1.2 pygments-2.17.2 python-slugify-8.0.4 pyyaml-6.0.1 rich-13.7.0 taskcluster-taskgraph-7.3.0 types-python-dateutil-2.8.19.20240106 urllib3-2.2.0 voluptuous-0.14.2
[task 2024-02-13T19:45:36.138Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='4a5fc1f8c7145f08f07d1a5454ff58fae1ea412a' --head-repository='https://github.com/bhearsum/firefox-translations-training' --head-ref='start-specific' --head-rev='37fbf272d7eb316897377144111a3ef057becfd4' \n"]
[task 2024-02-13T19:45:36.140Z] + cd /builds/worker/checkouts/src
[task 2024-02-13T19:45:36.140Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-02-13T19:45:36.141Z] + /builds/worker/.local/bin/taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/firefox-translations-training --base-ref=main --base-rev=4a5fc1f8c7145f08f07d1a5454ff58fae1ea412a --head-repository=https://github.com/bhearsum/firefox-translations-training --head-ref=start-specific --head-rev=37fbf272d7eb316897377144111a3ef057becfd4
[task 2024-02-13T19:45:36.353Z] 2024-02-13 19:45:36,352 - INFO - Loading graph configuration.
[task 2024-02-13T19:45:36.372Z] 2024-02-13 19:45:36,372 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /builds/worker/.local/lib/python3.11/site-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-02-13T19:45:36.373Z] 2024-02-13 19:45:36,373 - INFO - Using Parameters(id=a0d8b3e83544) (from defaults)
[task 2024-02-13T19:45:36.375Z] 2024-02-13 19:45:36,375 - INFO - writing artifact file `parameters.yml`
[task 2024-02-13T19:45:36.382Z] 2024-02-13 19:45:36,382 - INFO - writing artifact file `actions.json`
[task 2024-02-13T19:45:36.383Z] 2024-02-13 19:45:36,383 - INFO - Loading kinds
[task 2024-02-13T19:45:36.619Z] 2024-02-13 19:45:36,619 - INFO - Generating full task set
[task 2024-02-13T19:45:36.643Z] 2024-02-13 19:45:36,643 - INFO - Generated 7 tasks for kind dataset
[task 2024-02-13T19:45:36.644Z] 2024-02-13 19:45:36,644 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-02-13T19:45:36.661Z] 2024-02-13 19:45:36,661 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-02-13T19:45:36.662Z] 2024-02-13 19:45:36,661 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-02-13T19:45:36.663Z] 2024-02-13 19:45:36,662 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-02-13T19:45:36.680Z] 2024-02-13 19:45:36,680 - INFO - Generated 4 tasks for kind docker-image
[task 2024-02-13T19:45:36.694Z] 2024-02-13 19:45:36,694 - INFO - Generated 9 tasks for kind fetch
[task 2024-02-13T19:45:36.697Z] 2024-02-13 19:45:36,697 - INFO - Generated 5 tasks for kind tests
[task 2024-02-13T19:45:36.747Z] 2024-02-13 19:45:36,747 - INFO - Generated 9 tasks for kind toolchain
[task 2024-02-13T19:45:36.750Z] 2024-02-13 19:45:36,750 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-02-13T19:45:36.754Z] 2024-02-13 19:45:36,753 - INFO - Generated 2 tasks for kind clean-corpus
[task 2024-02-13T19:45:36.757Z] 2024-02-13 19:45:36,757 - INFO - Generated 2 tasks for kind bicleaner
[task 2024-02-13T19:45:36.760Z] 2024-02-13 19:45:36,760 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-02-13T19:45:36.765Z] 2024-02-13 19:45:36,765 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-02-13T19:45:36.768Z] 2024-02-13 19:45:36,768 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-02-13T19:45:36.770Z] 2024-02-13 19:45:36,770 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-02-13T19:45:36.773Z] 2024-02-13 19:45:36,773 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-02-13T19:45:36.775Z] 2024-02-13 19:45:36,775 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-02-13T19:45:36.790Z] 2024-02-13 19:45:36,790 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-02-13T19:45:36.793Z] 2024-02-13 19:45:36,793 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-02-13T19:45:36.795Z] 2024-02-13 19:45:36,795 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-02-13T19:45:36.800Z] 2024-02-13 19:45:36,800 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-02-13T19:45:36.803Z] 2024-02-13 19:45:36,803 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-02-13T19:45:36.806Z] 2024-02-13 19:45:36,806 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-02-13T19:45:36.810Z] 2024-02-13 19:45:36,810 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-02-13T19:45:36.813Z] 2024-02-13 19:45:36,813 - INFO - Generated 2 tasks for kind extract-best
[task 2024-02-13T19:45:36.817Z] 2024-02-13 19:45:36,817 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-02-13T19:45:36.819Z] 2024-02-13 19:45:36,819 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-02-13T19:45:36.822Z] 2024-02-13 19:45:36,822 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-02-13T19:45:36.824Z] 2024-02-13 19:45:36,824 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-02-13T19:45:36.827Z] 2024-02-13 19:45:36,827 - INFO - Generated 1 tasks for kind score
[task 2024-02-13T19:45:36.829Z] 2024-02-13 19:45:36,829 - INFO - Generated 1 tasks for kind cefilter
[task 2024-02-13T19:45:36.831Z] 2024-02-13 19:45:36,831 - INFO - Generated 1 tasks for kind alignments
[task 2024-02-13T19:45:36.834Z] 2024-02-13 19:45:36,834 - INFO - Generated 1 tasks for kind train-student
[task 2024-02-13T19:45:36.836Z] 2024-02-13 19:45:36,836 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-02-13T19:45:36.839Z] 2024-02-13 19:45:36,839 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-02-13T19:45:36.841Z] 2024-02-13 19:45:36,841 - INFO - Generated 1 tasks for kind quantize
[task 2024-02-13T19:45:36.844Z] 2024-02-13 19:45:36,844 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-02-13T19:45:36.849Z] 2024-02-13 19:45:36,849 - INFO - Generated 4 tasks for kind evaluate
[task 2024-02-13T19:45:36.851Z] 2024-02-13 19:45:36,851 - INFO - Generated 1 tasks for kind export
[task 2024-02-13T19:45:36.853Z] 2024-02-13 19:45:36,853 - INFO - Generated 1 tasks for kind all
[task 2024-02-13T19:45:36.856Z] 2024-02-13 19:45:36,856 - INFO - Generated 1 tasks for kind all-pr
[task 2024-02-13T19:45:36.857Z] 2024-02-13 19:45:36,856 - INFO - Generating full task graph
[task 2024-02-13T19:45:36.858Z] 2024-02-13 19:45:36,856 - INFO - Full task graph contains 78 tasks and 216 dependencies
[task 2024-02-13T19:45:36.861Z] 2024-02-13 19:45:36,861 - INFO - writing artifact file `full-task-graph.json`
[task 2024-02-13T19:45:36.876Z] 2024-02-13 19:45:36,876 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-02-13T19:45:36.878Z] 2024-02-13 19:45:36,877 - INFO - Generating target task set
[task 2024-02-13T19:45:36.879Z] 2024-02-13 19:45:36,878 - INFO - Filter filter_target_tasks pruned 63 tasks (15 remain)
[task 2024-02-13T19:45:36.880Z] 2024-02-13 19:45:36,878 - INFO - writing artifact file `target-tasks.json`
[task 2024-02-13T19:45:36.880Z] 2024-02-13 19:45:36,878 - INFO - Generating target task graph
[task 2024-02-13T19:45:36.881Z] 2024-02-13 19:45:36,878 - INFO - Adding 4 tasks with `always_target` attribute
[task 2024-02-13T19:45:36.881Z] 2024-02-13 19:45:36,879 - INFO - Generating optimized task graph
[task 2024-02-13T19:45:36.882Z] 2024-02-13 19:45:36,881 - INFO - No tasks removed during optimization
[task 2024-02-13T19:45:37.311Z] 2024-02-13 19:45:37,311 - INFO - No tasks replaced during optimization
[task 2024-02-13T19:45:37.319Z] 2024-02-13 19:45:37,319 - INFO - writing artifact file `task-graph.json`
[task 2024-02-13T19:45:37.334Z] 2024-02-13 19:45:37,334 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-02-13T19:45:37.336Z] 2024-02-13 19:45:37,336 - INFO - Creating task with taskId VONvprkzQrq8zK50bnUWUA for build-docker-image-base
[task 2024-02-13T19:45:37.439Z] 2024-02-13 19:45:37,439 - INFO - Creating task with taskId F-_6ywUIRG25dUwlWmJY8A for tests-taskgraph-diff
[task 2024-02-13T19:45:37.441Z] 2024-02-13 19:45:37,440 - INFO - Creating task with taskId dWev7weFSYywGRhfixijtw for fetch-preprocess
[task 2024-02-13T19:45:37.444Z] 2024-02-13 19:45:37,444 - INFO - Creating task with taskId KTThW1rRQEWlZgGQ0sWCPQ for build-docker-image-toolchain-build
[task 2024-02-13T19:45:37.446Z] 2024-02-13 19:45:37,445 - INFO - Creating task with taskId Gudb01f2QISFkQNad5U_NA for build-docker-image-train
[task 2024-02-13T19:45:37.447Z] 2024-02-13 19:45:37,447 - INFO - Creating task with taskId JL9XbHeARfW0Af8aQ61MTQ for fetch-cuda
[task 2024-02-13T19:45:37.449Z] 2024-02-13 19:45:37,448 - INFO - Creating task with taskId H7GnTChEQb-toekV7HH-Bg for fetch-kenlm
[task 2024-02-13T19:45:37.450Z] 2024-02-13 19:45:37,448 - INFO - Creating task with taskId Zhm1VlLMTU-9WSIgQnqzdA for fetch-extract-lex
[task 2024-02-13T19:45:37.451Z] 2024-02-13 19:45:37,450 - INFO - Creating task with taskId UDrF3vXISZWcl3tsNXz-jA for fetch-fast-align
[task 2024-02-13T19:45:37.454Z] 2024-02-13 19:45:37,451 - INFO - Creating task with taskId ZpVLg4koSUSfhl8-Hv-LtQ for fetch-cuda-11
[task 2024-02-13T19:45:37.458Z] 2024-02-13 19:45:37,457 - INFO - Creating task with taskId axu8fa76TrevTwtokkEbIg for fetch-hunspell
[task 2024-02-13T19:45:37.460Z] 2024-02-13 19:45:37,460 - INFO - Creating task with taskId DdSPzJQtQY-5r87JCzGxdw for fetch-browsermt-marian
[task 2024-02-13T19:45:37.461Z] 2024-02-13 19:45:37,460 - INFO - Creating task with taskId CXcnp0qgTgy_kJ_dhAR3Kw for build-docker-image-test
[task 2024-02-13T19:45:37.462Z] 2024-02-13 19:45:37,461 - INFO - Creating task with taskId SeMN1MlvQXOmIciXa0J8kQ for fetch-marian
[task 2024-02-13T19:45:37.464Z] 2024-02-13 19:45:37,462 - INFO - Creating task with taskId Jlh5tUepQUK9kj6PfIstmg for tests-taskgraph-definition
[task 2024-02-13T19:45:37.537Z] 2024-02-13 19:45:37,537 - INFO - Creating task with taskId PZ0aWkVaQ7i15XftLSNtfA for dataset-sacrebleu-aug-mix_wmt19-ru-en
[task 2024-02-13T19:45:37.539Z] 2024-02-13 19:45:37,537 - INFO - Creating task with taskId M6gd0cTGT7-RejWr1iaI5A for dataset-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-02-13T19:45:37.541Z] 2024-02-13 19:45:37,540 - INFO - Creating task with taskId Q1moHftDRT-gY1hlNpRm9A for toolchain-cuda-toolkit-11
[task 2024-02-13T19:45:37.544Z] 2024-02-13 19:45:37,540 - INFO - Creating task with taskId bqNTthVBTSS0un1EjVRclQ for dataset-news-crawl-news_2008-ru
[task 2024-02-13T19:45:37.548Z] 2024-02-13 19:45:37,541 - INFO - Creating task with taskId REKgFXLrT6CIU704yzczpA for toolchain-preprocess
[task 2024-02-13T19:45:37.549Z] 2024-02-13 19:45:37,541 - INFO - Creating task with taskId Y5bcTyJsTlWoVuOWixennQ for dataset-opus-ada83_v1-ru-en
[task 2024-02-13T19:45:37.551Z] 2024-02-13 19:45:37,541 - INFO - Creating task with taskId KslRYRyMQteZcYvghH1s6g for dataset-flores-devtest-ru-en
[task 2024-02-13T19:45:37.554Z] 2024-02-13 19:45:37,542 - INFO - Creating task with taskId X8Xz_g3xRbyfqD3EwWI2Eg for dataset-news-crawl-news_2007-en
[task 2024-02-13T19:45:37.555Z] 2024-02-13 19:45:37,542 - INFO - Creating task with taskId NgfWAG6bRF6K-Ug3qCOGdg for dataset-flores-dev-ru-en
[task 2024-02-13T19:45:37.558Z] 2024-02-13 19:45:37,543 - INFO - Creating task with taskId Rs12st1TRtaaD0cSifgotw for toolchain-kenlm
[task 2024-02-13T19:45:37.620Z] 2024-02-13 19:45:37,620 - INFO - Creating task with taskId eltT5P8xQ6ix8qlBspE02Q for toolchain-hunspell
[task 2024-02-13T19:45:37.621Z] 2024-02-13 19:45:37,620 - INFO - Creating task with taskId f0mencplSO6OZKRpNtNZkw for toolchain-cuda-toolkit
[task 2024-02-13T19:45:37.623Z] 2024-02-13 19:45:37,623 - INFO - Creating task with taskId TLWFSUpvSqau9NyZEd7Yvg for tests-black
[task 2024-02-13T19:45:37.626Z] 2024-02-13 19:45:37,625 - INFO - Creating task with taskId de7HiazMToeJ5rs1P6VFrg for toolchain-fast-align
[task 2024-02-13T19:45:37.627Z] 2024-02-13 19:45:37,626 - INFO - Creating task with taskId XP7-72PVRYqwkSyrtrOQ2w for toolchain-extract-lex
[task 2024-02-13T19:45:37.629Z] 2024-02-13 19:45:37,627 - INFO - Creating task with taskId TPbc5V6JRKmcKZ7h7z8GfQ for tests-lint
[task 2024-02-13T19:45:37.631Z] 2024-02-13 19:45:37,628 - INFO - Creating task with taskId dAowqb2_TY-JI9GGuiQQCg for tests-test
[task 2024-02-13T19:45:37.704Z] 2024-02-13 19:45:37,704 - INFO - Creating task with taskId GO7xaBngTtaTphO5cOHpuw for clean-mono-news-crawl-ru-news_2008-mono-src
[task 2024-02-13T19:45:37.706Z] 2024-02-13 19:45:37,706 - INFO - Creating task with taskId GAMEfBWcRW6akGMKLMeQ0g for clean-corpus-opus-ada83_v1-ru-en
[task 2024-02-13T19:45:37.706Z] 2024-02-13 19:45:37,706 - INFO - Creating task with taskId fsUeMEKbRtWYo-affmIMbw for clean-corpus-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-02-13T19:45:37.710Z] 2024-02-13 19:45:37,710 - INFO - Creating task with taskId Ai7Mm3H6Q3SRbQ3z8CcPFw for merge-devset-ru-en
[task 2024-02-13T19:45:37.713Z] 2024-02-13 19:45:37,712 - INFO - Creating task with taskId NWMXxii2QqKLBYpVCtTUeA for clean-mono-news-crawl-en-news_2007-mono-trg
[task 2024-02-13T19:45:37.789Z] 2024-02-13 19:45:37,789 - INFO - Creating task with taskId T3__QjU9S_6CNOG1hWpSBw for toolchain-marian
[task 2024-02-13T19:45:37.792Z] 2024-02-13 19:45:37,791 - INFO - Creating task with taskId Tk19QR_0RoK-5LqBb3t9Pw for toolchain-browsermt-marian
[task 2024-02-13T19:45:37.794Z] 2024-02-13 19:45:37,794 - INFO - Creating task with taskId VhDf3Ew3RDmmhwqSOhav5Q for bicleaner-model-ru-en
[task 2024-02-13T19:45:37.879Z] 2024-02-13 19:45:37,878 - INFO - Creating task with taskId EgKyq3SpRDe1QDjywQJWXg for merge-mono-src-ru
[task 2024-02-13T19:45:37.881Z] 2024-02-13 19:45:37,881 - INFO - Creating task with taskId GtMTCD5dQz28YwNGj7DH9w for merge-mono-trg-en
[task 2024-02-13T19:45:37.997Z] 2024-02-13 19:45:37,997 - INFO - Creating task with taskId A4aqLg1fQaCAqdWkvO_58A for bicleaner-ai-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-02-13T19:45:37.999Z] 2024-02-13 19:45:37,997 - INFO - Creating task with taskId OkKNl-DSQsG4DD7SPqfoOQ for bicleaner-ai-opus-ada83_v1-ru-en
[task 2024-02-13T19:45:38.000Z] 2024-02-13 19:45:38,000 - INFO - Creating task with taskId ZgK_HZGBRq-hphBIWMeCAw for split-mono-src-ru
[task 2024-02-13T19:45:38.086Z] 2024-02-13 19:45:38,085 - INFO - Creating task with taskId ZYQFWLmKRF6IF1rRL3Bv9w for split-mono-trg-en
[task 2024-02-13T19:45:38.170Z] 2024-02-13 19:45:38,169 - INFO - Creating task with taskId cn6F16ilQdK7c1uRyCRvMA for merge-corpus-ru-en
[task 2024-02-13T19:45:38.268Z] 2024-02-13 19:45:38,268 - INFO - Creating task with taskId TlabNfGbRwGTNQcjW08etw for split-corpus-ru-en
[task 2024-02-13T19:45:38.270Z] 2024-02-13 19:45:38,270 - INFO - Creating task with taskId cDF3ROWYRleLBlKERefCqg for train-vocab-ru-en
[task 2024-02-13T19:45:38.385Z] 2024-02-13 19:45:38,385 - INFO - Creating task with taskId R8J7M8J4TqyJz4l0dFYwow for train-backwards-ru-en
[task 2024-02-13T19:45:38.478Z] 2024-02-13 19:45:38,478 - INFO - Creating task with taskId LghACDK6QqKpNzcyxYKslg for translate-mono-trg-ru-en-2/2
[task 2024-02-13T19:45:38.480Z] 2024-02-13 19:45:38,479 - INFO - Creating task with taskId M4dYNC8QT9SpqWpFNd7v_A for translate-mono-trg-ru-en-1/2
[task 2024-02-13T19:45:38.481Z] 2024-02-13 19:45:38,479 - INFO - Creating task with taskId A7TdziLxTxyFk_vsC0KUSA for evaluate-backward-flores-devtest-ru-en
[task 2024-02-13T19:45:38.593Z] 2024-02-13 19:45:38,593 - INFO - Creating task with taskId HkXlEbJ5R8-3YcpAaYJt_Q for collect-mono-trg-ru-en
[task 2024-02-13T19:45:38.690Z] 2024-02-13 19:45:38,690 - INFO - Creating task with taskId OU_o34F0RJq7NPMeGMOJew for train-teacher-ru-en-1/1
[task 2024-02-13T19:45:38.816Z] 2024-02-13 19:45:38,816 - INFO - Creating task with taskId ZSAxIQw8Td2N7Y96O3Fhkg for evaluate-teacher-flores-flores_devtest-ru-en-1/1
[task 2024-02-13T19:45:38.819Z] 2024-02-13 19:45:38,818 - INFO - Creating task with taskId ISSQpKG_QumHMVJS3v1caQ for evaluate-teacher-ensemble-flores-flores_devtest-ru-en
[task 2024-02-13T19:45:38.821Z] 2024-02-13 19:45:38,820 - INFO - Creating task with taskId QddrxP13Rt6sf6W4N84GzQ for translate-corpus-ru-en-2/2
[task 2024-02-13T19:45:38.823Z] 2024-02-13 19:45:38,822 - INFO - Creating task with taskId b0FIRywYQ7STYHVYprm58Q for translate-mono-src-ru-en-2/2
[task 2024-02-13T19:45:38.823Z] 2024-02-13 19:45:38,823 - INFO - Creating task with taskId JOzUfFSdTGKRpg-9jHDU7Q for translate-mono-src-ru-en-1/2
[task 2024-02-13T19:45:38.827Z] 2024-02-13 19:45:38,826 - INFO - Creating task with taskId Ix9gUxTrQNOvRCVbsUjktQ for translate-corpus-ru-en-1/2
[task 2024-02-13T19:45:38.940Z] 2024-02-13 19:45:38,939 - INFO - Creating task with taskId cvJ2s6JUQq2zCEZdhcPREQ for extract-best-ru-en-1/2
[task 2024-02-13T19:45:39.039Z] 2024-02-13 19:45:39,039 - INFO - Creating task with taskId IfddEhLmRNG1ccEFPQDAHw for collect-mono-src-ru-en
[task 2024-02-13T19:45:39.039Z] 2024-02-13 19:45:39,039 - INFO - Creating task with taskId d9rpYGBZRN21bFCnZcOKfw for extract-best-ru-en-2/2
[task 2024-02-13T19:45:39.141Z] 2024-02-13 19:45:39,141 - INFO - Creating task with taskId QCUM3_UkSYSE7GKxgDub1g for collect-corpus-ru-en
[task 2024-02-13T19:45:39.234Z] 2024-02-13 19:45:39,234 - INFO - Creating task with taskId JSyYgZFeQyeyKuQ85SKThA for merge-translated-ru-en
[task 2024-02-13T19:45:39.372Z] 2024-02-13 19:45:39,371 - INFO - Creating task with taskId GFvVAjOTQ0CagGT66TeNSw for score-ru-en
[task 2024-02-13T19:45:39.495Z] 2024-02-13 19:45:39,495 - INFO - Creating task with taskId MfrUmjRUR9OIFFX3y_brMA for cefilter-ru-en
[task 2024-02-13T19:45:39.610Z] 2024-02-13 19:45:39,609 - INFO - Creating task with taskId JjGclcJ9QE6c53LY8sVjMg for alignments-ru-en
[task 2024-02-13T19:45:39.751Z] 2024-02-13 19:45:39,751 - INFO - Creating task with taskId YIukC5EGQY2YkdIqMzAtaQ for train-student-ru-en
[task 2024-02-13T19:45:39.887Z] 2024-02-13 19:45:39,887 - INFO - Creating task with taskId RQnI_71QSPmynKAEsMl_Qw for finetune-student-ru-en
[task 2024-02-13T19:45:39.888Z] 2024-02-13 19:45:39,887 - INFO - Creating task with taskId BJd3tCBqRmGbFNvxbJJN2g for evaluate-student-flores-devtest-ru-en
[task 2024-02-13T19:45:40.010Z] 2024-02-13 19:45:40,010 - INFO - Creating task with taskId LqSk6LAfTPOCJsFH_fTd4w for quantize-ru-en
[task 2024-02-13T19:45:40.012Z] 2024-02-13 19:45:40,011 - INFO - Creating task with taskId OBqsRUK9Ti6R8GtYHNfcVw for evaluate-finetuned-student-flores-devtest-ru-en
[task 2024-02-13T19:45:40.236Z] 2024-02-13 19:45:40,236 - INFO - Creating task with taskId VrvBg3GPSwC-kkv76rtCqQ for export-ru-en
[task 2024-02-13T19:45:40.238Z] 2024-02-13 19:45:40,236 - INFO - Creating task with taskId AWIdhK8XSFagronE2Lhh0A for evaluate-quantized-flores-devtest-ru-en
[task 2024-02-13T19:45:40.800Z] 2024-02-13 19:45:40,800 - INFO - Creating task with taskId R3YmIvC4TLqqr84NrjKjZg for all-pr-ru-en-1
[taskcluster 2024-02-13 19:45:41.213Z] === Task Finished ===
[taskcluster 2024-02-13 19:45:43.249Z] Successful task run with exit code: 0 completed in 13.286 seconds