Add the ability to run starting from a specific task (fixes #227) #377
firefoxci-taskcluster / Decision Task (pull-request)
succeeded
Feb 13, 2024 in 17s
FirefoxCI (pull_request)
The task that creates all of the other tasks in the task graph
Details
View task in Taskcluster
View logs in Taskcluster
[vcs 2024-02-13T19:45:31.618Z] From https://github.com/bhearsum/firefox-translations-training
[vcs 2024-02-13T19:45:31.618Z] * branch start-specific -> FETCH_HEAD
[vcs 2024-02-13T19:45:31.621Z] executing ['git', 'checkout', '-f', '-B', 'start-specific', '37fbf272d7eb316897377144111a3ef057becfd4']
[vcs 2024-02-13T19:45:31.628Z] Switched to and reset branch 'start-specific'
[vcs 2024-02-13T19:45:31.628Z] Your branch and 'origin/start-specific' have diverged,
[vcs 2024-02-13T19:45:31.628Z] and have 2 and 1 different commits each, respectively.
[vcs 2024-02-13T19:45:31.628Z] (use "git pull" to merge the remote branch into yours)
[vcs 2024-02-13T19:45:31.629Z] executing ['git', 'submodule', 'init']
[vcs 2024-02-13T19:45:31.646Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-02-13T19:45:31.675Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-02-13T19:45:31.681Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-02-13T19:45:31.686Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-02-13T19:45:31.694Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-02-13T19:45:31.703Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-02-13T19:45:31.709Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-02-13T19:45:31.710Z] cleaning git checkout...
[vcs 2024-02-13T19:45:31.710Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-02-13T19:45:31.714Z] removing ['/builds/worker/checkouts/src/artifacts', '/builds/worker/checkouts/src/docker-contexts/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/actions/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/transforms/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/util/__pycache__/']
[vcs 2024-02-13T19:45:31.715Z] successfully cleaned git checkout!
[vcs 2024-02-13T19:45:31.718Z] TinderboxPrint:<a href='https://github.com/bhearsum/firefox-translations-training/commit/37fbf272d7eb316897377144111a3ef057becfd4' title='Built from firefox-translations-training commit 37fbf272d7eb316897377144111a3ef057becfd4'>37fbf272d7eb316897377144111a3ef057becfd4</a>
[pip-install 2024-02-13T19:45:31.718Z] executing ['/usr/bin/python3', '-mpip', 'install', '--break-system-packages', '--require-hashes', '-r', '/builds/worker/checkouts/src/taskcluster/requirements.txt']
[pip-install 2024-02-13T19:45:31.983Z] Defaulting to user installation because normal site-packages is not writeable
[pip-install 2024-02-13T19:45:32.071Z] Requirement already satisfied: appdirs==1.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 7)) (1.4.4)
[pip-install 2024-02-13T19:45:32.160Z] Collecting arrow==1.3.0
[pip-install 2024-02-13T19:45:32.303Z] Downloading arrow-1.3.0-py3-none-any.whl (66 kB)
[pip-install 2024-02-13T19:45:32.347Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 kB 1.5 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:32.351Z] Requirement already satisfied: binaryornot==0.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 15)) (0.4.4)
[pip-install 2024-02-13T19:45:32.382Z] Collecting certifi==2024.2.2
[pip-install 2024-02-13T19:45:32.417Z] Downloading certifi-2024.2.2-py3-none-any.whl (163 kB)
[pip-install 2024-02-13T19:45:32.459Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.8/163.8 kB 3.9 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:32.480Z] Collecting chardet==5.2.0
[pip-install 2024-02-13T19:45:32.515Z] Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[pip-install 2024-02-13T19:45:32.528Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 17.2 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:32.674Z] Collecting charset-normalizer==3.3.2
[pip-install 2024-02-13T19:45:32.710Z] Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
[pip-install 2024-02-13T19:45:32.719Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.3/140.3 kB 23.2 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:32.752Z] Collecting click==8.1.7
[pip-install 2024-02-13T19:45:32.788Z] Downloading click-8.1.7-py3-none-any.whl (97 kB)
[pip-install 2024-02-13T19:45:32.793Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 27.3 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:32.820Z] Collecting cookiecutter==2.5.0
[pip-install 2024-02-13T19:45:32.855Z] Downloading cookiecutter-2.5.0-py3-none-any.whl (39 kB)
[pip-install 2024-02-13T19:45:32.878Z] Collecting giturlparse==0.12.0
[pip-install 2024-02-13T19:45:32.914Z] Downloading giturlparse-0.12.0-py2.py3-none-any.whl (15 kB)
[pip-install 2024-02-13T19:45:32.940Z] Collecting idna==3.6
[pip-install 2024-02-13T19:45:32.977Z] Downloading idna-3.6-py3-none-any.whl (61 kB)
[pip-install 2024-02-13T19:45:32.982Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 kB 28.7 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.010Z] Collecting jinja2==3.1.3
[pip-install 2024-02-13T19:45:33.045Z] Downloading Jinja2-3.1.3-py3-none-any.whl (133 kB)
[pip-install 2024-02-13T19:45:33.053Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.2/133.2 kB 28.8 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.074Z] Collecting json-e==4.6.0
[pip-install 2024-02-13T19:45:33.110Z] Downloading json_e-4.6.0-py3-none-any.whl (13 kB)
[pip-install 2024-02-13T19:45:33.145Z] Collecting markdown-it-py==3.0.0
[pip-install 2024-02-13T19:45:33.180Z] Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[pip-install 2024-02-13T19:45:33.185Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 35.4 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.274Z] Collecting markupsafe==2.1.5
[pip-install 2024-02-13T19:45:33.309Z] Downloading MarkupSafe-2.1.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (28 kB)
[pip-install 2024-02-13T19:45:33.332Z] Collecting mdurl==0.1.2
[pip-install 2024-02-13T19:45:33.366Z] Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[pip-install 2024-02-13T19:45:33.370Z] Requirement already satisfied: mozilla-repo-urls==0.1.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 213)) (0.1.1)
[pip-install 2024-02-13T19:45:33.407Z] Collecting pygments==2.17.2
[pip-install 2024-02-13T19:45:33.442Z] Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
[pip-install 2024-02-13T19:45:33.499Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 21.3 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.507Z] Requirement already satisfied: python-dateutil==2.8.2 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 221)) (2.8.2)
[pip-install 2024-02-13T19:45:33.534Z] Collecting python-slugify==8.0.4
[pip-install 2024-02-13T19:45:33.570Z] Downloading python_slugify-8.0.4-py2.py3-none-any.whl (10 kB)
[pip-install 2024-02-13T19:45:33.632Z] Collecting pyyaml==6.0.1
[pip-install 2024-02-13T19:45:33.670Z] Downloading PyYAML-6.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (757 kB)
[pip-install 2024-02-13T19:45:33.682Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 757.7/757.7 kB 94.8 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.687Z] Requirement already satisfied: redo==2.0.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 284)) (2.0.4)
[pip-install 2024-02-13T19:45:33.688Z] Requirement already satisfied: requests==2.31.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 288)) (2.31.0)
[pip-install 2024-02-13T19:45:33.777Z] Collecting rich==13.7.0
[pip-install 2024-02-13T19:45:33.812Z] Downloading rich-13.7.0-py3-none-any.whl (240 kB)
[pip-install 2024-02-13T19:45:33.819Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 74.5 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.825Z] Requirement already satisfied: six==1.16.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 298)) (1.16.0)
[pip-install 2024-02-13T19:45:33.826Z] Requirement already satisfied: slugid==2.0.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 302)) (2.0.0)
[pip-install 2024-02-13T19:45:33.859Z] Collecting taskcluster-taskgraph==7.3.0
[pip-install 2024-02-13T19:45:33.912Z] Downloading taskcluster_taskgraph-7.3.0-py3-none-any.whl (188 kB)
[pip-install 2024-02-13T19:45:33.917Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 188.8/188.8 kB 69.8 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:33.921Z] Requirement already satisfied: taskcluster-urls==13.0.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 310)) (13.0.1)
[pip-install 2024-02-13T19:45:33.923Z] Requirement already satisfied: text-unidecode==1.3 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 315)) (1.3)
[pip-install 2024-02-13T19:45:33.950Z] Collecting types-python-dateutil==2.8.19.20240106
[pip-install 2024-02-13T19:45:33.985Z] Downloading types_python_dateutil-2.8.19.20240106-py3-none-any.whl (9.7 kB)
[pip-install 2024-02-13T19:45:34.037Z] Collecting urllib3==2.2.0
[pip-install 2024-02-13T19:45:34.073Z] Downloading urllib3-2.2.0-py3-none-any.whl (120 kB)
[pip-install 2024-02-13T19:45:34.077Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.9/120.9 kB 57.1 MB/s eta 0:00:00
[pip-install 2024-02-13T19:45:34.102Z] Collecting voluptuous==0.14.2
[pip-install 2024-02-13T19:45:34.137Z] Downloading voluptuous-0.14.2-py3-none-any.whl (31 kB)
[pip-install 2024-02-13T19:45:34.510Z] Installing collected packages: json-e, voluptuous, urllib3, types-python-dateutil, pyyaml, python-slugify, pygments, mdurl, markupsafe, idna, giturlparse, click, charset-normalizer, chardet, certifi, markdown-it-py, jinja2, arrow, rich, cookiecutter, taskcluster-taskgraph
[pip-install 2024-02-13T19:45:34.661Z] WARNING: The script slugify is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:34.661Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:35.224Z] WARNING: The script pygmentize is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:35.225Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:35.403Z] WARNING: The script normalizer is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:35.404Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:35.560Z] WARNING: The script chardetect is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:35.560Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:35.621Z] WARNING: The script markdown-it is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:35.621Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:35.904Z] WARNING: The script cookiecutter is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:35.904Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:35.988Z] WARNING: The script taskgraph is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:45:35.988Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:45:36.051Z] Successfully installed arrow-1.3.0 certifi-2024.2.2 chardet-5.2.0 charset-normalizer-3.3.2 click-8.1.7 cookiecutter-2.5.0 giturlparse-0.12.0 idna-3.6 jinja2-3.1.3 json-e-4.6.0 markdown-it-py-3.0.0 markupsafe-2.1.5 mdurl-0.1.2 pygments-2.17.2 python-slugify-8.0.4 pyyaml-6.0.1 rich-13.7.0 taskcluster-taskgraph-7.3.0 types-python-dateutil-2.8.19.20240106 urllib3-2.2.0 voluptuous-0.14.2
[task 2024-02-13T19:45:36.138Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph decision --pushlog-id='0' --pushdate='0' --project='firefox-translations-training' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/firefox-translations-training' --base-ref='main' --base-rev='4a5fc1f8c7145f08f07d1a5454ff58fae1ea412a' --head-repository='https://github.com/bhearsum/firefox-translations-training' --head-ref='start-specific' --head-rev='37fbf272d7eb316897377144111a3ef057becfd4' \n"]
[task 2024-02-13T19:45:36.140Z] + cd /builds/worker/checkouts/src
[task 2024-02-13T19:45:36.140Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-02-13T19:45:36.141Z] + /builds/worker/.local/bin/taskgraph decision --pushlog-id=0 --pushdate=0 --project=firefox-translations-training [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/firefox-translations-training --base-ref=main --base-rev=4a5fc1f8c7145f08f07d1a5454ff58fae1ea412a --head-repository=https://github.com/bhearsum/firefox-translations-training --head-ref=start-specific --head-rev=37fbf272d7eb316897377144111a3ef057becfd4
[task 2024-02-13T19:45:36.353Z] 2024-02-13 19:45:36,352 - INFO - Loading graph configuration.
[task 2024-02-13T19:45:36.372Z] 2024-02-13 19:45:36,372 - WARNING - using default project parameters; add firefox-translations-training to PER_PROJECT_PARAMETERS in /builds/worker/.local/lib/python3.11/site-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-02-13T19:45:36.373Z] 2024-02-13 19:45:36,373 - INFO - Using Parameters(id=a0d8b3e83544) (from defaults)
[task 2024-02-13T19:45:36.375Z] 2024-02-13 19:45:36,375 - INFO - writing artifact file `parameters.yml`
[task 2024-02-13T19:45:36.382Z] 2024-02-13 19:45:36,382 - INFO - writing artifact file `actions.json`
[task 2024-02-13T19:45:36.383Z] 2024-02-13 19:45:36,383 - INFO - Loading kinds
[task 2024-02-13T19:45:36.619Z] 2024-02-13 19:45:36,619 - INFO - Generating full task set
[task 2024-02-13T19:45:36.643Z] 2024-02-13 19:45:36,643 - INFO - Generated 7 tasks for kind dataset
[task 2024-02-13T19:45:36.644Z] 2024-02-13 19:45:36,644 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-02-13T19:45:36.661Z] 2024-02-13 19:45:36,661 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-02-13T19:45:36.662Z] 2024-02-13 19:45:36,661 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-02-13T19:45:36.663Z] 2024-02-13 19:45:36,662 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-02-13T19:45:36.680Z] 2024-02-13 19:45:36,680 - INFO - Generated 4 tasks for kind docker-image
[task 2024-02-13T19:45:36.694Z] 2024-02-13 19:45:36,694 - INFO - Generated 9 tasks for kind fetch
[task 2024-02-13T19:45:36.697Z] 2024-02-13 19:45:36,697 - INFO - Generated 5 tasks for kind tests
[task 2024-02-13T19:45:36.747Z] 2024-02-13 19:45:36,747 - INFO - Generated 9 tasks for kind toolchain
[task 2024-02-13T19:45:36.750Z] 2024-02-13 19:45:36,750 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-02-13T19:45:36.754Z] 2024-02-13 19:45:36,753 - INFO - Generated 2 tasks for kind clean-corpus
[task 2024-02-13T19:45:36.757Z] 2024-02-13 19:45:36,757 - INFO - Generated 2 tasks for kind bicleaner
[task 2024-02-13T19:45:36.760Z] 2024-02-13 19:45:36,760 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-02-13T19:45:36.765Z] 2024-02-13 19:45:36,765 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-02-13T19:45:36.768Z] 2024-02-13 19:45:36,768 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-02-13T19:45:36.770Z] 2024-02-13 19:45:36,770 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-02-13T19:45:36.773Z] 2024-02-13 19:45:36,773 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-02-13T19:45:36.775Z] 2024-02-13 19:45:36,775 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-02-13T19:45:36.790Z] 2024-02-13 19:45:36,790 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-02-13T19:45:36.793Z] 2024-02-13 19:45:36,793 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-02-13T19:45:36.795Z] 2024-02-13 19:45:36,795 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-02-13T19:45:36.800Z] 2024-02-13 19:45:36,800 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-02-13T19:45:36.803Z] 2024-02-13 19:45:36,803 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-02-13T19:45:36.806Z] 2024-02-13 19:45:36,806 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-02-13T19:45:36.810Z] 2024-02-13 19:45:36,810 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-02-13T19:45:36.813Z] 2024-02-13 19:45:36,813 - INFO - Generated 2 tasks for kind extract-best
[task 2024-02-13T19:45:36.817Z] 2024-02-13 19:45:36,817 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-02-13T19:45:36.819Z] 2024-02-13 19:45:36,819 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-02-13T19:45:36.822Z] 2024-02-13 19:45:36,822 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-02-13T19:45:36.824Z] 2024-02-13 19:45:36,824 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-02-13T19:45:36.827Z] 2024-02-13 19:45:36,827 - INFO - Generated 1 tasks for kind score
[task 2024-02-13T19:45:36.829Z] 2024-02-13 19:45:36,829 - INFO - Generated 1 tasks for kind cefilter
[task 2024-02-13T19:45:36.831Z] 2024-02-13 19:45:36,831 - INFO - Generated 1 tasks for kind alignments
[task 2024-02-13T19:45:36.834Z] 2024-02-13 19:45:36,834 - INFO - Generated 1 tasks for kind train-student
[task 2024-02-13T19:45:36.836Z] 2024-02-13 19:45:36,836 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-02-13T19:45:36.839Z] 2024-02-13 19:45:36,839 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-02-13T19:45:36.841Z] 2024-02-13 19:45:36,841 - INFO - Generated 1 tasks for kind quantize
[task 2024-02-13T19:45:36.844Z] 2024-02-13 19:45:36,844 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-02-13T19:45:36.849Z] 2024-02-13 19:45:36,849 - INFO - Generated 4 tasks for kind evaluate
[task 2024-02-13T19:45:36.851Z] 2024-02-13 19:45:36,851 - INFO - Generated 1 tasks for kind export
[task 2024-02-13T19:45:36.853Z] 2024-02-13 19:45:36,853 - INFO - Generated 1 tasks for kind all
[task 2024-02-13T19:45:36.856Z] 2024-02-13 19:45:36,856 - INFO - Generated 1 tasks for kind all-pr
[task 2024-02-13T19:45:36.857Z] 2024-02-13 19:45:36,856 - INFO - Generating full task graph
[task 2024-02-13T19:45:36.858Z] 2024-02-13 19:45:36,856 - INFO - Full task graph contains 78 tasks and 216 dependencies
[task 2024-02-13T19:45:36.861Z] 2024-02-13 19:45:36,861 - INFO - writing artifact file `full-task-graph.json`
[task 2024-02-13T19:45:36.876Z] 2024-02-13 19:45:36,876 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-02-13T19:45:36.878Z] 2024-02-13 19:45:36,877 - INFO - Generating target task set
[task 2024-02-13T19:45:36.879Z] 2024-02-13 19:45:36,878 - INFO - Filter filter_target_tasks pruned 63 tasks (15 remain)
[task 2024-02-13T19:45:36.880Z] 2024-02-13 19:45:36,878 - INFO - writing artifact file `target-tasks.json`
[task 2024-02-13T19:45:36.880Z] 2024-02-13 19:45:36,878 - INFO - Generating target task graph
[task 2024-02-13T19:45:36.881Z] 2024-02-13 19:45:36,878 - INFO - Adding 4 tasks with `always_target` attribute
[task 2024-02-13T19:45:36.881Z] 2024-02-13 19:45:36,879 - INFO - Generating optimized task graph
[task 2024-02-13T19:45:36.882Z] 2024-02-13 19:45:36,881 - INFO - No tasks removed during optimization
[task 2024-02-13T19:45:37.311Z] 2024-02-13 19:45:37,311 - INFO - No tasks replaced during optimization
[task 2024-02-13T19:45:37.319Z] 2024-02-13 19:45:37,319 - INFO - writing artifact file `task-graph.json`
[task 2024-02-13T19:45:37.334Z] 2024-02-13 19:45:37,334 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-02-13T19:45:37.336Z] 2024-02-13 19:45:37,336 - INFO - Creating task with taskId VONvprkzQrq8zK50bnUWUA for build-docker-image-base
[task 2024-02-13T19:45:37.439Z] 2024-02-13 19:45:37,439 - INFO - Creating task with taskId F-_6ywUIRG25dUwlWmJY8A for tests-taskgraph-diff
[task 2024-02-13T19:45:37.441Z] 2024-02-13 19:45:37,440 - INFO - Creating task with taskId dWev7weFSYywGRhfixijtw for fetch-preprocess
[task 2024-02-13T19:45:37.444Z] 2024-02-13 19:45:37,444 - INFO - Creating task with taskId KTThW1rRQEWlZgGQ0sWCPQ for build-docker-image-toolchain-build
[task 2024-02-13T19:45:37.446Z] 2024-02-13 19:45:37,445 - INFO - Creating task with taskId Gudb01f2QISFkQNad5U_NA for build-docker-image-train
[task 2024-02-13T19:45:37.447Z] 2024-02-13 19:45:37,447 - INFO - Creating task with taskId JL9XbHeARfW0Af8aQ61MTQ for fetch-cuda
[task 2024-02-13T19:45:37.449Z] 2024-02-13 19:45:37,448 - INFO - Creating task with taskId H7GnTChEQb-toekV7HH-Bg for fetch-kenlm
[task 2024-02-13T19:45:37.450Z] 2024-02-13 19:45:37,448 - INFO - Creating task with taskId Zhm1VlLMTU-9WSIgQnqzdA for fetch-extract-lex
[task 2024-02-13T19:45:37.451Z] 2024-02-13 19:45:37,450 - INFO - Creating task with taskId UDrF3vXISZWcl3tsNXz-jA for fetch-fast-align
[task 2024-02-13T19:45:37.454Z] 2024-02-13 19:45:37,451 - INFO - Creating task with taskId ZpVLg4koSUSfhl8-Hv-LtQ for fetch-cuda-11
[task 2024-02-13T19:45:37.458Z] 2024-02-13 19:45:37,457 - INFO - Creating task with taskId axu8fa76TrevTwtokkEbIg for fetch-hunspell
[task 2024-02-13T19:45:37.460Z] 2024-02-13 19:45:37,460 - INFO - Creating task with taskId DdSPzJQtQY-5r87JCzGxdw for fetch-browsermt-marian
[task 2024-02-13T19:45:37.461Z] 2024-02-13 19:45:37,460 - INFO - Creating task with taskId CXcnp0qgTgy_kJ_dhAR3Kw for build-docker-image-test
[task 2024-02-13T19:45:37.462Z] 2024-02-13 19:45:37,461 - INFO - Creating task with taskId SeMN1MlvQXOmIciXa0J8kQ for fetch-marian
[task 2024-02-13T19:45:37.464Z] 2024-02-13 19:45:37,462 - INFO - Creating task with taskId Jlh5tUepQUK9kj6PfIstmg for tests-taskgraph-definition
[task 2024-02-13T19:45:37.537Z] 2024-02-13 19:45:37,537 - INFO - Creating task with taskId PZ0aWkVaQ7i15XftLSNtfA for dataset-sacrebleu-aug-mix_wmt19-ru-en
[task 2024-02-13T19:45:37.539Z] 2024-02-13 19:45:37,537 - INFO - Creating task with taskId M6gd0cTGT7-RejWr1iaI5A for dataset-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-02-13T19:45:37.541Z] 2024-02-13 19:45:37,540 - INFO - Creating task with taskId Q1moHftDRT-gY1hlNpRm9A for toolchain-cuda-toolkit-11
[task 2024-02-13T19:45:37.544Z] 2024-02-13 19:45:37,540 - INFO - Creating task with taskId bqNTthVBTSS0un1EjVRclQ for dataset-news-crawl-news_2008-ru
[task 2024-02-13T19:45:37.548Z] 2024-02-13 19:45:37,541 - INFO - Creating task with taskId REKgFXLrT6CIU704yzczpA for toolchain-preprocess
[task 2024-02-13T19:45:37.549Z] 2024-02-13 19:45:37,541 - INFO - Creating task with taskId Y5bcTyJsTlWoVuOWixennQ for dataset-opus-ada83_v1-ru-en
[task 2024-02-13T19:45:37.551Z] 2024-02-13 19:45:37,541 - INFO - Creating task with taskId KslRYRyMQteZcYvghH1s6g for dataset-flores-devtest-ru-en
[task 2024-02-13T19:45:37.554Z] 2024-02-13 19:45:37,542 - INFO - Creating task with taskId X8Xz_g3xRbyfqD3EwWI2Eg for dataset-news-crawl-news_2007-en
[task 2024-02-13T19:45:37.555Z] 2024-02-13 19:45:37,542 - INFO - Creating task with taskId NgfWAG6bRF6K-Ug3qCOGdg for dataset-flores-dev-ru-en
[task 2024-02-13T19:45:37.558Z] 2024-02-13 19:45:37,543 - INFO - Creating task with taskId Rs12st1TRtaaD0cSifgotw for toolchain-kenlm
[task 2024-02-13T19:45:37.620Z] 2024-02-13 19:45:37,620 - INFO - Creating task with taskId eltT5P8xQ6ix8qlBspE02Q for toolchain-hunspell
[task 2024-02-13T19:45:37.621Z] 2024-02-13 19:45:37,620 - INFO - Creating task with taskId f0mencplSO6OZKRpNtNZkw for toolchain-cuda-toolkit
[task 2024-02-13T19:45:37.623Z] 2024-02-13 19:45:37,623 - INFO - Creating task with taskId TLWFSUpvSqau9NyZEd7Yvg for tests-black
[task 2024-02-13T19:45:37.626Z] 2024-02-13 19:45:37,625 - INFO - Creating task with taskId de7HiazMToeJ5rs1P6VFrg for toolchain-fast-align
[task 2024-02-13T19:45:37.627Z] 2024-02-13 19:45:37,626 - INFO - Creating task with taskId XP7-72PVRYqwkSyrtrOQ2w for toolchain-extract-lex
[task 2024-02-13T19:45:37.629Z] 2024-02-13 19:45:37,627 - INFO - Creating task with taskId TPbc5V6JRKmcKZ7h7z8GfQ for tests-lint
[task 2024-02-13T19:45:37.631Z] 2024-02-13 19:45:37,628 - INFO - Creating task with taskId dAowqb2_TY-JI9GGuiQQCg for tests-test
[task 2024-02-13T19:45:37.704Z] 2024-02-13 19:45:37,704 - INFO - Creating task with taskId GO7xaBngTtaTphO5cOHpuw for clean-mono-news-crawl-ru-news_2008-mono-src
[task 2024-02-13T19:45:37.706Z] 2024-02-13 19:45:37,706 - INFO - Creating task with taskId GAMEfBWcRW6akGMKLMeQ0g for clean-corpus-opus-ada83_v1-ru-en
[task 2024-02-13T19:45:37.706Z] 2024-02-13 19:45:37,706 - INFO - Creating task with taskId fsUeMEKbRtWYo-affmIMbw for clean-corpus-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-02-13T19:45:37.710Z] 2024-02-13 19:45:37,710 - INFO - Creating task with taskId Ai7Mm3H6Q3SRbQ3z8CcPFw for merge-devset-ru-en
[task 2024-02-13T19:45:37.713Z] 2024-02-13 19:45:37,712 - INFO - Creating task with taskId NWMXxii2QqKLBYpVCtTUeA for clean-mono-news-crawl-en-news_2007-mono-trg
[task 2024-02-13T19:45:37.789Z] 2024-02-13 19:45:37,789 - INFO - Creating task with taskId T3__QjU9S_6CNOG1hWpSBw for toolchain-marian
[task 2024-02-13T19:45:37.792Z] 2024-02-13 19:45:37,791 - INFO - Creating task with taskId Tk19QR_0RoK-5LqBb3t9Pw for toolchain-browsermt-marian
[task 2024-02-13T19:45:37.794Z] 2024-02-13 19:45:37,794 - INFO - Creating task with taskId VhDf3Ew3RDmmhwqSOhav5Q for bicleaner-model-ru-en
[task 2024-02-13T19:45:37.879Z] 2024-02-13 19:45:37,878 - INFO - Creating task with taskId EgKyq3SpRDe1QDjywQJWXg for merge-mono-src-ru
[task 2024-02-13T19:45:37.881Z] 2024-02-13 19:45:37,881 - INFO - Creating task with taskId GtMTCD5dQz28YwNGj7DH9w for merge-mono-trg-en
[task 2024-02-13T19:45:37.997Z] 2024-02-13 19:45:37,997 - INFO - Creating task with taskId A4aqLg1fQaCAqdWkvO_58A for bicleaner-ai-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-02-13T19:45:37.999Z] 2024-02-13 19:45:37,997 - INFO - Creating task with taskId OkKNl-DSQsG4DD7SPqfoOQ for bicleaner-ai-opus-ada83_v1-ru-en
[task 2024-02-13T19:45:38.000Z] 2024-02-13 19:45:38,000 - INFO - Creating task with taskId ZgK_HZGBRq-hphBIWMeCAw for split-mono-src-ru
[task 2024-02-13T19:45:38.086Z] 2024-02-13 19:45:38,085 - INFO - Creating task with taskId ZYQFWLmKRF6IF1rRL3Bv9w for split-mono-trg-en
[task 2024-02-13T19:45:38.170Z] 2024-02-13 19:45:38,169 - INFO - Creating task with taskId cn6F16ilQdK7c1uRyCRvMA for merge-corpus-ru-en
[task 2024-02-13T19:45:38.268Z] 2024-02-13 19:45:38,268 - INFO - Creating task with taskId TlabNfGbRwGTNQcjW08etw for split-corpus-ru-en
[task 2024-02-13T19:45:38.270Z] 2024-02-13 19:45:38,270 - INFO - Creating task with taskId cDF3ROWYRleLBlKERefCqg for train-vocab-ru-en
[task 2024-02-13T19:45:38.385Z] 2024-02-13 19:45:38,385 - INFO - Creating task with taskId R8J7M8J4TqyJz4l0dFYwow for train-backwards-ru-en
[task 2024-02-13T19:45:38.478Z] 2024-02-13 19:45:38,478 - INFO - Creating task with taskId LghACDK6QqKpNzcyxYKslg for translate-mono-trg-ru-en-2/2
[task 2024-02-13T19:45:38.480Z] 2024-02-13 19:45:38,479 - INFO - Creating task with taskId M4dYNC8QT9SpqWpFNd7v_A for translate-mono-trg-ru-en-1/2
[task 2024-02-13T19:45:38.481Z] 2024-02-13 19:45:38,479 - INFO - Creating task with taskId A7TdziLxTxyFk_vsC0KUSA for evaluate-backward-flores-devtest-ru-en
[task 2024-02-13T19:45:38.593Z] 2024-02-13 19:45:38,593 - INFO - Creating task with taskId HkXlEbJ5R8-3YcpAaYJt_Q for collect-mono-trg-ru-en
[task 2024-02-13T19:45:38.690Z] 2024-02-13 19:45:38,690 - INFO - Creating task with taskId OU_o34F0RJq7NPMeGMOJew for train-teacher-ru-en-1/1
[task 2024-02-13T19:45:38.816Z] 2024-02-13 19:45:38,816 - INFO - Creating task with taskId ZSAxIQw8Td2N7Y96O3Fhkg for evaluate-teacher-flores-flores_devtest-ru-en-1/1
[task 2024-02-13T19:45:38.819Z] 2024-02-13 19:45:38,818 - INFO - Creating task with taskId ISSQpKG_QumHMVJS3v1caQ for evaluate-teacher-ensemble-flores-flores_devtest-ru-en
[task 2024-02-13T19:45:38.821Z] 2024-02-13 19:45:38,820 - INFO - Creating task with taskId QddrxP13Rt6sf6W4N84GzQ for translate-corpus-ru-en-2/2
[task 2024-02-13T19:45:38.823Z] 2024-02-13 19:45:38,822 - INFO - Creating task with taskId b0FIRywYQ7STYHVYprm58Q for translate-mono-src-ru-en-2/2
[task 2024-02-13T19:45:38.823Z] 2024-02-13 19:45:38,823 - INFO - Creating task with taskId JOzUfFSdTGKRpg-9jHDU7Q for translate-mono-src-ru-en-1/2
[task 2024-02-13T19:45:38.827Z] 2024-02-13 19:45:38,826 - INFO - Creating task with taskId Ix9gUxTrQNOvRCVbsUjktQ for translate-corpus-ru-en-1/2
[task 2024-02-13T19:45:38.940Z] 2024-02-13 19:45:38,939 - INFO - Creating task with taskId cvJ2s6JUQq2zCEZdhcPREQ for extract-best-ru-en-1/2
[task 2024-02-13T19:45:39.039Z] 2024-02-13 19:45:39,039 - INFO - Creating task with taskId IfddEhLmRNG1ccEFPQDAHw for collect-mono-src-ru-en
[task 2024-02-13T19:45:39.039Z] 2024-02-13 19:45:39,039 - INFO - Creating task with taskId d9rpYGBZRN21bFCnZcOKfw for extract-best-ru-en-2/2
[task 2024-02-13T19:45:39.141Z] 2024-02-13 19:45:39,141 - INFO - Creating task with taskId QCUM3_UkSYSE7GKxgDub1g for collect-corpus-ru-en
[task 2024-02-13T19:45:39.234Z] 2024-02-13 19:45:39,234 - INFO - Creating task with taskId JSyYgZFeQyeyKuQ85SKThA for merge-translated-ru-en
[task 2024-02-13T19:45:39.372Z] 2024-02-13 19:45:39,371 - INFO - Creating task with taskId GFvVAjOTQ0CagGT66TeNSw for score-ru-en
[task 2024-02-13T19:45:39.495Z] 2024-02-13 19:45:39,495 - INFO - Creating task with taskId MfrUmjRUR9OIFFX3y_brMA for cefilter-ru-en
[task 2024-02-13T19:45:39.610Z] 2024-02-13 19:45:39,609 - INFO - Creating task with taskId JjGclcJ9QE6c53LY8sVjMg for alignments-ru-en
[task 2024-02-13T19:45:39.751Z] 2024-02-13 19:45:39,751 - INFO - Creating task with taskId YIukC5EGQY2YkdIqMzAtaQ for train-student-ru-en
[task 2024-02-13T19:45:39.887Z] 2024-02-13 19:45:39,887 - INFO - Creating task with taskId RQnI_71QSPmynKAEsMl_Qw for finetune-student-ru-en
[task 2024-02-13T19:45:39.888Z] 2024-02-13 19:45:39,887 - INFO - Creating task with taskId BJd3tCBqRmGbFNvxbJJN2g for evaluate-student-flores-devtest-ru-en
[task 2024-02-13T19:45:40.010Z] 2024-02-13 19:45:40,010 - INFO - Creating task with taskId LqSk6LAfTPOCJsFH_fTd4w for quantize-ru-en
[task 2024-02-13T19:45:40.012Z] 2024-02-13 19:45:40,011 - INFO - Creating task with taskId OBqsRUK9Ti6R8GtYHNfcVw for evaluate-finetuned-student-flores-devtest-ru-en
[task 2024-02-13T19:45:40.236Z] 2024-02-13 19:45:40,236 - INFO - Creating task with taskId VrvBg3GPSwC-kkv76rtCqQ for export-ru-en
[task 2024-02-13T19:45:40.238Z] 2024-02-13 19:45:40,236 - INFO - Creating task with taskId AWIdhK8XSFagronE2Lhh0A for evaluate-quantized-flores-devtest-ru-en
[task 2024-02-13T19:45:40.800Z] 2024-02-13 19:45:40,800 - INFO - Creating task with taskId R3YmIvC4TLqqr84NrjKjZg for all-pr-ru-en-1
[taskcluster 2024-02-13 19:45:41.213Z] === Task Finished ===
[taskcluster 2024-02-13 19:45:43.249Z] Successful task run with exit code: 0 completed in 13.286 seconds
Loading