Add the ability to run starting from a specific task (fixes #227) #377
firefoxci-taskcluster / Action: Train
succeeded
Feb 13, 2024 in 32s
FirefoxCI (push)
Initiate part or all of the training pipeline
Action triggered by clientID mozilla-auth0/ad|Mozilla-LDAP|bhearsum
Details
View task in Taskcluster
View logs in Taskcluster
[taskcluster 2024-02-13 19:48:22.112Z] Task ID: HMJY3H7NT1W7nYLX0xHJnQ
[taskcluster 2024-02-13 19:48:22.112Z] Worker ID: 329903592270364434
[taskcluster 2024-02-13 19:48:22.112Z] Worker Group: us-central1
[taskcluster 2024-02-13 19:48:22.112Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-02-13 19:48:22.112Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-02-13 19:48:22.112Z] Worker Version: 38.0.5
[taskcluster 2024-02-13 19:48:22.112Z] Public IP: 34.173.208.69
[taskcluster 2024-02-13 19:48:22.112Z] Hostname: translations-1-decision-gcp-t-boabu9q7uzshjr-jjbtg
[taskcluster 2024-02-13 19:48:22.112Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts
[taskcluster 2024-02-13 19:48:22.664Z] === Task Starting ===
[setup 2024-02-13T19:48:23.048Z] run-task started in /
[setup 2024-02-13T19:48:23.048Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph action-callback
[setup 2024-02-13T19:48:23.048Z] Python version: 3.11.2
[vcs 2024-02-13T19:48:23.049Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-02-13T19:48:23.049Z] running as worker:worker
[vcs 2024-02-13T19:48:23.049Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-02-13T19:48:23.052Z] executing ['git', 'fetch', 'origin', 'start-specific']
[vcs 2024-02-13T19:48:23.586Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-02-13T19:48:23.587Z] * branch start-specific -> FETCH_HEAD
[vcs 2024-02-13T19:48:23.591Z] executing ['git', 'checkout', 'start-specific']
[vcs 2024-02-13T19:48:23.613Z] Switched to branch 'start-specific'
[vcs 2024-02-13T19:48:23.614Z] Your branch is up to date with 'origin/start-specific'.
[vcs 2024-02-13T19:48:23.614Z] executing ['git', 'fetch', 'origin', '37fbf272d7eb316897377144111a3ef057becfd4']
[vcs 2024-02-13T19:48:23.861Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-02-13T19:48:23.861Z] * branch 37fbf272d7eb316897377144111a3ef057becfd4 -> FETCH_HEAD
[vcs 2024-02-13T19:48:23.867Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'refs/heads/start-specific']
[vcs 2024-02-13T19:48:24.195Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-02-13T19:48:24.195Z] * branch start-specific -> FETCH_HEAD
[vcs 2024-02-13T19:48:24.200Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'refs/heads/start-specific']
[vcs 2024-02-13T19:48:24.412Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-02-13T19:48:24.412Z] * branch start-specific -> FETCH_HEAD
[vcs 2024-02-13T19:48:24.417Z] executing ['git', 'checkout', '-f', '-B', 'refs/heads/start-specific', '37fbf272d7eb316897377144111a3ef057becfd4']
[vcs 2024-02-13T19:48:24.422Z] Switched to and reset branch 'refs/heads/start-specific'
[vcs 2024-02-13T19:48:24.422Z] executing ['git', 'submodule', 'init']
[vcs 2024-02-13T19:48:24.441Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-02-13T19:48:24.468Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-02-13T19:48:24.474Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-02-13T19:48:24.479Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-02-13T19:48:24.485Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-02-13T19:48:24.494Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-02-13T19:48:24.499Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-02-13T19:48:24.500Z] cleaning git checkout...
[vcs 2024-02-13T19:48:24.501Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-02-13T19:48:24.505Z] removing ['/builds/worker/checkouts/src/artifacts', '/builds/worker/checkouts/src/docker-contexts/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/actions/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/transforms/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/util/__pycache__/']
[vcs 2024-02-13T19:48:24.506Z] successfully cleaned git checkout!
[vcs 2024-02-13T19:48:24.507Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/37fbf272d7eb316897377144111a3ef057becfd4' title='Built from firefox-translations-training commit 37fbf272d7eb316897377144111a3ef057becfd4'>37fbf272d7eb316897377144111a3ef057becfd4</a>
[pip-install 2024-02-13T19:48:24.507Z] executing ['/usr/bin/python3', '-mpip', 'install', '--break-system-packages', '--require-hashes', '-r', '/builds/worker/checkouts/src/taskcluster/requirements.txt']
[pip-install 2024-02-13T19:48:24.756Z] Defaulting to user installation because normal site-packages is not writeable
[pip-install 2024-02-13T19:48:24.843Z] Requirement already satisfied: appdirs==1.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 7)) (1.4.4)
[pip-install 2024-02-13T19:48:24.932Z] Collecting arrow==1.3.0
[pip-install 2024-02-13T19:48:25.092Z] Downloading arrow-1.3.0-py3-none-any.whl (66 kB)
[pip-install 2024-02-13T19:48:25.144Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 kB 1.2 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.149Z] Requirement already satisfied: binaryornot==0.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 15)) (0.4.4)
[pip-install 2024-02-13T19:48:25.179Z] Collecting certifi==2024.2.2
[pip-install 2024-02-13T19:48:25.222Z] Downloading certifi-2024.2.2-py3-none-any.whl (163 kB)
[pip-install 2024-02-13T19:48:25.271Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.8/163.8 kB 3.3 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.303Z] Collecting chardet==5.2.0
[pip-install 2024-02-13T19:48:25.345Z] Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[pip-install 2024-02-13T19:48:25.361Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 14.0 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.507Z] Collecting charset-normalizer==3.3.2
[pip-install 2024-02-13T19:48:25.550Z] Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
[pip-install 2024-02-13T19:48:25.559Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.3/140.3 kB 21.3 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.591Z] Collecting click==8.1.7
[pip-install 2024-02-13T19:48:25.633Z] Downloading click-8.1.7-py3-none-any.whl (97 kB)
[pip-install 2024-02-13T19:48:25.639Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 22.6 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.671Z] Collecting cookiecutter==2.5.0
[pip-install 2024-02-13T19:48:25.714Z] Downloading cookiecutter-2.5.0-py3-none-any.whl (39 kB)
[pip-install 2024-02-13T19:48:25.736Z] Collecting giturlparse==0.12.0
[pip-install 2024-02-13T19:48:25.778Z] Downloading giturlparse-0.12.0-py2.py3-none-any.whl (15 kB)
[pip-install 2024-02-13T19:48:25.806Z] Collecting idna==3.6
[pip-install 2024-02-13T19:48:25.848Z] Downloading idna-3.6-py3-none-any.whl (61 kB)
[pip-install 2024-02-13T19:48:25.856Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 kB 20.6 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.882Z] Collecting jinja2==3.1.3
[pip-install 2024-02-13T19:48:25.926Z] Downloading Jinja2-3.1.3-py3-none-any.whl (133 kB)
[pip-install 2024-02-13T19:48:25.934Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.2/133.2 kB 22.5 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.957Z] Collecting json-e==4.6.0
[pip-install 2024-02-13T19:48:25.999Z] Downloading json_e-4.6.0-py3-none-any.whl (13 kB)
[pip-install 2024-02-13T19:48:26.056Z] Collecting markdown-it-py==3.0.0
[pip-install 2024-02-13T19:48:26.101Z] Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[pip-install 2024-02-13T19:48:26.168Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 1.2 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:26.274Z] Collecting markupsafe==2.1.5
[pip-install 2024-02-13T19:48:26.316Z] Downloading MarkupSafe-2.1.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (28 kB)
[pip-install 2024-02-13T19:48:26.363Z] Collecting mdurl==0.1.2
[pip-install 2024-02-13T19:48:26.406Z] Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[pip-install 2024-02-13T19:48:26.420Z] Requirement already satisfied: mozilla-repo-urls==0.1.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 213)) (0.1.1)
[pip-install 2024-02-13T19:48:26.472Z] Collecting pygments==2.17.2
[pip-install 2024-02-13T19:48:26.514Z] Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
[pip-install 2024-02-13T19:48:26.695Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 6.5 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:26.703Z] Requirement already satisfied: python-dateutil==2.8.2 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 221)) (2.8.2)
[pip-install 2024-02-13T19:48:26.748Z] Collecting python-slugify==8.0.4
[pip-install 2024-02-13T19:48:26.789Z] Downloading python_slugify-8.0.4-py2.py3-none-any.whl (10 kB)
[pip-install 2024-02-13T19:48:26.874Z] Collecting pyyaml==6.0.1
[pip-install 2024-02-13T19:48:26.916Z] Downloading PyYAML-6.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (757 kB)
[pip-install 2024-02-13T19:48:27.039Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 757.7/757.7 kB 6.2 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:27.044Z] Requirement already satisfied: redo==2.0.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 284)) (2.0.4)
[pip-install 2024-02-13T19:48:27.045Z] Requirement already satisfied: requests==2.31.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 288)) (2.31.0)
[pip-install 2024-02-13T19:48:27.157Z] Collecting rich==13.7.0
[pip-install 2024-02-13T19:48:27.199Z] Downloading rich-13.7.0-py3-none-any.whl (240 kB)
[pip-install 2024-02-13T19:48:27.245Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 5.3 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:27.248Z] Requirement already satisfied: six==1.16.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 298)) (1.16.0)
[pip-install 2024-02-13T19:48:27.249Z] Requirement already satisfied: slugid==2.0.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 302)) (2.0.0)
[pip-install 2024-02-13T19:48:27.305Z] Collecting taskcluster-taskgraph==7.3.0
[pip-install 2024-02-13T19:48:27.347Z] Downloading taskcluster_taskgraph-7.3.0-py3-none-any.whl (188 kB)
[pip-install 2024-02-13T19:48:27.382Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 188.8/188.8 kB 5.5 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:27.386Z] Requirement already satisfied: taskcluster-urls==13.0.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 310)) (13.0.1)
[pip-install 2024-02-13T19:48:27.387Z] Requirement already satisfied: text-unidecode==1.3 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 315)) (1.3)
[pip-install 2024-02-13T19:48:27.425Z] Collecting types-python-dateutil==2.8.19.20240106
[pip-install 2024-02-13T19:48:27.468Z] Downloading types_python_dateutil-2.8.19.20240106-py3-none-any.whl (9.7 kB)
[pip-install 2024-02-13T19:48:27.539Z] Collecting urllib3==2.2.0
[pip-install 2024-02-13T19:48:27.581Z] Downloading urllib3-2.2.0-py3-none-any.whl (120 kB)
[pip-install 2024-02-13T19:48:27.611Z] ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.9/120.9 kB 4.0 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:27.650Z] Collecting voluptuous==0.14.2
[pip-install 2024-02-13T19:48:27.692Z] Downloading voluptuous-0.14.2-py3-none-any.whl (31 kB)
[pip-install 2024-02-13T19:48:28.070Z] Installing collected packages: json-e, voluptuous, urllib3, types-python-dateutil, pyyaml, python-slugify, pygments, mdurl, markupsafe, idna, giturlparse, click, charset-normalizer, chardet, certifi, markdown-it-py, jinja2, arrow, rich, cookiecutter, taskcluster-taskgraph
[pip-install 2024-02-13T19:48:28.244Z] WARNING: The script slugify is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:28.244Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:28.776Z] WARNING: The script pygmentize is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:28.776Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:28.941Z] WARNING: The script normalizer is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:28.941Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:29.085Z] WARNING: The script chardetect is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:29.086Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:29.144Z] WARNING: The script markdown-it is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:29.145Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:29.409Z] WARNING: The script cookiecutter is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:29.409Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:29.492Z] WARNING: The script taskgraph is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:29.492Z] Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:29.556Z] Successfully installed arrow-1.3.0 certifi-2024.2.2 chardet-5.2.0 charset-normalizer-3.3.2 click-8.1.7 cookiecutter-2.5.0 giturlparse-0.12.0 idna-3.6 jinja2-3.1.3 json-e-4.6.0 markdown-it-py-3.0.0 markupsafe-2.1.5 mdurl-0.1.2 pygments-2.17.2 python-slugify-8.0.4 pyyaml-6.0.1 rich-13.7.0 taskcluster-taskgraph-7.3.0 types-python-dateutil-2.8.19.20240106 urllib3-2.2.0 voluptuous-0.14.2
[task 2024-02-13T19:48:29.632Z] executing ['bash', '-cx', 'cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph action-callback\n']
[task 2024-02-13T19:48:29.634Z] + cd /builds/worker/checkouts/src
[task 2024-02-13T19:48:29.634Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-02-13T19:48:29.635Z] + /builds/worker/.local/bin/taskgraph action-callback
[task 2024-02-13T19:48:43.852Z] 2024-02-13 19:48:43,852 - INFO - Loading graph configuration.
[task 2024-02-13T19:48:43.868Z] 2024-02-13 19:48:43,868 - INFO - Using Parameters(id=894a75bff22a) (from defaults)
[task 2024-02-13T19:48:43.870Z] 2024-02-13 19:48:43,870 - INFO - writing artifact file `parameters.yml`
[task 2024-02-13T19:48:43.878Z] 2024-02-13 19:48:43,878 - INFO - writing artifact file `actions.json`
[task 2024-02-13T19:48:43.880Z] 2024-02-13 19:48:43,880 - INFO - Loading kinds
[task 2024-02-13T19:48:44.116Z] 2024-02-13 19:48:44,116 - INFO - Generating full task set
[task 2024-02-13T19:48:44.139Z] 2024-02-13 19:48:44,139 - INFO - Generated 7 tasks for kind dataset
[task 2024-02-13T19:48:44.140Z] 2024-02-13 19:48:44,140 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-02-13T19:48:44.157Z] 2024-02-13 19:48:44,157 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-02-13T19:48:44.157Z] 2024-02-13 19:48:44,157 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-02-13T19:48:44.158Z] 2024-02-13 19:48:44,158 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-02-13T19:48:44.176Z] 2024-02-13 19:48:44,176 - INFO - Generated 4 tasks for kind docker-image
[task 2024-02-13T19:48:44.190Z] 2024-02-13 19:48:44,190 - INFO - Generated 9 tasks for kind fetch
[task 2024-02-13T19:48:44.194Z] 2024-02-13 19:48:44,194 - INFO - Generated 5 tasks for kind tests
[task 2024-02-13T19:48:44.244Z] 2024-02-13 19:48:44,244 - INFO - Generated 9 tasks for kind toolchain
[task 2024-02-13T19:48:44.256Z] 2024-02-13 19:48:44,256 - INFO - Generated 2 tasks for kind clean-corpus
[task 2024-02-13T19:48:44.259Z] 2024-02-13 19:48:44,259 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-02-13T19:48:44.262Z] 2024-02-13 19:48:44,262 - INFO - Generated 2 tasks for kind bicleaner
[task 2024-02-13T19:48:44.266Z] 2024-02-13 19:48:44,266 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-02-13T19:48:44.270Z] 2024-02-13 19:48:44,270 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-02-13T19:48:44.273Z] 2024-02-13 19:48:44,273 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-02-13T19:48:44.276Z] 2024-02-13 19:48:44,276 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-02-13T19:48:44.278Z] 2024-02-13 19:48:44,278 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-02-13T19:48:44.281Z] 2024-02-13 19:48:44,280 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-02-13T19:48:44.285Z] 2024-02-13 19:48:44,285 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-02-13T19:48:44.287Z] 2024-02-13 19:48:44,287 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-02-13T19:48:44.290Z] 2024-02-13 19:48:44,289 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-02-13T19:48:44.294Z] 2024-02-13 19:48:44,294 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-02-13T19:48:44.297Z] 2024-02-13 19:48:44,297 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-02-13T19:48:44.301Z] 2024-02-13 19:48:44,301 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-02-13T19:48:44.304Z] 2024-02-13 19:48:44,304 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-02-13T19:48:44.308Z] 2024-02-13 19:48:44,308 - INFO - Generated 2 tasks for kind extract-best
[task 2024-02-13T19:48:44.310Z] 2024-02-13 19:48:44,310 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-02-13T19:48:44.314Z] 2024-02-13 19:48:44,314 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-02-13T19:48:44.316Z] 2024-02-13 19:48:44,316 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-02-13T19:48:44.319Z] 2024-02-13 19:48:44,319 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-02-13T19:48:44.321Z] 2024-02-13 19:48:44,321 - INFO - Generated 1 tasks for kind score
[task 2024-02-13T19:48:44.323Z] 2024-02-13 19:48:44,323 - INFO - Generated 1 tasks for kind cefilter
[task 2024-02-13T19:48:44.326Z] 2024-02-13 19:48:44,326 - INFO - Generated 1 tasks for kind alignments
[task 2024-02-13T19:48:44.328Z] 2024-02-13 19:48:44,328 - INFO - Generated 1 tasks for kind train-student
[task 2024-02-13T19:48:44.331Z] 2024-02-13 19:48:44,331 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-02-13T19:48:44.333Z] 2024-02-13 19:48:44,333 - INFO - Generated 1 tasks for kind quantize
[task 2024-02-13T19:48:44.336Z] 2024-02-13 19:48:44,336 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-02-13T19:48:44.339Z] 2024-02-13 19:48:44,339 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-02-13T19:48:44.345Z] 2024-02-13 19:48:44,344 - INFO - Generated 4 tasks for kind evaluate
[task 2024-02-13T19:48:44.347Z] 2024-02-13 19:48:44,347 - INFO - Generated 1 tasks for kind export
[task 2024-02-13T19:48:44.348Z] 2024-02-13 19:48:44,348 - INFO - Generated 1 tasks for kind all
[task 2024-02-13T19:48:44.352Z] 2024-02-13 19:48:44,352 - INFO - Generated 1 tasks for kind all-pr
[task 2024-02-13T19:48:44.352Z] 2024-02-13 19:48:44,352 - INFO - Generating full task graph
[task 2024-02-13T19:48:44.352Z] 2024-02-13 19:48:44,352 - INFO - Full task graph contains 78 tasks and 216 dependencies
[task 2024-02-13T19:48:44.356Z] 2024-02-13 19:48:44,356 - INFO - writing artifact file `full-task-graph.json`
[task 2024-02-13T19:48:44.371Z] 2024-02-13 19:48:44,371 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-02-13T19:48:44.372Z] 2024-02-13 19:48:44,372 - INFO - Generating target task set
[task 2024-02-13T19:48:44.375Z] 2024-02-13 19:48:44,372 - INFO - Filter filter_target_tasks pruned 77 tasks (1 remain)
[task 2024-02-13T19:48:44.375Z] 2024-02-13 19:48:44,372 - INFO - writing artifact file `target-tasks.json`
[task 2024-02-13T19:48:44.375Z] 2024-02-13 19:48:44,372 - INFO - Generating target task graph
[task 2024-02-13T19:48:44.375Z] 2024-02-13 19:48:44,373 - INFO - Adding 4 tasks with `always_target` attribute
[task 2024-02-13T19:48:44.375Z] 2024-02-13 19:48:44,373 - INFO - Generating optimized task graph
[task 2024-02-13T19:48:44.375Z] 2024-02-13 19:48:44,374 - INFO - No tasks removed during optimization
[task 2024-02-13T19:48:45.427Z] 2024-02-13 19:48:45,426 - INFO - Replaced 27 tasks by existing_tasks, 4 tasks by index-search (index-search) during optimization.
[task 2024-02-13T19:48:45.428Z] 2024-02-13 19:48:45,428 - INFO - writing artifact file `task-graph.json`
[task 2024-02-13T19:48:45.430Z] 2024-02-13 19:48:45,430 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-02-13T19:48:45.431Z] 2024-02-13 19:48:45,431 - INFO - Creating task with taskId em9zoxLkRjWaVUFbvlhdDw for train-backwards-ru-en
[task 2024-02-13T19:48:45.434Z] 2024-02-13 19:48:45,432 - INFO - Creating task with taskId C-VohexaR6OqXMCKs5SRDA for build-docker-image-test
[task 2024-02-13T19:48:45.564Z] 2024-02-13 19:48:45,564 - INFO - Creating task with taskId OP6bx3kZQDioBZpJU4Gfrg for translate-mono-trg-ru-en-2/2
[task 2024-02-13T19:48:45.566Z] 2024-02-13 19:48:45,566 - INFO - Creating task with taskId KFs1DQQ-RCupxH0u-qnMDg for translate-mono-trg-ru-en-1/2
[task 2024-02-13T19:48:45.694Z] 2024-02-13 19:48:45,694 - INFO - Creating task with taskId QRwvX1AQRkaJEnhmYbCPvw for collect-mono-trg-ru-en
[task 2024-02-13T19:48:45.801Z] 2024-02-13 19:48:45,800 - INFO - Creating task with taskId S7WIYrfFTUqh2RoR8xns3A for train-teacher-ru-en-1/1
[taskcluster 2024-02-13 19:48:46.109Z] === Task Finished ===
[taskcluster 2024-02-13 19:48:47.957Z] Successful task run with exit code: 0 completed in 25.845 seconds
Loading