Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the ability to run starting from a specific task (fixes #227) #377

Merged
merged 2 commits into from
Feb 14, 2024

Update poetry dependencies to pull in newer taskgraph version

37fbf27
Select commit
Loading
Failed to load commit list.
Merged

Add the ability to run starting from a specific task (fixes #227) #377

Update poetry dependencies to pull in newer taskgraph version
37fbf27
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / Action: Train succeeded Feb 13, 2024 in 32s

FirefoxCI (push)

Initiate part or all of the training pipeline

Action triggered by clientID mozilla-auth0/ad|Mozilla-LDAP|bhearsum

Details

View task in Taskcluster
View logs in Taskcluster


[taskcluster 2024-02-13 19:48:22.112Z] Task ID: HMJY3H7NT1W7nYLX0xHJnQ
[taskcluster 2024-02-13 19:48:22.112Z] Worker ID: 329903592270364434
[taskcluster 2024-02-13 19:48:22.112Z] Worker Group: us-central1
[taskcluster 2024-02-13 19:48:22.112Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-02-13 19:48:22.112Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-02-13 19:48:22.112Z] Worker Version: 38.0.5
[taskcluster 2024-02-13 19:48:22.112Z] Public IP: 34.173.208.69
[taskcluster 2024-02-13 19:48:22.112Z] Hostname: translations-1-decision-gcp-t-boabu9q7uzshjr-jjbtg
[taskcluster 2024-02-13 19:48:22.112Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts

[taskcluster 2024-02-13 19:48:22.664Z] === Task Starting ===
[setup 2024-02-13T19:48:23.048Z] run-task started in /
[setup 2024-02-13T19:48:23.048Z] Invoked by command: --firefox_translations_training-checkout=/builds/worker/checkouts/src -- bash -cx cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph action-callback

[setup 2024-02-13T19:48:23.048Z] Python version: 3.11.2
[vcs 2024-02-13T19:48:23.049Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-02-13T19:48:23.049Z] running as worker:worker
[vcs 2024-02-13T19:48:23.049Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-02-13T19:48:23.052Z] executing ['git', 'fetch', 'origin', 'start-specific']
[vcs 2024-02-13T19:48:23.586Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-02-13T19:48:23.587Z]  * branch            start-specific -> FETCH_HEAD
[vcs 2024-02-13T19:48:23.591Z] executing ['git', 'checkout', 'start-specific']
[vcs 2024-02-13T19:48:23.613Z] Switched to branch 'start-specific'
[vcs 2024-02-13T19:48:23.614Z] Your branch is up to date with 'origin/start-specific'.
[vcs 2024-02-13T19:48:23.614Z] executing ['git', 'fetch', 'origin', '37fbf272d7eb316897377144111a3ef057becfd4']
[vcs 2024-02-13T19:48:23.861Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-02-13T19:48:23.861Z]  * branch            37fbf272d7eb316897377144111a3ef057becfd4 -> FETCH_HEAD
[vcs 2024-02-13T19:48:23.867Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/firefox-translations-training', 'refs/heads/start-specific']
[vcs 2024-02-13T19:48:24.195Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-02-13T19:48:24.195Z]  * branch            start-specific -> FETCH_HEAD
[vcs 2024-02-13T19:48:24.200Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/firefox-translations-training', 'refs/heads/start-specific']
[vcs 2024-02-13T19:48:24.412Z] From https://github.com/mozilla/firefox-translations-training
[vcs 2024-02-13T19:48:24.412Z]  * branch            start-specific -> FETCH_HEAD
[vcs 2024-02-13T19:48:24.417Z] executing ['git', 'checkout', '-f', '-B', 'refs/heads/start-specific', '37fbf272d7eb316897377144111a3ef057becfd4']
[vcs 2024-02-13T19:48:24.422Z] Switched to and reset branch 'refs/heads/start-specific'
[vcs 2024-02-13T19:48:24.422Z] executing ['git', 'submodule', 'init']
[vcs 2024-02-13T19:48:24.441Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-02-13T19:48:24.468Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-02-13T19:48:24.474Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-02-13T19:48:24.479Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-02-13T19:48:24.485Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-02-13T19:48:24.494Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-02-13T19:48:24.499Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-02-13T19:48:24.500Z] cleaning git checkout...
[vcs 2024-02-13T19:48:24.501Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-02-13T19:48:24.505Z] removing ['/builds/worker/checkouts/src/artifacts', '/builds/worker/checkouts/src/docker-contexts/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/actions/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/transforms/__pycache__/', '/builds/worker/checkouts/src/taskcluster/translations_taskgraph/util/__pycache__/']
[vcs 2024-02-13T19:48:24.506Z] successfully cleaned git checkout!
[vcs 2024-02-13T19:48:24.507Z] TinderboxPrint:<a href='https://github.com/mozilla/firefox-translations-training/commit/37fbf272d7eb316897377144111a3ef057becfd4' title='Built from firefox-translations-training commit 37fbf272d7eb316897377144111a3ef057becfd4'>37fbf272d7eb316897377144111a3ef057becfd4</a>
[pip-install 2024-02-13T19:48:24.507Z] executing ['/usr/bin/python3', '-mpip', 'install', '--break-system-packages', '--require-hashes', '-r', '/builds/worker/checkouts/src/taskcluster/requirements.txt']
[pip-install 2024-02-13T19:48:24.756Z] Defaulting to user installation because normal site-packages is not writeable
[pip-install 2024-02-13T19:48:24.843Z] Requirement already satisfied: appdirs==1.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 7)) (1.4.4)
[pip-install 2024-02-13T19:48:24.932Z] Collecting arrow==1.3.0
[pip-install 2024-02-13T19:48:25.092Z]   Downloading arrow-1.3.0-py3-none-any.whl (66 kB)
[pip-install 2024-02-13T19:48:25.144Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 66.4/66.4 kB 1.2 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.149Z] Requirement already satisfied: binaryornot==0.4.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 15)) (0.4.4)
[pip-install 2024-02-13T19:48:25.179Z] Collecting certifi==2024.2.2
[pip-install 2024-02-13T19:48:25.222Z]   Downloading certifi-2024.2.2-py3-none-any.whl (163 kB)
[pip-install 2024-02-13T19:48:25.271Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.8/163.8 kB 3.3 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.303Z] Collecting chardet==5.2.0
[pip-install 2024-02-13T19:48:25.345Z]   Downloading chardet-5.2.0-py3-none-any.whl (199 kB)
[pip-install 2024-02-13T19:48:25.361Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 199.4/199.4 kB 14.0 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.507Z] Collecting charset-normalizer==3.3.2
[pip-install 2024-02-13T19:48:25.550Z]   Downloading charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
[pip-install 2024-02-13T19:48:25.559Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 140.3/140.3 kB 21.3 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.591Z] Collecting click==8.1.7
[pip-install 2024-02-13T19:48:25.633Z]   Downloading click-8.1.7-py3-none-any.whl (97 kB)
[pip-install 2024-02-13T19:48:25.639Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 22.6 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.671Z] Collecting cookiecutter==2.5.0
[pip-install 2024-02-13T19:48:25.714Z]   Downloading cookiecutter-2.5.0-py3-none-any.whl (39 kB)
[pip-install 2024-02-13T19:48:25.736Z] Collecting giturlparse==0.12.0
[pip-install 2024-02-13T19:48:25.778Z]   Downloading giturlparse-0.12.0-py2.py3-none-any.whl (15 kB)
[pip-install 2024-02-13T19:48:25.806Z] Collecting idna==3.6
[pip-install 2024-02-13T19:48:25.848Z]   Downloading idna-3.6-py3-none-any.whl (61 kB)
[pip-install 2024-02-13T19:48:25.856Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.6/61.6 kB 20.6 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.882Z] Collecting jinja2==3.1.3
[pip-install 2024-02-13T19:48:25.926Z]   Downloading Jinja2-3.1.3-py3-none-any.whl (133 kB)
[pip-install 2024-02-13T19:48:25.934Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.2/133.2 kB 22.5 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:25.957Z] Collecting json-e==4.6.0
[pip-install 2024-02-13T19:48:25.999Z]   Downloading json_e-4.6.0-py3-none-any.whl (13 kB)
[pip-install 2024-02-13T19:48:26.056Z] Collecting markdown-it-py==3.0.0
[pip-install 2024-02-13T19:48:26.101Z]   Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
[pip-install 2024-02-13T19:48:26.168Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 1.2 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:26.274Z] Collecting markupsafe==2.1.5
[pip-install 2024-02-13T19:48:26.316Z]   Downloading MarkupSafe-2.1.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (28 kB)
[pip-install 2024-02-13T19:48:26.363Z] Collecting mdurl==0.1.2
[pip-install 2024-02-13T19:48:26.406Z]   Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
[pip-install 2024-02-13T19:48:26.420Z] Requirement already satisfied: mozilla-repo-urls==0.1.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 213)) (0.1.1)
[pip-install 2024-02-13T19:48:26.472Z] Collecting pygments==2.17.2
[pip-install 2024-02-13T19:48:26.514Z]   Downloading pygments-2.17.2-py3-none-any.whl (1.2 MB)
[pip-install 2024-02-13T19:48:26.695Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 6.5 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:26.703Z] Requirement already satisfied: python-dateutil==2.8.2 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 221)) (2.8.2)
[pip-install 2024-02-13T19:48:26.748Z] Collecting python-slugify==8.0.4
[pip-install 2024-02-13T19:48:26.789Z]   Downloading python_slugify-8.0.4-py2.py3-none-any.whl (10 kB)
[pip-install 2024-02-13T19:48:26.874Z] Collecting pyyaml==6.0.1
[pip-install 2024-02-13T19:48:26.916Z]   Downloading PyYAML-6.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (757 kB)
[pip-install 2024-02-13T19:48:27.039Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 757.7/757.7 kB 6.2 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:27.044Z] Requirement already satisfied: redo==2.0.4 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 284)) (2.0.4)
[pip-install 2024-02-13T19:48:27.045Z] Requirement already satisfied: requests==2.31.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 288)) (2.31.0)
[pip-install 2024-02-13T19:48:27.157Z] Collecting rich==13.7.0
[pip-install 2024-02-13T19:48:27.199Z]   Downloading rich-13.7.0-py3-none-any.whl (240 kB)
[pip-install 2024-02-13T19:48:27.245Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 240.6/240.6 kB 5.3 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:27.248Z] Requirement already satisfied: six==1.16.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 298)) (1.16.0)
[pip-install 2024-02-13T19:48:27.249Z] Requirement already satisfied: slugid==2.0.0 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 302)) (2.0.0)
[pip-install 2024-02-13T19:48:27.305Z] Collecting taskcluster-taskgraph==7.3.0
[pip-install 2024-02-13T19:48:27.347Z]   Downloading taskcluster_taskgraph-7.3.0-py3-none-any.whl (188 kB)
[pip-install 2024-02-13T19:48:27.382Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 188.8/188.8 kB 5.5 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:27.386Z] Requirement already satisfied: taskcluster-urls==13.0.1 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 310)) (13.0.1)
[pip-install 2024-02-13T19:48:27.387Z] Requirement already satisfied: text-unidecode==1.3 in /usr/local/lib/python3.11/dist-packages (from -r /builds/worker/checkouts/src/taskcluster/requirements.txt (line 315)) (1.3)
[pip-install 2024-02-13T19:48:27.425Z] Collecting types-python-dateutil==2.8.19.20240106
[pip-install 2024-02-13T19:48:27.468Z]   Downloading types_python_dateutil-2.8.19.20240106-py3-none-any.whl (9.7 kB)
[pip-install 2024-02-13T19:48:27.539Z] Collecting urllib3==2.2.0
[pip-install 2024-02-13T19:48:27.581Z]   Downloading urllib3-2.2.0-py3-none-any.whl (120 kB)
[pip-install 2024-02-13T19:48:27.611Z]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.9/120.9 kB 4.0 MB/s eta 0:00:00
[pip-install 2024-02-13T19:48:27.650Z] Collecting voluptuous==0.14.2
[pip-install 2024-02-13T19:48:27.692Z]   Downloading voluptuous-0.14.2-py3-none-any.whl (31 kB)
[pip-install 2024-02-13T19:48:28.070Z] Installing collected packages: json-e, voluptuous, urllib3, types-python-dateutil, pyyaml, python-slugify, pygments, mdurl, markupsafe, idna, giturlparse, click, charset-normalizer, chardet, certifi, markdown-it-py, jinja2, arrow, rich, cookiecutter, taskcluster-taskgraph
[pip-install 2024-02-13T19:48:28.244Z]   WARNING: The script slugify is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:28.244Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:28.776Z]   WARNING: The script pygmentize is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:28.776Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:28.941Z]   WARNING: The script normalizer is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:28.941Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:29.085Z]   WARNING: The script chardetect is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:29.086Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:29.144Z]   WARNING: The script markdown-it is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:29.145Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:29.409Z]   WARNING: The script cookiecutter is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:29.409Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:29.492Z]   WARNING: The script taskgraph is installed in '/builds/worker/.local/bin' which is not on PATH.
[pip-install 2024-02-13T19:48:29.492Z]   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[pip-install 2024-02-13T19:48:29.556Z] Successfully installed arrow-1.3.0 certifi-2024.2.2 chardet-5.2.0 charset-normalizer-3.3.2 click-8.1.7 cookiecutter-2.5.0 giturlparse-0.12.0 idna-3.6 jinja2-3.1.3 json-e-4.6.0 markdown-it-py-3.0.0 markupsafe-2.1.5 mdurl-0.1.2 pygments-2.17.2 python-slugify-8.0.4 pyyaml-6.0.1 rich-13.7.0 taskcluster-taskgraph-7.3.0 types-python-dateutil-2.8.19.20240106 urllib3-2.2.0 voluptuous-0.14.2
[task 2024-02-13T19:48:29.632Z] executing ['bash', '-cx', 'cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && ~/.local/bin/taskgraph action-callback\n']
[task 2024-02-13T19:48:29.634Z] + cd /builds/worker/checkouts/src
[task 2024-02-13T19:48:29.634Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-02-13T19:48:29.635Z] + /builds/worker/.local/bin/taskgraph action-callback
[task 2024-02-13T19:48:43.852Z] 2024-02-13 19:48:43,852 - INFO - Loading graph configuration.
[task 2024-02-13T19:48:43.868Z] 2024-02-13 19:48:43,868 - INFO - Using Parameters(id=894a75bff22a) (from defaults)
[task 2024-02-13T19:48:43.870Z] 2024-02-13 19:48:43,870 - INFO - writing artifact file `parameters.yml`
[task 2024-02-13T19:48:43.878Z] 2024-02-13 19:48:43,878 - INFO - writing artifact file `actions.json`
[task 2024-02-13T19:48:43.880Z] 2024-02-13 19:48:43,880 - INFO - Loading kinds
[task 2024-02-13T19:48:44.116Z] 2024-02-13 19:48:44,116 - INFO - Generating full task set
[task 2024-02-13T19:48:44.139Z] 2024-02-13 19:48:44,139 - INFO - Generated 7 tasks for kind dataset
[task 2024-02-13T19:48:44.140Z] 2024-02-13 19:48:44,140 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-02-13T19:48:44.157Z] 2024-02-13 19:48:44,157 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-02-13T19:48:44.157Z] 2024-02-13 19:48:44,157 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-02-13T19:48:44.158Z] 2024-02-13 19:48:44,158 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-02-13T19:48:44.176Z] 2024-02-13 19:48:44,176 - INFO - Generated 4 tasks for kind docker-image
[task 2024-02-13T19:48:44.190Z] 2024-02-13 19:48:44,190 - INFO - Generated 9 tasks for kind fetch
[task 2024-02-13T19:48:44.194Z] 2024-02-13 19:48:44,194 - INFO - Generated 5 tasks for kind tests
[task 2024-02-13T19:48:44.244Z] 2024-02-13 19:48:44,244 - INFO - Generated 9 tasks for kind toolchain
[task 2024-02-13T19:48:44.256Z] 2024-02-13 19:48:44,256 - INFO - Generated 2 tasks for kind clean-corpus
[task 2024-02-13T19:48:44.259Z] 2024-02-13 19:48:44,259 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-02-13T19:48:44.262Z] 2024-02-13 19:48:44,262 - INFO - Generated 2 tasks for kind bicleaner
[task 2024-02-13T19:48:44.266Z] 2024-02-13 19:48:44,266 - INFO - Generated 2 tasks for kind clean-mono
[task 2024-02-13T19:48:44.270Z] 2024-02-13 19:48:44,270 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-02-13T19:48:44.273Z] 2024-02-13 19:48:44,273 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-02-13T19:48:44.276Z] 2024-02-13 19:48:44,276 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-02-13T19:48:44.278Z] 2024-02-13 19:48:44,278 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-02-13T19:48:44.281Z] 2024-02-13 19:48:44,280 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-02-13T19:48:44.285Z] 2024-02-13 19:48:44,285 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-02-13T19:48:44.287Z] 2024-02-13 19:48:44,287 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-02-13T19:48:44.290Z] 2024-02-13 19:48:44,289 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-02-13T19:48:44.294Z] 2024-02-13 19:48:44,294 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-02-13T19:48:44.297Z] 2024-02-13 19:48:44,297 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-02-13T19:48:44.301Z] 2024-02-13 19:48:44,301 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-02-13T19:48:44.304Z] 2024-02-13 19:48:44,304 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-02-13T19:48:44.308Z] 2024-02-13 19:48:44,308 - INFO - Generated 2 tasks for kind extract-best
[task 2024-02-13T19:48:44.310Z] 2024-02-13 19:48:44,310 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-02-13T19:48:44.314Z] 2024-02-13 19:48:44,314 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-02-13T19:48:44.316Z] 2024-02-13 19:48:44,316 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-02-13T19:48:44.319Z] 2024-02-13 19:48:44,319 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-02-13T19:48:44.321Z] 2024-02-13 19:48:44,321 - INFO - Generated 1 tasks for kind score
[task 2024-02-13T19:48:44.323Z] 2024-02-13 19:48:44,323 - INFO - Generated 1 tasks for kind cefilter
[task 2024-02-13T19:48:44.326Z] 2024-02-13 19:48:44,326 - INFO - Generated 1 tasks for kind alignments
[task 2024-02-13T19:48:44.328Z] 2024-02-13 19:48:44,328 - INFO - Generated 1 tasks for kind train-student
[task 2024-02-13T19:48:44.331Z] 2024-02-13 19:48:44,331 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-02-13T19:48:44.333Z] 2024-02-13 19:48:44,333 - INFO - Generated 1 tasks for kind quantize
[task 2024-02-13T19:48:44.336Z] 2024-02-13 19:48:44,336 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-02-13T19:48:44.339Z] 2024-02-13 19:48:44,339 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-02-13T19:48:44.345Z] 2024-02-13 19:48:44,344 - INFO - Generated 4 tasks for kind evaluate
[task 2024-02-13T19:48:44.347Z] 2024-02-13 19:48:44,347 - INFO - Generated 1 tasks for kind export
[task 2024-02-13T19:48:44.348Z] 2024-02-13 19:48:44,348 - INFO - Generated 1 tasks for kind all
[task 2024-02-13T19:48:44.352Z] 2024-02-13 19:48:44,352 - INFO - Generated 1 tasks for kind all-pr
[task 2024-02-13T19:48:44.352Z] 2024-02-13 19:48:44,352 - INFO - Generating full task graph
[task 2024-02-13T19:48:44.352Z] 2024-02-13 19:48:44,352 - INFO - Full task graph contains 78 tasks and 216 dependencies
[task 2024-02-13T19:48:44.356Z] 2024-02-13 19:48:44,356 - INFO - writing artifact file `full-task-graph.json`
[task 2024-02-13T19:48:44.371Z] 2024-02-13 19:48:44,371 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-02-13T19:48:44.372Z] 2024-02-13 19:48:44,372 - INFO - Generating target task set
[task 2024-02-13T19:48:44.375Z] 2024-02-13 19:48:44,372 - INFO - Filter filter_target_tasks pruned 77 tasks (1 remain)
[task 2024-02-13T19:48:44.375Z] 2024-02-13 19:48:44,372 - INFO - writing artifact file `target-tasks.json`
[task 2024-02-13T19:48:44.375Z] 2024-02-13 19:48:44,372 - INFO - Generating target task graph
[task 2024-02-13T19:48:44.375Z] 2024-02-13 19:48:44,373 - INFO - Adding 4 tasks with `always_target` attribute
[task 2024-02-13T19:48:44.375Z] 2024-02-13 19:48:44,373 - INFO - Generating optimized task graph
[task 2024-02-13T19:48:44.375Z] 2024-02-13 19:48:44,374 - INFO - No tasks removed during optimization
[task 2024-02-13T19:48:45.427Z] 2024-02-13 19:48:45,426 - INFO - Replaced 27 tasks by existing_tasks, 4 tasks by index-search (index-search) during optimization.
[task 2024-02-13T19:48:45.428Z] 2024-02-13 19:48:45,428 - INFO - writing artifact file `task-graph.json`
[task 2024-02-13T19:48:45.430Z] 2024-02-13 19:48:45,430 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-02-13T19:48:45.431Z] 2024-02-13 19:48:45,431 - INFO - Creating task with taskId em9zoxLkRjWaVUFbvlhdDw for train-backwards-ru-en
[task 2024-02-13T19:48:45.434Z] 2024-02-13 19:48:45,432 - INFO - Creating task with taskId C-VohexaR6OqXMCKs5SRDA for build-docker-image-test
[task 2024-02-13T19:48:45.564Z] 2024-02-13 19:48:45,564 - INFO - Creating task with taskId OP6bx3kZQDioBZpJU4Gfrg for translate-mono-trg-ru-en-2/2
[task 2024-02-13T19:48:45.566Z] 2024-02-13 19:48:45,566 - INFO - Creating task with taskId KFs1DQQ-RCupxH0u-qnMDg for translate-mono-trg-ru-en-1/2
[task 2024-02-13T19:48:45.694Z] 2024-02-13 19:48:45,694 - INFO - Creating task with taskId QRwvX1AQRkaJEnhmYbCPvw for collect-mono-trg-ru-en
[task 2024-02-13T19:48:45.801Z] 2024-02-13 19:48:45,800 - INFO - Creating task with taskId S7WIYrfFTUqh2RoR8xns3A for train-teacher-ru-en-1/1
[taskcluster 2024-02-13 19:48:46.109Z] === Task Finished ===
[taskcluster 2024-02-13 19:48:47.957Z] Successful task run with exit code: 0 completed in 25.845 seconds